Journal of Endourology Interobserver Reliability and Reproducibility of S.T.O.N.E. Nephrolithometry for Renal Calculi (doi: 10.1089/end.2013.0289) This article has been peer-reviewed and accepted for publication, but has yet to undergo copyediting and proof correction. The final published version may differ from this proof.
Page 1 of 16
1 Interobserver Reliability and Reproducibility of S.T.O.N.E. Nephrolithometry for Renal Calculi
Zhamshid Okhunov1, Mohammad Helmy2, Alberto Perez-Lansac 1, Ashleigh Menhadji1, Philip Bucur1, Surendra B. Kolla1, Jane S. Cho1, Kathy Osann3, Achim Lusch1, and Jaime Landman1
1. Department of Urology, University of California, Irvine 2. Department of Radiology, University of California, Irvine 3. Department of Biostatistics, University of California, Irvine
Corresponding Author: Jaime Landman, MD Professor of Urology and Radiology Chairman, Department of Urology University of California, Irvine 333 City Boulevard, Suite 2100 Orange, CA 92868
[email protected] Key words: kidney calculi, percutaneous nephrolithotomy, interobserver variability, reproducibility, classification;
1
Journal of Endourology Interobserver Reliability and Reproducibility of S.T.O.N.E. Nephrolithometry for Renal Calculi (doi: 10.1089/end.2013.0289) This article has been peer-reviewed and accepted for publication, but has yet to undergo copyediting and proof correction. The final published version may differ from this proof.
Page 2 of 16
2 Abstract: Objective: To assess the reliability of the S.T.O.N.E. nephrolithometry scoring system by testing its reproducibility between different observers. Methods: Preoperative images of 58 subjects that underwent PCNL were reviewed. Medical students, urology residents, one fellow and a urology attending independently reviewed all images and scored the renal stones. Interobserver reliabilities of the total score for all categories and each component were evaluated by the intraclass correlation (ICC) and a Kappa coefficient. Results: The interobserver reliability for the total score demonstrated high correlations for all components and total score (ICC = S, T, O, N, E and total 0.80, 0.97, 0.89, 0.84, 0.91 and 0.87 respectively). Kappa rates for individual components between 2 medical students were 0.36, 1, 0.31, 0.45, 0.33 and 0.30 for the S, T, O, N, E components and total score, respectively. Kappa values between the two urology residents were 0.71, 1, 0.92, 0.79, 0.93 and 0.67 for S, T, O, N, E components and total score respectively. Kappa values between the urology fellow and an attending physician were 0.95, 1, 0.88, 0.94, 0.89 and 0.87 for S, T, O, N, E components and total score respectively. P value for all the scoring components was
