TY - JOUR
T1 - Validation of the AUA BLUS Tasks
AU - Kowalewski, Timothy M.
AU - Sweet, Robert
AU - Lendvay, Thomas S.
AU - Menhadji, Ashleigh
AU - Averch, Timothy
AU - Box, Geoffrey
AU - Brand, Timothy
AU - Ferrandino, Michael
AU - Kaouk, Jihad
AU - Knudsen, Bodo
AU - Landman, Jaime
AU - Lee, Benjamin
AU - Schwartz, Bradley F.
AU - McDougall, Elspeth
N1 - Publisher Copyright:
© 2016 American Urological Association Education and Research, Inc.
PY - 2016/4
Y1 - 2016/4
N2 - Purpose Standardized assessment of laparoscopic skill in urology is lacking. We investigated whether the AUA (American Urological Association) BLUS (Basic Laparoscopic Urologic Skills) skill tasks are valid to address this need. Materials and Methods This institutional review board approved study included 27 medical students, 42 urology residents, 18 fellows and 37 faculty urologists across 8 sites. Using the EDGE (Electronic Data Generation and Evaluation) device (Simulab, Seattle, Washington) 454 recordings were collected on peg transfer, pattern cutting, suturing and clip applying tasks, which together comprise the expert determined BLUS tasks. We collected synchronized video and tool motion data for each trial. For each task errors, time, path length, economy of motion, peak grasp force and EDGE score were collected. An expert panel of 5 faculty members performed GOALS (Global Objective Assessment of Laparoscopic Skills) evaluations on a representative subset of peg transfer and suturing skill tasks performed by 24 participants (IRR = 0.95). Results Demographically derived skill levels proved unsuitable to evaluate construct validity. Separation of mean scores by grouped skill levels was strongest for the suturing task. Objective motion metrics and errors supported construct validity vis-à-vis correlation with blinded expert video ratings (motion metrics R2 = 0.95, p <0.01). Expert scores appeared to reward errors in suturing but not in block transfer. Conclusions BLUS skill task performance scoring can discriminate among basic laparoscopic technical skill levels. Self-reported demographics are an unreliable source of determining laparoscopic technical skill.
AB - Purpose Standardized assessment of laparoscopic skill in urology is lacking. We investigated whether the AUA (American Urological Association) BLUS (Basic Laparoscopic Urologic Skills) skill tasks are valid to address this need. Materials and Methods This institutional review board approved study included 27 medical students, 42 urology residents, 18 fellows and 37 faculty urologists across 8 sites. Using the EDGE (Electronic Data Generation and Evaluation) device (Simulab, Seattle, Washington) 454 recordings were collected on peg transfer, pattern cutting, suturing and clip applying tasks, which together comprise the expert determined BLUS tasks. We collected synchronized video and tool motion data for each trial. For each task errors, time, path length, economy of motion, peak grasp force and EDGE score were collected. An expert panel of 5 faculty members performed GOALS (Global Objective Assessment of Laparoscopic Skills) evaluations on a representative subset of peg transfer and suturing skill tasks performed by 24 participants (IRR = 0.95). Results Demographically derived skill levels proved unsuitable to evaluate construct validity. Separation of mean scores by grouped skill levels was strongest for the suturing task. Objective motion metrics and errors supported construct validity vis-à-vis correlation with blinded expert video ratings (motion metrics R2 = 0.95, p <0.01). Expert scores appeared to reward errors in suturing but not in block transfer. Conclusions BLUS skill task performance scoring can discriminate among basic laparoscopic technical skill levels. Self-reported demographics are an unreliable source of determining laparoscopic technical skill.
KW - clinical competence
KW - education
KW - laparoscopy/standards
KW - medical
KW - urologic surgical procedures/education
KW - validation studies
UR - http://www.scopus.com/inward/record.url?scp=84975173929&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84975173929&partnerID=8YFLogxK
U2 - 10.1016/j.juro.2015.10.087
DO - 10.1016/j.juro.2015.10.087
M3 - Article
C2 - 26527514
AN - SCOPUS:84975173929
SN - 0022-5347
VL - 195
SP - 998
EP - 1005
JO - Journal of Urology
JF - Journal of Urology
IS - 4
ER -