A multi-national, video-based qualitative study to refine training guidelines for assigning an “unsafe” score in laparoscopic cholecystectomy critical view of safety

Background: The critical view of safety (CVS) was incorporated into a novel 6-item objective procedure-specific assessment for laparoscopic cholecystectomy (LC-CVS OPSA) to enhance focus on safe completion of surgical tasks and advance the American Board of Surgery’s entrustable professional activities (EPAs) initiative. To enhance instrument development, a feasibility study was performed to elucidate expert surgeon perspectives regarding “safe” vs. “unsafe” practice. Methods: A multi-national consortium of 11 expert LC surgeons were asked to apply the LC-CVS OPSA to ten LC videos of varying surgical difficulty using a “safe” vs. “unsafe” scale. Raters were asked to provide written rationale for all “unsafe” ratings and invited to provide additional feedback regarding instrument clarity. A qualitative analysis was performed on written responses to extract major themes. Results: Of the 660 ratings, 238 were scored as “unsafe” with substantial variation in distribution across tasks and raters. Analysis of the comments revealed three major categories of “unsafe” ratings: (a) inability to achieve the critical view of safety (intended outcome), (b) safe task completion but less than optimal surgical technique, and (c) safe task completion but risk for potential future complication. Analysis of reviewer comments also identified the potential for safe surgical practice even when CVS was not achieved, either due to unusual anatomy or severe pathology preventing safe visualization. Based upon findings, modifications to the instructions to raters for the LC-CVS OPSA were incorporated to enhance instrument reliability. Conclusions: A safety-based LC-CVS OPSA has the potential to significantly improve surgical training by incorporating CVS formally into learner assessment. This study documents the perspectives of expert biliary tract surgeons regarding clear identification and documentation of unsafe surgical practice for LC-CVS and enables the development of training materials to improve instrument reliability. Learnings from the study have been incorporated into rater instructions to enhance instrument reliability.