A dynamic application of PRECIS-2 to evaluate implementation in a pragmatic, cluster randomized clinical trial in two nursing home systems

Jennifer A. Palmer, Vincent Mor, Angelo E. Volandes, Ellen McCreedy, Lacey Loomer, Phoebe Carter, Faye Dvorchak, Susan L. Mitchell

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Background: PRECIS-2 (PRagmatic Explanatory Continuum Indicator Summary-2) can assess how clinical trial design decisions (along the explanatory-pragmatic continuum) influence the applicability of trial results to intended stakeholders. The tool has been used to assess features of trials during the trial design phase and also upon completion. The ongoing PRagmatic trial Of Video Education in Nursing homes (PROVEN), which is evaluating the effectiveness of a suite of videos to improve advance care planning, is one of the first large pragmatic, cluster randomized trials within nursing home health care systems. While certain features of pragmatic trials remain static once designed (e.g., recruitment, outcomes), successful implementation of a system-wide program requires on-going evaluation and adaptation. This report's objectives were to apply PRECIS-2 in a novel manner during the actual conduct of the PROVEN trial to assess how dynamic adaptations shifted implementation to either a more explanatory or a more pragmatic approach. Methods: We assessed PROVEN's protocol as initially designed according to the three PRECIS-2 domains pertinent to implementation: (1) Organization, (2) Flexibility-Delivery, and (3) Flexibility-Adherence. We then applied this framework to conduct a formative evaluation of decisions made while the trial was ongoing to adapt the implementation approach along the pragmatic versus the explanatory continuum in response to emergent challenges. Results: Based on the PRECIS-2 rubric, the initial design of the PROVEN implementation approach reflected a hybrid of pragmatic and explanatory features. Most notably, within the Flexibility-Delivery, the trial had a relatively pragmatic approach to protocol delivery by front-line nursing home providers, balanced with a more explanatory approach to protocol monitoring enabled by the analytic capabilities of the research team. This more intensive monitoring proved critical in revealing implementation problems once the study began. Dynamic adaptations made in response to these challenges generally reflected shifts to more explanatory approaches within the Flexibility-Delivery and Flexibility-Adherence domains including ever more intensive compliance monitoring, as well as detailed coaching of front-line providers delivering the intervention by the research team. Conclusions: Pragmatic trials conducted in the nursing home setting may benefit from a more dynamic approach to implementation. Allowing fluidity between pragmatic and explanatory features may still preserve the trial's applicability to intended stakeholders' needs. PRECIS-2 provides a useful formative evaluation tool to assess these adaptations in "real-time."

Original languageEnglish (US)
Article number453
JournalTrials
Volume19
Issue number1
DOIs
StatePublished - Aug 22 2018
Externally publishedYes

Bibliographical note

Funding Information:
The planned 18-month implementation period began on 1 March 2016 in staggered waves (approximately 30 intervention facilities/wave) with all facilities on board by 1 June 2016. The implementation strategy was collaboratively designed by the RT and corporate leaders but executed primarily by the HCS by leveraging existing infrastructures for new program roll-out. Each HCS assigned a corporate-level administrator to broadly oversee the project and, with funding from the research grant, also hired a 50% full-time equivalent clinical education specialist specifically dedicated to leading program implementation. At each facility, one or more providers were designated as ACP champions to lead on-the-ground implementation. One principal investigator (AEV) and one full-time project director on the RT were dedicated to the implementation effort.

Publisher Copyright:
© 2018 The Author(s).

Keywords

  • Implementation
  • Nursing homes
  • PRECIS-2
  • Pragmatic trial

Fingerprint

Dive into the research topics of 'A dynamic application of PRECIS-2 to evaluate implementation in a pragmatic, cluster randomized clinical trial in two nursing home systems'. Together they form a unique fingerprint.

Cite this