Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-27T19:25:58.674Z Has data issue: false hasContentIssue false

The RIC COVID-19 Recruitment & Retention Toolkit: A community-informed resource of recruitment tools and strategies for clinical trial investigators

Published online by Cambridge University Press:  19 July 2022

Nan Kennedy*
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Julia Dunagan
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Leslie R. Boone
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Tiffany Israel
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Stephanie A. Mayers
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Leah Dunkel
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Sarah Cook
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Pamela Pimentel
Affiliation:
Community Research Consultant, Santa Ana, CA, USA Community Advisory Board, Recruitment Innovation Center, Nashville, TN, USA
Terri L. Edwards
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Mary Stroud
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA
Consuelo H. Wilkins
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA Department of Internal Medicine, Meharry Medical College, Nashville, TN, USA Office of Health Equity, Vanderbilt University Medical Center, Nashville, TN, USA
Paul A. Harris
Affiliation:
Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, Nashville, TN, USA Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA
*
Address for correspondence: N. Kennedy, MLAS, Vanderbilt Institute for Clinical and Translational Research, Vanderbilt University Medical Center, 2525 West End Ave., Nashville, TN 37203, USA. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

The Recruitment Innovation Center (RIC) has created a toolkit of novel strategies to engage potential participants in response to recruitment and retention challenges associated with COVID-19 studies. The toolkit contains pragmatic, generalizable resources to help research teams increase awareness of clinical trials and opportunities to participate; produce culturally sensitive and engaging recruitment materials; improve consent and return of results processes; and enhance recruitment of individuals from populations disproportionately impacted by COVID-19. This resource, the “RIC COVID-19 Recruitment and Retention Toolkit,” is available free online. We describe the toolkit and the community feedback used to author and curate this resource.

Type
Brief Report
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of The Association for Clinical and Translational Science

Introduction

Early data from the SARS-CoV-2 pandemic demonstrated a disproportionate impact of COVID-19 infection, hospitalization, and mortality rates among Black, Hispanic, and Asian communities compared to the white population [Reference Rubin-Miller and Alban1]. Moreover, the pandemic altered the clinical trial landscape and created challenges in participant recruitment and retention for both COVID- and non-COVID-related studies. Innovative solutions designed to make trials safer and less burdensome to participants during the pandemic [2] can also improve clinical trial recruitment going forward, especially with respect to disadvantaged populations that already face greater barriers to clinical trial participation.

The Vanderbilt Recruitment Innovation Center (RIC) [Reference Wilkins, Edwards and Stroud3], part of the Trial Innovation Network (TIN) [Reference Bernard, Harris and Pulley4,Reference Shah, Culp and Gersing5], is our nation’s only federally funded center charged with developing and field-testing new strategies and methods to catalyze multisite clinical trial recruitment. The RIC’s transdisciplinary team of experts in community engagement, recruitment material development, and informatics methods has consulted on recruitment strategies for over 36 COVID-19 treatment trials. This extensive experience, gleaned in a short period of time, led to development of new strategies and tools that specifically address recruitment and retention challenges unique to, or exacerbated by, the pandemic. These methods, guidelines, and community-informed recommendations have been compiled into the “RIC COVID-19 Recruitment and Retention Toolkit” (Fig. 1). This toolkit, free and easily accessible on the TIN website [6], seeks to expand capacity and expertise for study teams as they strive to conduct trials in a manner that is safe, trustworthy, and respectful of all participants.

Fig. 1. The RIC COVID-19 Recruitment & Retention Toolkit. Key: RIC – Recruitment Innovation Center.

This paper describes how the toolkit was created and disseminated. It also provides guidance to others who may be developing research-related toolkits on how to use community feedback to ensure that guidelines and strategies they develop are culturally sensitive and relevant to racial and ethnic populations they seek to include as research participants.

Methods

The RIC consulted on design and implementation for 36 COVID-related clinical trials in 2020 and 2021. In the process, we developed and refined new tools and methods for recruitment and retention during COVID-19. We compiled these resources into a toolkit, which includes screening and consenting tools, templates for clinician-facing study information sheets and for returning study results to participants, and best practices guidelines for designing participant-facing websites, recruitment materials, and videos. To augment these resources and further inform their development and usefulness, the RIC also compiled community input on clinical trial recruitment and retention practices, by means of both formal and informal discussions with members and leaders of diverse communities. We gathered and organized the feedback, then synthesized and categorized the accumulated information. Figure 2 details the types and numbers of community members involved, the forms of interactions, and the areas in which their advice and suggestions informed the toolkit.

Fig. 2. Community feedback used to inform the development of the RIC COVID-19 Recruitment and Retention Toolkit. Key: RIC – Recruitment Innovation Center; CAB – Community Advisory Board. *The number of community members who offered informal suggestions through these channels was not tallied.

Community Engagement

The Community Engagement (CE) Studio model is a structured approach to eliciting feedback from diverse groups of community stakeholders, who are considered experts in the topic under study by means of their lived experiences [Reference Joosten, Israel and Williams8]. To leverage the extensive community engagement work the RIC had already completed, we identified 89 past CE Studios that engaged a total of 1357 diverse community members, for which the primary focus was recruitment and retention. Of these 89 CE Studios, 8 recruited individuals specifically from groups disproportionately impacted by COVID-19, including persons from underserved racial and ethnic groups, older adults, healthcare and essential workers, and individuals living in COVID-19 outbreak hotspots. These eight Studios focused on community members’ thoughts and opinions on implementation of planned COVID-19 research. To locate and garner the ideas of greatest relevancy to COVID-19 recruitment and retention, we read compilations of findings from each of the 89 Studios. Next, we aggregated the recommendations by key demographics and synthesized the information into toolkit categories (see Toolkit Description and Content).

Ad Hoc Community Feedback

We also received informal, anecdotal feedback from other community sources, including participants in five early COVID-19 trials (commenting through study staff), ad hoc conversations with community members who called our COVID-19 clinical trial registration hotline, and at two presentations on current COVID-19 research to community organizations. This feedback, while not part of a formal process, uncovered real-world examples of barriers to COVID-19 trial participation that we deemed valuable to share with other researchers. For example, we learned the importance of establishing methods to safeguard participant privacy during COVID-19 trials; designing and providing easily understood educational materials about the virus and treatment; and being prepared to assist potential participants seeking medical care. This anecdotal feedback is labeled as “Lessons Learned” in the toolkit.

Community Advisory Board (CAB)

Additionally, as we developed the toolkit, we gathered iterative input from the RIC Community Advisory Board (CAB) at two consultative meetings. The RIC CAB, a panel of 12 members representing diverse communities across the United States, regularly provides recommendations and guidance to the RIC team to ensure that our strategies and materials reflect the needs, priorities, and values of the wider community. Input from the RIC CAB led to wording changes that made the toolkit more culturally sensitive and participant-focused, and was used to develop a summary of 20 strategies to increase inclusivity of populations disproportionately impacted by COVID-19 and underrepresented in clinical research.

Toolkit Description and Content

The toolkit is organized by steps a researcher might take to optimize recruitment, retention, and return of value during the lifecycle of a participant’s journey – from study awareness and opportunity, the invitation to participate, and consenting, through continuing engagement and retention, and finishing with return of study results or study value to participants. Figure 3 shows this continuum and examples of recommendations received from the community on how best to implement each of these steps. The entire compendium of stakeholder advice can be found in the toolkit.

Fig. 3. Continuum of clinical trial recruitment activities and examples of community feedback to support those activities.

Awareness and Opportunity

Community experts offered a range of ideas on expanding awareness of COVID-19 studies and increasing the opportunity to participate by reducing or eliminating barriers to participation. These included collaborating with local and state government and health agency leaders to promote studies in press announcements; partnering with local organizations and companies such as unions, restaurants, and childcare centers to expand outreach; and approaching patients upon admission for hospital-based studies to allow ample time for decision-making.

Screening

The toolkit describes the development of a COVID-19 Research Data Mart [Reference Helmer, Lewis and McEver9] for efficient participant screening. The Data Mart is a REDCap [Reference Harris, Taylor, Thielke, Payne, Gonzalez and Conde10] (Research Electronic Data Capture) database of COVID-19-positive patients who have agreed to direct contact about COVID-19 research opportunities. Since VUMC operates as an opt-in institution for research contact, a COVID-specific workflow was initiated. All patients who receive a COVID-19 test at a VUMC facility receive a "Consent to Contact" message via email (default) or SMS message. Custom logic reflecting study-specific inclusion and exclusion criteria facilitates real-time matching of active studies with potentially eligible patients. Approximately 3000 individuals who tested positive for COVID-19 responded favorably to being contacted directly and were matched to studies in the COVID-19 Data Mart. While the Data Mart is proprietary to Vanderbilt, we published a paper [Reference Helmer, Lewis and McEver9] to disseminate our efforts broadly. Other institutions can use REDCap (free to academic research institutions) and our published process to pattern their own efforts after ours.

Invitation to Participate

Recruitment materials, including tailored content and design geared toward specific audiences, can have a major impact on recruitment success. Using best practices generated through community stakeholder feedback, the RIC developed or provided input on multiple, varied COVID-19 study materials such as flyers with QR Codes linked to study recruitment websites, study fact sheets and consent discussion guides, mobile apps for clinicians to share information with their patients about relevant studies, social media messaging, and educational and instructional videos. Examples of these materials are displayed in the toolkit.

An example of how the RIC incorporated community feedback to develop materials specific to recruitment during COVID-19 is found in the Passive Immunity Trial for Our Nation (Pass It On) Study. Pass It On was a multi-center clinical trial evaluating the use of convalescent plasma in hospitalized COVID-19 patients. Community feedback, especially from racially and ethnically diverse communities, was collected and applied to craft the trial’s public-facing study website, social media presence, and videos explaining the trial and its importance. Pass It On enrolled 974 patients across 26 trial sites, with 40% of study participants identifying as a member of a marginalized racial or ethnic population. Examples of the successful recruitment materials from this study are included in the toolkit.

Consent and Enrollment

In challenging clinical trial circumstances, such as those confronting research teams during the COVID-19 pandemic, electronic consenting (eConsent [Reference Lawrence, Dunkel and McEver11]) is especially salient, as it can facilitate consenting accomplished remotely. The eConsent process has been enriched by recommendations from community experts and can be further enhanced with customization ideas from the toolkit. Feedback from diverse groups of community stakeholders informed formatting, tools, and recommendations relating to eConsent, including integration of photos and videos, additional tools to facilitate consenting in multiple languages, and options to improve accessibility (e.g., option for consent language to be read aloud).

Engagement and Retention

Participant engagement and retention are necessary for achieving successful study completion goals. Expert advice from the community stresses consistent communication with participants, an emphasis on the value of the study, and the provision of fair compensation as critical methods to retain participants.

Return of Results and Return of Value

Researchers have an ethical obligation to share study findings with participants, who are partners in the research. Participants have consistently expressed a desire to receive research results for studies they take part in [Reference Long, Stewart, Cunningham, Warmack and McElfish12,Reference Purvis, Abraham, Long, Stewart, Warmack and McElfish13], and they prefer that these findings be presented to them in an engaging format [Reference Harris, Taylor, Thielke, Payne, Gonzalez and Conde10]. The toolkit contains an example of a study result graphic and a link to study results templates. In addition, other types of information that participants value just as highly as results [Reference Wilkins, Mapes, Jerome, Villalta-Gil, Pulley and Harris14Reference Cook, Mayers and Goggins16] are documented in the toolkit.

Toolkit Format and Dissemination

The toolkit was designed to be visually appealing, with color graphics, bulleted advice from community experts, and sidebars of “Lessons Learned.” Investigators can navigate easily through the document to locate needed information. Some of the RIC’s existing tools and methods were adapted to suit particular recruitment needs during the pandemic, while others were newly conceived and developed by the RIC to address specific challenges and gaps.

The COVID-19 Recruitment and Retention Toolkit was posted on February 5, 2021, on the TIN website in the TIN Toolbox. It has been widely disseminated to researchers through national webinars and announcements on the TIN website. An updated toolkit, containing additional materials and improvements in verbiage and formatting, was disseminated in July 2021. Since its initial posting, the toolkit has been viewed or downloaded 925 times (as of June 30, 2022).

Discussion

Throughout the toolkit, particular attention is paid to modalities for supporting inclusion of all populations in COVID-19 clinical research, especially members of racial and ethnic populations most heavily impacted by COVID-19 and individuals with limited English-language proficiency. By including members of the non-academic community on research teams or involving community health workers and community partners as “bridge alternatives” or liaisons, trust in researchers can be built organically. The toolkit contains a compilation of recommendations geared specifically toward the goal of helping research teams view recruitment activities through the lens of diversity.

Toolkits consisting of guidelines, strategies, and templates have become popular vehicles for distributing information to healthcare providers and the public alike [Reference Barac, Stein, Bruce and Barwick17]. The development of toolkits designed to disseminate clinical trial methods and strategies to investigators has also begun to take hold [Reference Dolor, Schmit, Graham, Fox and Baldwin18,Reference Chambers, Harris, Lusk and Benczkowski19], including those with the express purpose of increasing involvement of participants and community-based organizations in the research process [Reference Dolor, Greene, Thompson, Baldwin and Neale20,Reference Bagley, Short and Harman21]. To our knowledge, however, no published toolkit for clinical research has used community feedback as a core process for informing a toolkit’s materials. The RIC COVID-19 Recruitment & Retention Toolkit demonstrates that using community engagement principles and informal feedback processes to yield insights and suggest new strategies can be both valuable and attainable.

Limitations and Evaluations

Because the toolkit was developed rapidly during the pandemic, no formal evaluation has been conducted to evaluate investigator success in increasing recruitment and retention through use of the toolkit’s materials. However, we currently collect institutional affiliation and contact information from individuals who download the toolkit; we plan to conduct a survey to evaluate toolkit usage and impact on enhancing recruitment and retention. Findings will be used to reveal gaps in knowledge and implementation and inform future iterations of the toolkit, as we expect to update and expand it over time as more community feedback becomes available.

Conclusion

The challenging clinical trial milieu necessitated by COVID-related concerns and restrictions has forced clinical trial investigators to devise new strategies to conduct research in a way that feels safe, convenient, and attractive to potential participants from diverse backgrounds and circumstances. The RIC COVID-19 Recruitment & Retention Toolkit was created to provide researchers with novel strategies and resources to help them achieve their recruitment and retention goals, while also motivating them to turn to community feedback, especially from populations disproportionately affected by a condition or disease, more readily and enthusiastically when developing their own research plans, methods, and toolkits.

Acknowledgments

The RIC acknowledges and sincerely thanks the individuals who have contributed their expertise and input to this toolkit, especially RIC team members, RIC Community Advisory Board members, Community Engagement Studio experts, and all other contributing community members and leaders. We thank Caitlin Rantala for her assistance in designing the figures.

This project was supported by awards no. UL1 TR002243 from the National Center for Advancing Translational Sciences (NCATS), the Vanderbilt Institute for Clinical and Translational Research grant no. UL1 TR000445 from NCATS/NIH, and The Recruitment Innovation Center – RIC (U24TR001579) from NCATS. Its contents are solely the responsibility of the authors and do not necessarily represent official views of NCATS or NIH.

Disclosures

The authors have no conflicts of interest to declare.

References

Rubin-Miller, L, Alban, C. COVID-19 Racial Disparities in Testing, Infection, Hospitalization, and Death: Analysis of Epic Patient Data. KFF, September 16, 2020. (https://www.kff.org/coronavirus-covid-19/issue-brief/covid-19-racial-disparities-testing-infection-hospitalization-death-analysis-epic-patient-data/)Google Scholar
Wilkins, CH, Edwards, TL, Stroud, M, et al. The Recruitment Innovation Center: developing novel, person-centered strategies for clinical trial recruitment and retention. Journal of Clinical and Translational Science 2021; 5(1): 135. DOI 10.1017/cts.2021.841.Google ScholarPubMed
Bernard, GR, Harris, PA, Pulley, JM, et al. A collaborative, academic approach to optimizing the national clinical research infrastructure: the first year of the Trial Innovation Network. Journal of Clinical and Translational Science 2018; 2(4): 187192. DOI 10.1017/cts.2018.319.Google ScholarPubMed
Shah, M, Culp, M, Gersing, K, et al. Early vision for the CTSA Program Trial Innovation Network: a perspective from the National Center for Advancing Translational Sciences. Clinical and Translational Science 2017; 10(5): 311313. DOI 10.1111/cts.12463.Google ScholarPubMed
Wilkins, CH. Effective engagement requires trust and being trustworthy. Medical Care 2018; 56(10 Suppl 1): S6S8. DOI 10.1097/MLR.0000000000000953.Google ScholarPubMed
Joosten, YA, Israel, TL, Williams, NA, et al. Community engagement studios: a structured approach to obtaining meaningful input from stakeholders to inform research. Academic Medicine 2015; 90(12): 16461650. DOI 10.1097/ACM.0000000000000794.10.1097/ACM.0000000000000794CrossRefGoogle ScholarPubMed
Helmer, TT, Lewis, AA, McEver, M, et al. Creating and implementing a COVID-19 recruitment Data Mart. Journal of Biomedical Informatics 2021; 117(10): 103765. DOI 10.1016/j.jbi.2021.103765.10.1016/j.jbi.2021.103765CrossRefGoogle ScholarPubMed
Harris, PA, Taylor, R, Thielke, R, Payne, J, Gonzalez, N, Conde, JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics 2009; 42(2): 377381. DOI 10.1016/j.jbi.2008.08.010.Google ScholarPubMed
Lawrence, CE, Dunkel, L, McEver, M, et al. A REDCap-based model for electronic consent (eConsent): moving toward a more personalized consent. Journal of Clinical and Translational Science 2020; 4(4): 345353. DOI 10.1017/cts.2020.30.10.1017/cts.2020.30CrossRefGoogle Scholar
Long, CR, Stewart, MK, Cunningham, TV, Warmack, TS, McElfish, PA. Health research participants’ preferences for receiving research results. Clinical Trials 2016; 13(6): 582591. DOI 10.1177/1740774516665598.Google ScholarPubMed
Purvis, RS, Abraham, TH, Long, CR, Stewart, MK, Warmack, TS, McElfish, PA. Qualitative study of participants’ perceptions and preferences regarding research dissemination. AJOB Empirical Bioethics 2017; 8(2): 6974. DOI 10.1080/23294515.2017.1310146.Google ScholarPubMed
Wilkins, CH, Mapes, BM, Jerome, RN, Villalta-Gil, V, Pulley, JM, Harris, PA. Understanding what information is valued by research participants, and why. Health Affairs (Millwood) 2019; 38(3): 399407. DOI 10.1377/hlthaff.2018.05046.10.1377/hlthaff.2018.05046CrossRefGoogle Scholar
National Academies of Sciences, Engineering, and Medicine, Health and Medicine Division, Board on Health Sciences Policy, et al. Principles for the Return of Individual Research Results: Ethical and Societal Considerations. Washington, DC: National Academies Press (US), 2018.Google Scholar
Cook, S, Mayers, S, Goggins, K, et al. Assessing research participant preferences for receiving study results. Journal of Clinical and Translational Science 2020; 4(3): 243249. DOI 10.1017/cts.2019.427.10.1017/cts.2019.427CrossRefGoogle Scholar
Barac, R, Stein, S, Bruce, B, Barwick, M. Scoping review of toolkits as a knowledge translation strategy in health. BMC Medical Informatics and Decision Making 2014; 14(1): 121. DOI 10.1186/s12911-014-0121-7.10.1186/s12911-014-0121-7CrossRefGoogle ScholarPubMed
Dolor, RJ, Schmit, KM, Graham, DG, Fox, CH, Baldwin, LM. Guidance for researchers developing and conducting clinical trials in practice-based research networks (PBRNs). The Journal of the American Board of Family Medicine 2014; 27(6): 750758. DOI 10.3122/jabfm.2014.06.140166.10.3122/jabfm.2014.06.140166CrossRefGoogle Scholar
Chambers, LW, Harris, M, Lusk, E, Benczkowski, D. Guide to enable health charities to increase recruitment to clinical trials on dementia. Alzheimer’s & Dementia: Translational Research & Clinical Interventions 2017; 3(4): 584592. DOI 10.1016/j.trci.2017.08.008.Google ScholarPubMed
Dolor, RJ, Greene, SM, Thompson, E, Baldwin, LM, Neale, AV. Partnership-driven resources to improve and enhance research (PRIMER): a survey of community-engaged researchers and creation of an online toolkit. Clinical and Translational Science 2011; 4(4): 259265. DOI 10.1111/j.1752-8062.2011.00310.x.10.1111/j.1752-8062.2011.00310.xCrossRefGoogle ScholarPubMed
Bagley, HJ, Short, H, Harman, NL, et al. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials – a work in progress. Research Involvement and Engagement 2016; 2(1): 15. DOI 10.1186/s40900-016-0029-8.10.1186/s40900-016-0029-8CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. The RIC COVID-19 Recruitment & Retention Toolkit. Key: RIC – Recruitment Innovation Center.

Figure 1

Fig. 2. Community feedback used to inform the development of the RIC COVID-19 Recruitment and Retention Toolkit. Key: RIC – Recruitment Innovation Center; CAB – Community Advisory Board. *The number of community members who offered informal suggestions through these channels was not tallied.

Figure 2

Fig. 3. Continuum of clinical trial recruitment activities and examples of community feedback to support those activities.