Introduction
Integrating community voices is integral to successful community-engaged research (CEnR) [Reference Mullins, Abdulhalim and Lavallee1–Reference Joosten, Israel and Head7]. By developing strategies from community voices, researchers can orient their research topics and design studies that are most beneficial to patients and communities [Reference Selby, Forsythe and Sox8–Reference Sprague Martinez, Carolan, O.'Donnell, Diaz and Freeman11]. The Clinical Translational Science Award (CTSA) program mandates strong community-academic partnerships to build researchers' capacities to advance CEnR [Reference Mathews, Anderson, Willis, Castillo and Choure10–Reference Joosten, Israel and Williams15].
The Johns Hopkins the Institute for Clinical and Translational Research (ICTR) was established in 2007 to address health equity issues among Maryland residents. Through its Community and Collaboration Core, the ICTR engages community partners, stakeholders, and researchers to codesign, implement, evaluate, and disseminate clinical and translational research. Within the Community and Collaboration Core, the Community Research Advisory Council (C-RAC) provides consultation services for researchers who request this service. From 2009–2016, the C-RAC consultation service provided researchers with a vehicle to strengthen community-academic partnerships while enhancing funding prospects. The service program also provided C-RAC members opportunities to become advisory board members for some of the studies consulted. Using post-consultation surveys in 2016 and 2017, the C-RAC analyzed data from both researchers and C-RAC members to learn about their experience with the consultation process. Results from these surveys informed an ICTR-wide stakeholder retreat meeting in 2019, which informed goals and objectives to redesign and build a framework to sustain the CEnR consultation process [Reference Han, Xu and Bahouth9].
In particular, transitioning to virtual consultation engagement due to the COVID-19 pandemic, the redesigned consultation framework has been implemented since 2020. This report reflects refinements that were made by C-RAC using the 2016–2017 post-consultation survey results and directives from the 2019 retreat [Reference Han, Xu and Bahouth9].
Initial Consultation and Post-Consultation Steps
C-RAC Composition
The C-RAC is composed of 22 members representing patients/research participants, community-based organizations, neighborhood associations, health systems, and historically black colleges and universities. Membership included twelve Blacks/African American, six White, two Asian, and two Hispanic individuals. Fifteen were female, six were male, and one was nonbinary; with mean age of 55 years. Sixteen members have served 5–7 years. Ten members were Johns Hopkins affiliates.
Researcher Composition
Researchers requesting consultation services represented disciplines including cardiology, pulmonary and critical care, human genomics, cancer, biomedical informatics, emergency medicine, infectious disease, and obstetrics-gynecology. The researchers included tenured and nontenured faculty from Johns Hopkins University.
The Original C-RAC Consultation Steps
Figure 1 displays the four original consultation steps established in 2009: (1) Researcher-initiated request, (2) Provision of prepared consultation materials to C-RAC members, (3) Consultation meeting and feedback, and (4) Technical support team’s post-consultation meetings with researchers to evaluate implementation of C-RAC recommendations. The consultation service was originally marketed through word-of-mouth, referrals, and Johns Hopkins IRB.
From 2009 to 2016, C-RAC provided 28 consultations to 25 researchers: Requests were made for 13 pre-grant submissions and 15 post-award projects. The IRB required community input from four projects.
Overall, 13 researchers requested C-RAC input on study design, six on recruitment and retention, two on data collection strategies, 8 on community advisory board formation, seven on forming partners, and five on disseminating information. The above requests overlapped among researchers.
Post-Consultation Surveys
Post-consultation surveys were administered between 2016 and 2017 to inform the consultation redesign. Qualtrics-based surveys were emailed to the 25 researchers and 22-C-RAC member participants from the 2009–2016 consultations. Fourteen of 25 researchers and 19 of 22-C-RAC members responded. Responses were exported to databases for analysis of qualitative and quantitative data separately. Frequency distribution was generated for quantitative data. The qualitative survey responses were reviewed and categorized by theme by the authors of this manuscript and other participants at the ICTR stakeholder retreat. Consensus-based themes that were generated are described in the implementation section of this report [Reference Han, Xu and Bahouth9].
Table 1 displays survey structured questions and results. The researcher survey consisted of 10 questions: three structured (nominal, discrete, ordinal) and seven open-ended, including reasons for consultation requests and satisfaction with the services. The C-RAC member survey included 16 questions: thirteen structured and three open-ended queries. The structured questions included demographics and the consultation experience of the C-RAC member. The open-ended queries generated improvement strategies for consultation services.
Researcher Satisfaction with Consultation Services
Twelve researchers found the consultation services very or extremely useful in meeting their research needs and 13 reported incorporating C-RAC recommendations into their research. All 14 researchers responded that they would likely or very likely recommend the consultation service to the research community.
Most researchers learned about the consultation service through word-of-mouth, other faculty and staff involved with ICTR, and external sources (e.g., PCORI). Most common reasons for seeking consultation were: (1) feedback on the project prior to grant submission; (2) assistance in developing a community advisory board; (3) identification of community partners. Researchers also noted the extreme helpfulness of technical staff.
Gaining access to diverse stakeholders with “lived and professional experience” helped inform study design, simplify survey instruments, and identify recruitment strategies.
Researchers incorporated C-RAC recommendations into their studies by modifying consent forms, increasing participant reimbursement rate, developing websites to disseminate study results, and recruiting and training study participants to serve as research ambassadors.
C-RAC Member Experience with Consultation Services
Fourteen C-RAC members reported participating in at least one consultation. Most frequent consultation topics were diabetes (n = 8), heart diseases (n = 6), asthma (n = 6), and Alzheimer’s disease (n = 6). C-RAC consultations provided a forum for members to inform researchers about the concerns of people living in their communities (n = 12), learn about the research process (n = 11), share research information with community members (n = 10), and hear about research relevant to their communities (n = 9). Thirteen C-RAC members were interested in increasing the number of consultations.
Ten C-RAC members were somewhat prepared for the consultations whereas six were very confident in their ability to contribute to the consultation process. Nine were also very confident of researchers using C-RAC feedback to improve their research.
To improve the consultation process, thirteen C-RAC members wanted a better understanding of research methods and getting research results back to the community. Developing research questions (n = 11) and preparing grant proposals (n = 13) were other unmet training needs for C-RAC members. The frequency of these pieces of training could be 3–4 times (n = 10) or 1–2 times a year (n = 18). via both virtual and in-person venues.
The above results informed the 2019 strategic planning meeting comprising C-RAC members, community organizations, researchers, and the ICTR. Objectives for redesigning consultation services were formulated at this retreat. The Logic Model in Fig. 2 provided the framework to achieve those objectives.
Implementation of Recommendations
Adapting to the COVID-19 Pandemic
In 2020, the COVID-19 restrictions and increased consultation requests necessitated transitioning from in-person to virtual consultation meetings from monthly to weekly, respectively. Additionally, enhanced technical support provided tablets, internet access, and virtual meeting platforms to enable community members with limited access.
Implementing Feedback on Improving the Consultation Service
The qualitative survey responses informed ways to improve the service after being reviewed and categorized by the authors and the C-RAC. Three themes emerged as follows:
-
1. Increased visibility and capacity to promote CEnR practice: There was consensus to increase the number of consultations through increased visibility and marketing. Accordingly, the service was marketed through presentations and Community and Collaboration Core website placement. Thirteen presentations at six scientific conferences and distribution of over 500 brochures at stakeholder events were useful marketing strategies. Additionally, C-RAC partnered with NIH-funded trainee (TL-1) program to mentor the next generation of researchers in CEnR practice [Reference LaFave, Wallace II and Grover19]. Since 2020, three cohorts of 36 trainees have participated in C-RAC consultations [Reference LaFave, Wallace II and Grover19]. The C-RAC also served as the advisory council for a Cardiovascular Study, COVID-19 Health Literacy research, and a COVID-19 testing study.
-
2. Training: Both researchers and C-RAC members recommended that members receive training to strengthen collaboration with researchers, including understanding of research methods and human subject protection. Between 2020 and 2022, C-RAC organized twelve training sessions on CEnR Health equity, Bioethics, Dissemination of Findings, Diversity and Inclusion, and Manuscript Development. In 2021, fourteen C-RAC members completed the Office of Human Research Protections online training certification.
-
3. Increased communication: Both groups indicated the need for instituting timely and effective communication (e.g., providing all consultation materials in advance) to improve preparedness before, and active participation during consultation sessions. C-RAC members also requested that researchers provide feedback as to whether their suggestions were implemented. In response, the number of consultations where materials were provided in advance of the meeting had more than doubled, and an increase from 3 to 45 researchers returning to C-RAC meetings to discuss implementation of recommendations was observed.
Overall, the recruitment of staff trained in CEnR practice facilitated the consultation process, and the C-RAC, by implementing a weekly schedule, conducted 114 consultations in 2020-2022.
Redesigned Consultation Service
Two additional steps were incorporated into the original four-step process: (1) Formalizing iterative interactions between technical staff and researchers to clarify the needs of the consultation and (2) Post-consultation follow-up with researchers to determine the status of their research (e.g., achieving funding or recruitment goals) and the extent to which C-RAC recommendations were implemented. To achieve these steps, a dedicated staff member was assigned to coordinate the consultation service and to work closely with the researcher and C-RAC.
Discussion and Conclusion
Our redesigned community-engaged consultation services have improved the efficiency of the research (e.g., timely reviews and dedicated support structure).
Reports on how feedback from community members and researchers was used to refine the consultation process are limited [Reference Pelfrey, Cain, Lawless, Pike and Sehgal16,Reference Vizueta, Sarkisian and Szilagyi17]. Enhancing technical support, increasing the visibility and consultation frequency, providing research training, and refining the consultation protocol have strengthened the consultation process holistically.
The C-RAC consultation process is in alignment with reports on overall satisfaction with community- consultations [Reference Joosten, Israel and Head7,Reference Mathews, Anderson, Willis, Castillo and Choure10,Reference Brockman, Balls-Berry and West14,Reference Pelfrey, Cain, Lawless, Pike and Sehgal16,Reference Vizueta, Sarkisian and Szilagyi17]. However, improvements made in response to feedback from researcher and community are insufficiently documented. Our efforts reinforce the significance of integrating community voices in improving the consultation process. These processes included: (1) advanced provision and review of consultation materials (2) bidirectional feedback on the implementation of C-RAC recommendations, (3) dedicated staff to help the researcher navigate the consultation process, and (4) training and capacity building for the C-RAC on research methods, ethics, human subject’s protection. The implementation of these changes during COVID-19 showed evidence of a noticeable increase in consultations that included COVID-19 (n = 19) and other research projects (n = 95). Increased marketing may have also sustained the C-RAC-researcher partnership.
Limitations and Future Directions
We encountered setbacks while striving to optimize the consultation process. A methodical baseline and follow-up would have helped evaluate the implementation of recommendations. In actuality, the unanticipated increase in utilization of the C-RAC consultation services during COVID-19 limited our ability to formally evaluate the implementation in a timely manner. A comprehensive evaluation of the service following the changes described here is underway.
The low response rate to the researcher’s post-consultation survey may have biased our interpretation. However, the consensus among researchers at the strategic planning retreat was that the consultation process had accelerated a timely CEnR process, albeit a few step-wise improvements were needed. Implementation of the reengineered steps and preliminary assessments not only reflects an iterative bidirectional communication between C-RAC and researchers but also shows promise of increased participation in follow-up among these integral partners.
Acknowledgments
The authors wish to acknowledge the valuable editorial suggestions and feedback on this manuscript from the following C-RAC members: Jennifer Ayana-Harrison, Patricia Carroll, Carolyn Henderson, Sharon Hunt, Janet Johnson, Cassie Lewis-Land, Aurelia Laird, Frederick Luthardt, Marvin Murphy, Darcenia McDowell, Tracy Newsome, Tyrone Qualls, Melanie Reese, Inez Robb, Mary Thomas, and Michael Thompson.
Funding statement
The work reported in this paper was made possible by the Johns Hopkins ICTR, which is funded in part by Grant Number UL1 TR003098 from the National Center for Advancing Translational Sciences (NCATS), a component of the National Institutes of Health (NIH), and NIH Roadmap for Medical Research. Its contents are solely the responsibility of the authors and do not necessarily represent the official view of the Johns Hopkins ICTR, NCATS, or NIH.
Competing interests
The authors have no conflict of interest to declare.