Hostname: page-component-745bb68f8f-b95js Total loading time: 0 Render date: 2025-01-11T22:34:40.476Z Has data issue: false hasContentIssue false

Local context review by single institutional review boards: Results from a modified Delphi process

Published online by Cambridge University Press:  18 December 2024

Stephanie R. Morain*
Affiliation:
Johns Hopkins Berman Institute of Bioethics, Baltimore, MD, USA Department of Health Policy & Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
Juli Bollinger
Affiliation:
Johns Hopkins Berman Institute of Bioethics, Baltimore, MD, USA
Megan K. Singleton
Affiliation:
Johns Hopkins University School of Medicine, Baltimore, MD, USA
Mia Terkowitz
Affiliation:
Institute for Clinical and Translational Research, Johns Hopkins University, Baltimore, MD, USA
Christine Weston
Affiliation:
Department of Health Policy & Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA Institute for Clinical and Translational Research, Johns Hopkins University, Baltimore, MD, USA
Jeremy Sugarman
Affiliation:
Johns Hopkins Berman Institute of Bioethics, Baltimore, MD, USA Department of Health Policy & Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA Johns Hopkins University School of Medicine, Baltimore, MD, USA
*
Corresponding author: S. Morain; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Introduction:

Local context is the most common concern regarding use of a single institutional review board (sIRB). Yet what “local context” constitutes remains underspecified. Developing a shared understanding of the goals of local context review, the categories of information that should be considered, as well as the types of studies for which sIRB review may be inappropriate, are critical for ensuring that sIRB review provides adequate protections for human subjects.

Methods:

We conducted a three-round modified Delphi process convening individuals with expertise in the conduct and oversight of multisite research. Delphi surveys explored: (1) the goals of local context review; (2) the types of information that should be considered; and (3) study types that should be exempted from sIRB requirements.

Results:

Twenty-one experts participated. Experts agreed that (1) local context review should aim to both protect local participants and ensure compliance and (2) that four types of information should be considered (population/participant-level characteristics; investigator and research team characteristics; institution-level characteristics; and state and local laws). There was less consensus about whether existing processes facilitated adequate consideration of this information. Experts agreed that exemptions from sIRB requirements should be permitted but disagreed about when and in what circumstances.

Conclusion:

There is overlapping consensus about both the goals of local context review and the types of information that should be assessed. Future work remains, however, to develop effective processes to best realize the goals of local context review – and do so with appropriate efficiency.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Association for Clinical and Translational Science

Introduction

Using a single institutional review board (sIRB) is now required for most United States (US) federally funded multisite research [Reference Taylor, Ehrhardt and Ervin1]. The most common concern regarding sIRBs relates to the need to consider the local context in which proposed research will be conducted [Reference Taylor, Ehrhardt and Ervin1]. According to the US National Institutes of Health (NIH) regulations governing the use of sIRBs, participating sites are expected to communicate “relevant information necessary for the single IRB to consider local context issues and state and regulatory requirements” [2]. Yet what, exactly, “local context issues” constitutes remains underspecified [Reference Klitzman, Pivovarova and Lidz3Reference Johnson, Kasimatis Singleton and Ozier5]. What are the goals of local context review? What types of information should it consider? And are there some types of research studies for which local considerations are sufficiently important or distinctive so as to make sIRB review inappropriate?

A prior scoping review explored these issues [Reference Morain, Singleton, Tsiandoulas, Bollinger and Sugarman6]. It identified five potential goals for local context review: (1) protecting the rights and welfare of local participants; (2) ensuring compliance with applicable laws and policies; (3) assessing feasibility; (4) promoting the quality of research; and (5) promoting procedural justice. It also identified four categories of information that might be considered as part of local context review: (1) population/participant-level characteristics; (2) investigator and research team characteristics; (3) institution-level characteristics; (4) state and local laws; and (5) characteristics for study exclusion from sIRB requirements.

However, the extent to which those responsible for the conduct and ethical oversight of multisite research agree on the goals and types of information that should be considered as part of local context review remains unclear. Nevertheless, a shared understanding is necessary for assessing the impact of policies mandating the use of sIRB review, including those enacted by the National Institutes of Health [2], the Revised Common Rule of 2018 [7], and a similar proposed rule by the Food and Drug Administration in 2022 [8]. Requiring review by a sIRB is predicated on the rationale that it can improve research efficiency while maintaining safeguards for research participants [Reference Hudson and Collins9Reference Collins11]. Limited evaluations suggest sIRBs may reduce the time for IRB review and study approval (although perhaps not as much as might have been anticipated) [Reference Vardeny, Hernandez and Cohen12,Reference Wagner, Murray, Goldberg, Adler and Abrams13]. Less clear is their impact on participant protections, including whether sIRBs can identify and address considerations particular to the local context.

In this article, we report the results of a study employing a modified Delphi process to identify areas where there is agreement and areas where additional work is needed regarding local context review to promote efficiency and ensure protections when using a sIRB.

Methods

We used a modified Delphi process (Fig. 1) to elicit experts’ views about local context review in a sIRB model. The Delphi process is a method of structuring group communication to synthesize expert opinion through two or more rounds of iterative surveys designed to elicit and refine experts’ views [Reference Linstone and Turoff14]. The technique has been used widely in health research [Reference Stevens Smith, Russell, Lee and Morain15Reference Minter, Angelos and Coimbra20], including to address issues related to research oversight [Reference Gelinas, Weissman and Lynch21].

Figure 1. Overview of Delphi process.

Delphi panelists included individuals representing expertise in the conduct or oversight of multisite research, including current or former leaders of organizations with expertise in human subjects research (e.g., Public Responsibility in Medicine & Research, Association for the Accreditation of Human Research Protection Programs, and SMART IRB), leaders of academic human research protection programs (HRPPs), clinician investigators who have published about sIRBs, and community representatives with sIRB experience. We used purposive recruitment to obtain geographic diversity and to include relevant perspectives from academic medicine, commercial IRBs, and government. As a proxy for experience in reviewing a high volume of multisite studies, we selected academic HRPP experts from among the 30 most highly funded Clinical and Translational Science Award program hubs in fiscal year 2022, ensuring at least one representative from each of the four US census regions. We recruited participants by email and offered a $300 incentive for their estimated 4 hours of participation. The Johns Hopkins Bloomberg School of Public Health IRB determined that this study did not constitute human subjects research.

Guided by the findings of the earlier scoping review [Reference Morain, Singleton, Tsiandoulas, Bollinger and Sugarman6], we designed a survey instrument with structured response categories to elicit feedback on three issues: (1) the goals of local context review; (2) the types of information that should be considered as part of this review; and (3) whether there were any study types for which local context was so important that sIRB review would be inappropriate (and the study should therefore be exempted from sIRB requirements). Experts were also asked to provide comments explaining their answers. We pilot tested the Round 1 survey with two individuals with expertise in sIRBs. All surveys were conducted using Qualtrics. (Survey instruments provided in Supplementary Materials.)

Panelists completed Round 1 between October and November 2023. We generated descriptive statistics to determine the distribution of panelists’ answers and synthesized their free-text qualitative explanations using inductive thematic analysis.

Panelists completed the second survey in February 2024. During Round 2, we provided histograms presenting the distribution of responses to Round 1, as well as summaries of the free-text explanations. We then asked panelists to re-rate questions in light of the ratings and comments of the group and to provide qualitative comments explaining their responses. Items that received low support in Round 1 were not included in Round 2 or future evaluations (i.e., one potential goal for local context review and seven potential exemptions from sIRB requirements).

Experts completed Round 3 in April–May 2024, which involved reviewing a draft report summarizing the findings of Rounds 1 and 2 and answering a short survey. The survey solicited suggestions for improving local context review along six dimensions, with a forced choice question exploring experts’ preferences for the management of exceptions to the sIRB requirement.

Results

Twenty-one experts participated in the Round 1 survey, 20 and 18 of whom completed the Round 2 and 3 surveys, respectively (Table 1).

Table 1. Panel characteristics

Note: HRPP, Human Research Protection Program; IRB, Institutional Review Board.

Goals of local context review

Panelists were asked to rate how strongly they agreed with the proposed goals for local context review (Table 2). By Round 2, a substantial majority somewhat or strongly agreed that local context review should aim to protect the rights and welfare of local participants (18/20) and ensure compliance with applicable laws and policies (15/20). Views were more mixed about two other proposed goals, with 11/20 somewhat or strongly agreeing that local context review should aspire to assess study feasibility, and 10/20 somewhat or strongly agreeing it should promote the quality of research.

Table 2. Goals of local context review

Question text: To what extent do you agree or disagree that each of the following should be a goal of local context review?

* Only those items for which a majority rated as strongly/somewhat agree were included in the Round 2 survey.

When asked about the relative importance of the four goals, panelists were split as to whether ensuring compliance with applicable laws and policies or protecting the rights and welfare of local (relying site) participants was most important, with 10/20 rating the former as most important, and another 9/10 selecting the latter. Only one panelist selected assessing study feasibility as most important, and none selected promoting the quality of research.

With respect to ensuring compliance, panelists generally agreed (15/20) there needed to be a process for ensuring local site-level compliance with applicable laws and policies, and that sIRBs cannot reasonably be expected to identify and interpret relevant laws and policies across all study sites. However, they disagreed about the appropriate process for site-level review to ensure compliance with applicable laws and policies, particularly if completed by IRB staff, with some positing that this review would be better conducted through an alternative mechanism at the local institution, such as by legal counsel.

Similarly, while there was strong agreement (90%) with the general principle that protecting the rights and welfare of local participants should be a goal of local context review, a few panelists noted that rights and welfare considerations did not commonly vary across sites and expressed concern that local context review could therefore lead to unnecessary duplication of efforts.

When considering study feasibility, those who disagreed that it should be a goal of local context review argued that feasibility assessments were better managed by other entities, such as investigators or sponsors. However, others offered comments emphasizing the importance of local institutional involvement in this process, particularly in light of the high number of studies that overestimate feasibility and fail to accrue sufficient participants to address study objectives.

Content of local context review

Most panelists strongly or somewhat agreed that all four proposed information types explored should be considered as part of local context review: population/participant-level characteristics; investigator and research team characteristics; institution-level characteristics; and state and local laws (Table 3).

Table 3. Content of local context review

Question text: To what extent do you agree or disagree that each of the following should be considered as part of local context review?

However, there was less agreement as to whether current processes for local context review facilitated adequate consideration of these information types (Table 4). While at least 70% agreed or strongly agreed that local context review processes facilitated adequate consideration of state and local laws (16/20), and institution characteristics (14/20), fewer expressed confidence that these processes did so for investigator and research team characteristics (12/20), or population/participant-level characteristics (9/20).

Table 4. Appropriateness of existing processes to assess relevant local characteristics

Question text: To what extent do you agree or disagree that current processes for local context review facilitate appropriate consideration for each of the following?

At least four specific concerns related to processes for assessing population/participation-level characteristics were identified: (1) uncertainty about which specific characteristics should be considered; (2) a lack of standardized tools or processes for identifying relevant information; (3) uncertainty about who should review information (e.g., IRB staff versus IRB members); and (4) that staffing at many IRBs was insufficient to facilitate adequate review.

Additional concerns related to assessing the other three information types included those pertaining to: researchers with a history of compliance or disciplinary issues; local site resources or local standards of care and, whether IRB staff were best positioned to assess and communicate these considerations; and whether existing processes facilitated appropriate interpretation of whether and how identified laws might apply to a specific study.

Potential exceptions to sIRB requirements

Overall, there was little consensus about the appropriateness of exemptions to sIRB requirements (Table 5). Of the thirteen study types initially explored, by Round 2, only one received support from a slight majority of panelists as being appropriate for an exemption: non-clinical studies in which sites are not conducting the same research activities (12/20). Sizable minorities supported exemptions for three additional study types, including studies involving: unique ethnic or religious groups (8/20); studies that are not clinical trials (7/20); and studies operating under the Food and Drug Administration’s Exception from the Requirement to Obtain Informed Consent (7/20).

Table 5. Potential study-specific exceptions from the sIRB requirement

Question text: To what extent do you agree or disagree that each of the following should be granted an exception from the single IRB requirement?

* Only those items for which a majority rated as strongly/somewhat agree or unsure were included in the Round 2 survey.

Notably, for the six study types explored in Round 2, at least one panelist “strongly agreed” that the study merited an exemption, and at least one “strongly disagreed,” suggesting continued dissensus regarding the appropriateness of study-specific exemptions from sIRB requirements.

These disagreements about the details of exemptions notwithstanding, there was consensus that exemptions from the sIRB requirements should be permitted. When asked in Round 3 about how exemption determinations should be made, a slight majority (11/18) preferred a case-by-case basis rather than categorical exemptions for all studies of a certain type (e.g., those involving stem cells or those involving no more than minimal risk).

Discussion

This study provides important and novel insights into the views of experts in the conduct or oversight of multisite research with human subjects about local context review for sIRBs. Three themes merit particular consideration: (1) lack of agreement of the goals of local context review; (2) whether current processes fit the goals of local context review; and (3) when exceptions should be permitted.

First, consistent with the findings of the earlier scoping review [Reference Morain, Singleton, Tsiandoulas, Bollinger and Sugarman6], experts do not fully agree about the goals of local context review or their relative prioritization. Our data found strong support for the view that local context review should aim to protect the rights and welfare of local participants and to ensure compliance with applicable laws and policies. However, panelists held mixed views about whether local context review should aim to ensure feasibility or promote the quality of research. Furthermore, panelists were split as to the relative priority of protecting rights and welfare versus ensuring compliance. This divergence may impair ongoing efforts to design appropriate processes for local context review, as well as assessments of their effectiveness.

Second, questions remain about the fit – or lack thereof – between goals of local context review and existing processes for their fulfillment. Our finding that the majority of panelists viewed existing processes for assessing state and local laws as adequate provides some confidence that these processes can be supportive of the goal of ensuring compliance. Nevertheless, some compliance-related concerns remain, including how best to ensure that sIRBs are not only aware of relevant laws but also have guidance about how to appropriately interpret them in specific research contexts. Moreover, the fact that a strong majority of panelists viewed protecting participants’ rights and welfare as an important goal of local context review, yet a substantial portion of panelists found current processes for assessing participant- and investigator-level characteristics as lacking suggests the need to refine these processes to ensure this goal is realized. Potential next steps to support this effort include developing greater standardization of the specific types of information that are relevant for making these assessments (e.g., which particular participant- and/or investigator-level characteristics should be considered), as well as the processes by which to communicate and assess that information. As part of this effort, more attention is needed to the question of who should be engaged in various components of the review process (both at the relying organization and reviewing IRB), including which components require expertise beyond that of administrative IRB staff members, and, relatedly, which types of considerations might benefit from broader expertise and deliberation, such as that which might occur via a convened review of the full IRB.

Third, while we found broad agreement that some studies should be exempted from the requirement to use a sIRB, there remains far less clarity as to when and in what circumstances such exemptions should be permitted. Yet requiring the use of a sIRB is not without possible drawbacks, including that doing so may delay, rather than accelerate, the time to approval [Reference Green, Goodman, Kirby, Cobb and Bierer4], or might undermine important protections for human subjects. Prior calls have been made for the NIH to convene an expert panel to develop criteria to inform assessments of when exemptions might be appropriate [22]. The divergence in views among our panelists about the appropriateness of exemptions underscores the potential value of this or similar opportunities for deliberation and guidance development.

Despite the importance of our findings, several limitations merit consideration. First, like all studies involving a Delphi process, our findings are dependent upon the composition of the expert panel. We deliberately assembled an expert panel with a broad range of perspectives: individuals representing commercial, government, and non-academic IRBs, as well as those with expertise beyond the IRB/HRPP, including investigators and patient or community representatives. While our experts had extensive experience in the conduct and/or oversight of multisite research, including under a sIRB, the results of our process may not be representative of all relevant perspectives. Second, while our survey was informed by a scoping review, there may be potential characteristics within the categories that we did not fully explore. Third, space limitations within the Delphi surveys precluded our ability to examine some characteristics at the level of granularity needed to inform future practice (e.g., identifying the specific types of information related to patient- or population-level characteristics that should be considered).

Conclusion

How sIRBs should consider local context remains a leading concern about sIRB review for multisite studies. This study is the first to characterize areas of agreement and disagreement among multidisciplinary experts regarding the goals and content of local context review and about potential exemptions to federal sIRB requirements. Our findings suggest shared agreement that local context review should aim to both protect the rights and welfare of local participants and ensure compliance. They also suggest that information related to characteristics of patients, populations, investigators, and institutions are relevant to assessing local context, as are state and local laws. However, future work remains to develop effective processes to best realize the goals of local context review and to do so with appropriate efficiency.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/cts.2024.685

Acknowledgments

We thank the following members of our expert panel, who all agreed to be listed by name, as well as another seven members who preferred to remain anonymous: Jenni Beadles, David Borasky, Nichelle Cobb, Laura Covington, J. Michael Dean, Elisa Hurley, Charlotte Karen Jeans, Carissa Minder, Duke Morrow, Rhonda Oilepo, Julie Ozier, and Mehul V. Raval, Todd W. Rice, and Robert Silbergleit. The views expressed are those of the experts themselves and do not necessarily reflect the views of their institutions or other organizations with which they are affiliated.

Author contributions

Dr Morain conceptualized and designed the work, conducted the analysis, and wrote the initial manuscript draft. Ms. Bollinger assisted in the conceptualization, design, and analysis and critically revised the manuscript. Ms. Terkowitz and Dr Weston assisted in the design and analysis, collected the data, and critically revised the manuscript. Ms. Singleton and Dr Sugarman conceptualized and designed the work, supported the interpretation of the analysis, and critically revised the manuscript. Dr Morain takes responsibility for the manuscript as a whole.

Funding statement

This work was supported by the National Center for Advancing Translational Sciences (UL1TR003098-04S1).

Competing interests

JS is a consultant to Merck KGaA, IQVIA, and Merck and a member of Aspen Neurosciences’ Clinical Advisory Panel. None of these activities are related to the material discussed in this article. No other authors have any conflicts to disclose.

References

Taylor, HA, Ehrhardt, S, Ervin, A. Public comments on the proposed common rule mandate for single-IRB review of multisite research. Ethics Hum Res. 2019;41(1):1521. doi: 10.1002/eahr.500002.Google Scholar
National Institutes of Health. Final NIH policy on the use of a single institutional review board for multi-site research. Fed Regist. 2016;81(119):4032540331.Google Scholar
Klitzman, R, Pivovarova, E, Lidz, CW. Single IRBs in multisite trials: questions posed by the new NIH policy. JAMA. 2017;317(20):2061. doi: 10.1001/jama.2017.4624.Google Scholar
Green, JM, Goodman, P, Kirby, A, Cobb, N, Bierer, BE. Implementation of single IRB review for multisite human subjects research: persistent challenges and possible solutions. J Clin Transl Sci. 2023;7(1):e99. doi: 10.1017/cts.2023.517.Google Scholar
Johnson, AR, Kasimatis Singleton, M, Ozier, J, et al. Key lessons and strategies for implementing single IRB review in the Trial Innovation Network. J Clin Transl Sci. 2022;6(1):e53. doi: 10.1017/cts.2022.391.Google Scholar
Morain, SR, Singleton, MK, Tsiandoulas, K, Bollinger, J, Sugarman, J. Thinking locally and acting centrally in human research subjects research oversight: assessing the goals, content, and appropriateness of local context review for multisite research. Ethics Hum Res. 2024;46(4):1726. doi: 10.1002/eahr.500215.Google Scholar
Federal Policy for the Protection of Human Subjects (‘Common Rule’). Vol. 45, CFR part 46.Google Scholar
Food and Drug Administration. Proposed rule: institutional review boards. Cooperative research. Fed Regist. 2022;87(187):5875258763.Google Scholar
Hudson, KL, Collins, FS. Bringing the common rule into the 21st century. N Engl J Med. 2015;373(24):22932296. doi: 10.1056/NEJMp1512205.Google Scholar
Gordon, V, Culp, M, Wolinetz, C. Final NIH Policy on the use of a single institutional review board for multisite research: final NIH policy on the use of a single institutional review board for multisite research. Clin Transl Sci. 2017;10(3):130132. doi: 10.1111/cts.12447.Google Scholar
Collins, FS. NIH Director’s Letter: Single IRB policy to streamline reviews of multi-site research, Published online June 20, 2016. (https://www.nih.gov/about-nih/who-we-are/nih-director/statements/single-irb-policy-streamline-reviews-multi-site-research) Accessed February 28, 2022.Google Scholar
Vardeny, O, Hernandez, AF, Cohen, LW, et al. Transitioning to the National Institutes of Health single institutional review board model: piloting the use of the streamlined, multi-site, accelerated resources for trials IRB reliance. Clin Trials. 2019;16(3):290296. doi: 10.1177/1740774519832911.Google Scholar
Wagner, TH, Murray, C, Goldberg, J, Adler, JM, Abrams, J. Costs and benefits of the National Cancer Institute central institutional review board. J Clin Oncol. 2010;28(4):662666. doi: 10.1200/JCO.2009.23.2470.Google Scholar
Linstone, H, Turoff, M. The Delphi Method: Techniques and Applications. Reading, MA: Addison-Wesley Pub. Co., Advanced Book Program, 1975.Google Scholar
Stevens Smith, H, Russell, HV, Lee, BH, Morain, SR. Using the Delphi method to identify clinicians’ perceived importance of pediatric exome sequencing results. Genet Med. 2020;22(1):6976. doi: 10.1038/s41436-019-0601-3.Google Scholar
Kohler, JN, Turbitt, E, Lewis, KL, et al. Defining personal utility in genomics: a Delphi study. Clin Genet. 2017;92(3):290297. doi: 10.1111/cge.12998.Google Scholar
Majumder, MA, Blank, ML, Geary, J, et al. Challenges to building a gene variant commons to assess hereditary cancer risk: results of a modified policy Delphi panel deliberation. J Pers Med. 2021;11(7):646. doi: 10.3390/jpm11070646.Google Scholar
Morain, SR, Joffe, S, Campbell, EG, Mello, MM. Institutional oversight of faculty-industry consulting relationships in U.S. Medical Schools: A Delphi Study. J Law Med Ethics J Am Soc Law Med Ethics. 2015;43(2):383396. doi: 10.1111/jlme.12255.Google Scholar
Messner, DA, Al Naber, J, Koay, P, et al. Barriers to clinical adoption of next generation sequencing: perspectives of a policy Delphi panel. Appl Transl Genomics. 2016;10:1924. doi: 10.1016/j.atg.2016.05.004.Google Scholar
Minter, RM, Angelos, P, Coimbra, R, et al. Ethical management of conflict of interest: proposed standards for academic surgical societies. J Am Coll Surg. 2011;213(5):677682. doi: 10.1016/j.jamcollsurg.2011.08.003.Google Scholar
Gelinas, L, Weissman, JS, Lynch, HF, et al. Oversight of patient-centered outcomes research: recommendations from a Delphi Panel. Ann Intern Med. 2018;169(8):559. doi: 10.7326/M18-1334.Google Scholar
Public Responsibility in Medicine and Research. Re: NOT-OD-15-026 draft NIH policy on the use of a single institutional review board for multi-site research. Published online January 29, 2015.Google Scholar
Figure 0

Figure 1. Overview of Delphi process.

Figure 1

Table 1. Panel characteristics

Figure 2

Table 2. Goals of local context review

Figure 3

Table 3. Content of local context review

Figure 4

Table 4. Appropriateness of existing processes to assess relevant local characteristics

Figure 5

Table 5. Potential study-specific exceptions from the sIRB requirement

Supplementary material: File

Morain et al. supplementary material

Morain et al. supplementary material
Download Morain et al. supplementary material(File)
File 264.2 KB