Hostname: page-component-cd9895bd7-fscjk Total loading time: 0 Render date: 2024-12-18T21:02:09.823Z Has data issue: false hasContentIssue false

Key recommendations from the 2021 “inclusion of older adults in clinical research” workshop

Published online by Cambridge University Press:  07 January 2022

Darina V. Petrovsky
Affiliation:
Rutgers University, New Brunswick, NJ, USA
Lan N. Ðoàn
Affiliation:
New York University Grossman School of Medicine, New York, NY, USA
Maria Loizos
Affiliation:
Icahn School of Medicine at Mount Sinai, New York, NY, USA
Rachel O’Conor
Affiliation:
Northwestern University, Evanston, IL, USA
Micah Prochaska
Affiliation:
University of Chicago, Chicago, IL, USA
Mazie Tsang
Affiliation:
University of California, San Francisco, CA, USA
Rachel Hopman-Droste
Affiliation:
Pearson, London, UK
Tara C. Klinedinst
Affiliation:
University of Pittsburgh, Pittsburgh, PA, USA
Aarti Mathur
Affiliation:
Johns Hopkins University, Baltimore, MD, USA
Karen Bandeen-Roche
Affiliation:
Johns Hopkins University, Baltimore, MD, USA
Odette van der Willik
Affiliation:
American Federation for Aging Research, New York, NY, USA
Stephen B. Kritchevsky*
Affiliation:
Wake Forest School of Medicine, Winston-Salem, NC, USA
*
Address for correspondence: S. B. Kritchevsky, PhD, Professor, Department of Internal Medicine, Section on Gerontology and Geriatric Medicine, Wake Forest School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157, USA. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Older adults are often underrepresented in clinical research, even though older adults are major consumers of novel therapies. We present major themes and recommendations from the 2021 "Inclusion of Older Adults in Clinical Research" Workshop, convened by the Clinical and Translational Science Award (CTSA) Inclusion of Older Adults as a Model for Special Populations Workgroup and the Research Centers Collaborative Network (RCCN). The goal of this workshop was to develop strategies to assist the research community in increasing the inclusion of older adults in clinical research. Major identified barriers include historical lack of federal guidelines, ageist biases and stereotypes, and lack of recruitment and retention techniques or infrastructure focused on older adults. Three key recommendations emerged: 1) engaging with the policymaking process to further promote inclusion; 2) using the CTSA Workgroup Presentation Materials Library and other resources to overcome ageism, and 3) building institutional capacity to support age inclusion.

Type
Conference Proceedings
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of The Association for Clinical and Translational Science

Introduction

Over the last century, there has been great progress in life expectancy in the USA. However, this change in longevity is accompanied by increases in the burden of multimorbidity, polypharmacy, and frailty. Despite the growth in the number of medically complex older adults, many clinical trials exclude such individuals, and as a result, older adults are underrepresented in clinical research [Reference Lockett, Sauma, Radziszewska and Bernard1,Reference Jadad, To, Emara and Jones2].

Recognition of the need to address underrepresentation of older adults in clinical research has grown in recent years [Reference Bernard, Clayton and Lauer3,Reference DeJong and Covinsky4]. The Clinical and Translational Science Award (CTSA) Inclusion of Older Adults as a Model for Special Populations Workgroup in partnership with the Research Centers Collaborative Network (RCCN) convened the “Inclusion of Older Adults in Clinical Research” Workshop in February 2021 (herein referred to as the Workshop). The Workshop sought to convene cross-disciplinary perspectives, including key thought leaders from National Institute on Aging (NIA) center programs (Appendix Table S1 lists all workshop speakers). This manuscript presents summaries of discussion from the Workshop to inform the inclusion of older adults in clinical research.

NIH Inclusion Across the Lifespan

The National Institutes of Health (NIH) is the largest funder of research in the US; therefore, NIH policies have significant impact on research practices. The NIH began setting policies to stimulate broader inclusion in 1986, with the policy encouraging researchers to include women in studies. In 2017, the NIH “Inclusion Across the Lifespan” Workshop hosted a meeting to discuss the representation of older adults (65 years and older) in research [5]. In response to the 21st Century Cures Act, which directed the NIH to ensure inclusion of a broad range of participants in research [6], the NIH updated their policy and guidelines to include all ages in clinical research, unless there were specific and compelling scientific or ethical justifications for participant age restrictions [Reference Bernard, Clayton and Lauer3,7].

Furthermore, in 2015 the CTSA Program established the Hub Research Capacity Cores and instituted the LIFESPAN Domain Task Force as one of five major platforms for network-wide communication and collaboration dedicated to promoting age inclusivity in research. This led to the development of an “Inclusion of Older Adults as a Model for Special Populations” working group (henceforth, “CTSA Inclusion Workgroup”) in 2019 with the mission of increasing inclusion of older adults in research.

In 2020, the NIH convened a second workshop “Inclusion Across the Lifespan” that examined the representation of racial/ethnic minority and other marginalized older populations in clinical studies [8]. This workshop led to recommendations on adjusting study inclusion and exclusion criteria to represent target populations, being age-inclusive in trial design and metrics, utilizing best practices and completing relevant training to recruit and retain older adults in studies, and identifying social determinants of health across age groups. The NIH has continued these efforts to ensure older adults are included in clinical research to represent target populations.

State of the Inclusion of Older Adults

The Workshop was organized to discuss the current state of older adult inclusion, overall and among older adults of color with panelists featuring oncology, cardiology, Alzheimer’s Disease and Related Dementias (ADRD) as examples. In cancer research, clinical trials often do not include older adults, which limits data on tolerability, leaving clinicians to improvise dose adjustments in older adults. Researchers in geriatric oncology are focused on increasing the inclusion of older adults in clinical trials and optimizing the screening and management of older adults with cancer. When examining data on 224,766 older adults with cancer supporting 105 Federal Drug Administration (FDA) drug applications according to age distributions of <65, 65–69, 70–74, 75–79, and ≥80, the participation rates of older adults with cancer in clinical trials were significantly lower compared to corresponding participation rates in the US cancer population. For example, 4% of all clinical trial participants enrolled between 2005 and 2015 were over the age of 80, whereas approximately 16% of older adults age 80+ in 2013 were diagnosed with cancer [Reference Singh, Kanapuru and Smith9]. This led to the American Society of Clinical Oncology recommendation in 2018 that oncologists consider performing geriatric assessments in older adults who receive chemotherapy to screen for cognitive impairment or impaired nutrition [Reference Mohile, Dale and Somerfield10].

Similarly, older adults with cardiovascular disease are frequently excluded from cardiovascular clinical trials, despite the growing number of older adults with these diseases [Reference Malavolta, Caraceni, Olivieri and Antonicelli11,Reference Anderson, Odden, Penko, Kazi, Bellows and Bibbins-Domingo12]. More recently, however, cardiovascular clinicians and researchers shifted from thinking of the heart as the epicenter to a more integrated view that includes functional outcomes such as frailty and cognitive impairment. Future challenges facing cardiovascular research include selection of meaningful and measurable clinical outcomes and logistics of conducting research with older adults.

Older adults with ADRD continue to be frequently excluded from clinical research. In a 2012 review, 16% of studies applied recruitment methods that were likely to reduce participation of older adults living with ADRD and only 6% of studies provided justification for exclusion [Reference Taylor, DeMers, Vig and Borson13]. A recent analysis of Medicare beneficiaries with ADRD concluded that inclusion criteria in clinical trials of Aducanumab, a drug aimed at slowing down Alzheimer’s disease progression, would have excluded more than 92% of eligible older adults [Reference Anderson, Ayanian, Souza and Landon14]. Research opportunities for persons living with ADRD include research on new models of decision-making, determining preferences, sources of exclusion, training needs, and science of engagement [15].

Lastly, health disparities cut across all chronic diseases and contribute to ageism. Ageism is defined as “negative or positive stereotypes, prejudice and/or discrimination against (or to advantage of) elderly people on the basis of their chronological age…” [Reference Iversen, Larsen and Solem16]. Potentially stemming from ageism, health disparities are differences in health that exist across disparate groups, including race, ethnicity, and age [Reference Riley17]. Older racial/ethnic minority adults, who face significant social and economic inequities that contributes to their mistrust of the medical system, are less likely to participate in clinical research [Reference Hansen, Hodgson and Gitlin18]. To mitigate this, researchers should conduct research with the lens of cultural humility, develop culturally and linguistically concordant interventions, and build trust by learning from older adults’ lived experiences. Many NIA-funded efforts are underway to examine diversity, recruitment, and retention in aging research.

Barriers to the Inclusion of Older Adults

Workshop panelists identified three main barriers to the inclusion of older adults in clinical trials: 1) historical lack of federal guidelines; 2) ageism; and 3) lack of recruitment and retention techniques/infrastructure focused on older adults.

The recent changes to NIH’s inclusion policy may have a substantial impact on the inclusion of older adults with researchers having to justify age limits for inclusion criteria in grant applications. However, disease-based exclusions will still differentially impact older adults. In 2020, the FDA published guidance to broaden the eligibility criteria to increase the diversity of study participants with comorbidities (e.g., sex, race, ethnicity, age, location of residency) [19]. This guidance recommended increasing inclusion of older adults by using adaptive clinical trial designs and during early clinical development (e.g., describing differences in drug metabolism and clearance across populations). A high priority will be to evaluate the effect of these changes on age inclusion to determine if additional action on the part of funding and regulating bodies is necessary.

Ageism can play out through the entire human research subject protections process: study design, institutional review board (IRB) evaluation, and conduct of research. Contributing to implicit bias, benevolent prejudice refers to a “superficially positive type of prejudice… expressed in terms of positive beliefs and emotional responses, which results in keeping the group of members experiencing prejudice in inferior positions in society” [20]. Older adults, for example, may be seen as needing care and concern, supporting the notion that they require greater protection in and from research. Implicit biases and assumptions about what older adults can and cannot do may impede their inclusion. Implicit bias could be addressed by educating IRB members, researchers, and staff of older adults’ meaningful contributions to research.

Successful recruitment strategies used in population-based survey research may provide useful techniques to increase representation of older adults in clinical research outside of a traditional clinical setting. Examples of survey research include surveys supported by the NIH (e.g., Health and Retirement Survey), Census Bureau (e.g., American Community Survey), and National Center for Health Statistics (e.g., National Health Interview Survey). Surveys can provide nuanced, longitudinal information on the national trends in health and social determinants of health in representative samples of older adults. Lessons on inclusion of older adults in population-based surveys include using multi-pronged recruitment models, building relationships and trust with older adults by engaging with them outside of clinic visits, using financial incentives, and engaging with care partners. In addition, some older adults may need assistance in getting transportation to research sites or may need help navigating complicated medical facilities. Centralized infrastructure support would make it easier for investigators to access the resources required to promote inclusion.

Making the Case

In order to make the case to include older adults in research, schema such as the 5Ts framework (Target Population, Team, Tools, Time and Tips to Accommodate) can guide researchers to support inclusion of older adults in studies [Reference Bowling, Whitson and Johnson21]. Below we outline additional arguments identified during the Workshop.

First, inclusion of older adults is consistent with the ethical value and principle of justice, which is defined by The Belmont Report as risk and benefits of research that are equally shared amongst each person [Reference Shore22]. Second, inclusion aligns with the scientific values of generalizability and reproducibility. Older adults constitute a large proportion of end-users for novel therapies. It is, therefore, critical that results from clinical research are generalizable to this population. The only way to understand if findings are reproducible across the lifespan is by inclusion across the lifespan. Third, there are practical benefits of including older adults in research. The inclusion of higher-risk older adults can increase study power for certain clinical events for an equivalent sample size. Furthermore, older adults may have more flexible schedules compared to younger adults and view participating in research as leaving a legacy for the next generation [Reference Jacelon23]. These practical advantages can translate to more rigorous and impactful clinical trials.

Anticipating and Adapting to Possible Effects of Increased Age Inclusion

Concerns about selective participation and study dropout leading to decreased sample size and bias related to misrepresentation of the target population may contribute to the exclusion of older adults. As a result, study treatments generalize to younger, healthier participants as opposed to the intended target. However, in the experience of the Workshop participants, retention of older adults is usually excellent. Nevertheless, at the design stage, sample sizes can be calculated to account for incomplete retention, and collection of auxiliary data related to dropout can mitigate biases. If researchers are concerned about missed measures, prioritizing key measures early in the assessment can help protect the validity of data. Stereotypes related to the cognitive capacity of older adults may engender concerns about measurement accuracy. Design choices can mitigate these concerns. For example, wearable sensors can collect data on exposures and outcomes and can overcome concerns about the ability of older adults with cognitive and physical impairments. In longer-term studies, competing risks, such as death prior to achieving a study outcome, can be managed and even leveraged to additional insight using appropriate statistical methods.

Lastly, researchers may have concerns about treatment heterogeneity across age groups as well as heterogeneity in older adult health. In some cases, these can be leveraged for increased power in estimating the relationships between independent and dependent variables [Reference Colantuoni and Rosenblum24]. Both designs (e.g., adaptive) and analytic methods are available to compare treatment effects in subgroups in a principled way [Reference Pallmann, Bedding and Choodari-Oskooei25]. Including older adults in clinical research may introduce complexity for data analysis and interpretation of findings, and we recommend engaging a statistician or an epidemiologist to assist in the development of design and analysis strategies for overcoming these barriers.

Recommendations

The key takeaway from this Workshop was that inclusion of older adults is paramount to increase the reproducibility and generalizability of research findings. Older adults continue to be underrepresented in clinical research, despite being one of the largest consumers for therapeutics and medical interventions. Key recommendations to promote the inclusion of older adults in clinical research include the following: 1) engaging with the policymaking process to further promote inclusion; 2) using the CTSA Presentation Materials Library on Inclusion of Older Adults in Clinical and Translational Research (https://clic-ctsa.org/education/kits/presentation-materials-library-inclusion-older-adults-clinical-and-translational) and other resources to overcome ageism; and 3) building institutional capacity to support age inclusion (Table 1).

Table 1. Key themes and recommendations

When engaging in policy efforts, researchers should introduce others to the NIH and the FDA policies for inclusion of older adults and be vocal in their support of new policies to others. In addition, reviewers in study sections may need to be trained on identifying poor justification for exclusion of older adults in grant applications. Advocacy efforts should include presentations and conversations with stakeholder groups, elected officials, policymakers, and agencies on the importance of inclusion of older adults in research. IRBs should eliminate strict exclusion criteria for older adults based on arbitrary risk assessment. Personal stories matter and may be more effective than statistics in motivating change – researchers can use these stories to engage with policymakers and IRBs.

Barriers for older adult participation in research include lack of resources or limited physical capacity. Institutions can support core services to mitigate these barriers by providing transportation and navigation for older adults who need such services. Given persistent lack of trust in the medical community, researchers should build trust with the research participants by learning from older adults’ lived experiences. As a result, researchers will be better able to promote inclusive practices and develop better research processes that protect older adults. Age-friendly movements focused on health systems, cities, and universities and the Reframing Aging Initiative are examples of strategies to create age-inclusive communities.

The lack of age-friendly initiatives in recruitment and retention efforts contribute to the exclusion of older adults in research. We encourage researchers to involve older adults in all phases of the research cycle and make justifications for inclusion of older adults in research clear. Older adults need to be given an opportunity to contribute and understand the science underlying research. This can be accomplished by creating more opportunities for older adult representation in a citizen science or professional researcher program, like the Professional Research Assistant program at the University of Colorado. Quality improvement strategies like rapid cycles can be helpful in testing and identifying most successful recruitment strategies. In addition, implementation outcomes can be incorporated into study design to evaluate intervention success [Reference Lewis, Fischer, Weiner, Stanick, Kim and Martinez26,Reference Proctor, Silmere and Raghavan27]. This approach promotes the dissemination of successful strategies to the broader research community.

The CTSA Inclusion Workgroup under the NIH National Center for Advancing Translational Sciences (NCATS) is a recent effort aimed at equipping research teams with tools to facilitate successful inclusion of diverse older adults in clinical research. It has provided a slide set repository focused on ways to improve recruitment, enrollment, and retention of older adults, particularly from marginalized backgrounds and underresourced settings (https://clic-ctsa.org/education/kits/presentation-materials-library-inclusion-older-adults-clinical-and-translational). In addition, slide set modules provide examples of successful recruitment approaches, methods to address typical reasons older adults are excluded from research, ways to adapt studies, and ethical considerations regarding consent of older adults with limited decision-making capacity.

Building institutional capacity to support age inclusion will require solid infrastructure support, resources, and designated funds. For example, having a center that supports age-friendly recruitment and retention would allow researchers access to resources and toolkits to promote inclusion in clinical research. Resources may include webinars with stakeholders engaged in aging research (e.g., funders, academic researchers, community leaders, and coalitions), peer-to-peer conversations, and continuing education opportunities that keep researchers up to date with federal policies on inclusion. Other educational topics may include ways to combat ageism, how to actively engage and build trust with diverse older adult populations, how to address IRB-related challenges related to including older adults in research, approaches to developing and implementing age-friendly initiatives in recruitment and retention. At a minimum, institutions could launch pilot grants focused on research on older adult populations to support a pipeline of aging-related research among scientists.

Conclusion

The aim of the Workshop, a collaboration between the CTSA Inclusion Workgroup and RCCN, was to develop and disseminate strategies to assist the research community with improving the inclusion of older adults in clinical research. Researchers should engage with the policymaking process to further promote inclusion, include the voice of older participants in every stage of research, and promote age-friendly initiatives in their institutions to make a significant impact on the health of older adults, who are one of the fastest-growing populations in the U.S.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/cts.2022.1

Acknowledgements

We would like to thank all the Workshop participants for their time and thoughtful discussion on ways to improve inclusion of older adults in clinical research. Funding is provided by the NIMHD U54MD000538, NIA 5P30AG059302 (L.Ð.); NIA K01AG070107, P30AG059988 (R.O.); NCATS UL1TR003098 (K.B-R); NIA K23AG053429 (A.M.); DHHS/ACL 12877426 (T.C.K.); NHLBI K23HL140132, NIA R25AG060910 (M.P.); NIA K23AG073618 (D.P.); NIA U24AG058556 (S.K.) The contents of this publication are solely the responsibility of the authors and do not necessarily represent the official views of the funders.

Disclosures

The authors have no conflicts of interest to declare.

References

Lockett, J, Sauma, S, Radziszewska, B, Bernard, MA. Adequacy of inclusion of older adults in NIH-funded phase III clinical trials. Journal of the American Geriatrics Society 2019; 67(2): 218222. DOI 10.1111/jgs.15786.CrossRefGoogle ScholarPubMed
Jadad, AR, To, MJ, Emara, M, Jones, J. Consideration of multiple chronic diseases in randomized controlled trials. JAMA 2011; 306(24): 26702672. DOI 10.1001/jama.2011.1886.CrossRefGoogle ScholarPubMed
Bernard, MA, Clayton, JA, Lauer, MS. Inclusion across the lifespan: NIH policy for clinical research. JAMA 2018; 320(15): 15351536. DOI 10.1001/jama.2018.12368.CrossRefGoogle ScholarPubMed
DeJong, C, Covinsky, K. Inclusion across the lifespan in cardiovascular trials—A long road ahead. JAMA Internal Medicine 2020; 180(11): 15331534. DOI 10.1001/jamainternmed.2020.2735.CrossRefGoogle ScholarPubMed
The National Institutes of Health.Inclusion Across the Lifespan, June 1–2, 2017 Workshop Summary, 2017. (https://report.nih.gov/sites/report/files/docs/NIH%20Inclusion%20Across%20the%20Lifespan%20Workshop%20Summary%20Report.pdf)Google Scholar
National Institutes of Health.Revision: NIH Policy and Guidelines on the Inclusion of Individuals Across the Lifespan as Participants in Research Involving Human Subjects, 2017. (https://grants.nih.gov/grants/guide/notice-files/NOT-OD-18-116.html)Google Scholar
The National Institute on Aging.NIH Inclusion Across the Lifespan II. September 2, 2020 Workshop, 2020. (https://www.nia.nih.gov/Inclusion-Across-Lifespan-2020)Google Scholar
Singh, H, Kanapuru, B, Smith, C, et al. FDA analysis of enrollment of older adults in clinical trials for cancer drug registration: a 10-year experience by the U.S. Food and Drug Administration. Journal of Clinical Oncology 2017; 35(15_suppl): 1000910009. DOI 10.1200/JCO.2017.35.15_suppl.10009.CrossRefGoogle Scholar
Mohile, SG, Dale, W, Somerfield, MR, et al. Practical assessment and management of vulnerabilities in older patients receiving chemotherapy: ASCO guideline for geriatric oncology. Journal of Clinical Oncology 2018; 36(22): 23262347. DOI 10.1200/JCO.2018.78.8687.CrossRefGoogle ScholarPubMed
Malavolta, M, Caraceni, D, Olivieri, F, Antonicelli, R. New challenges of geriatric cardiology: from clinical to preclinical research. Journal of Geriatric Cardiology 2017; 14(4): 223232. DOI 10.11909/j.issn.1671-5411.2017.04.005.Google ScholarPubMed
Anderson, TS, Odden, MC, Penko, J, Kazi, DS, Bellows, BK, Bibbins-Domingo, K. Characteristics of populations excluded from clinical trials supporting intensive blood pressure control guidelines. Journal of the American Heart Association 2021; 10(7): e019707. DOI 10.1161/JAHA.120.019707.CrossRefGoogle ScholarPubMed
Taylor, JS, DeMers, SM, Vig, EK, Borson, S. The disappearing subject: exclusion of people with cognitive impairment and dementia from geriatrics research. Journal of the American Geriatrics Society 2012; 60(3): 413419. DOI 10.1111/j.1532-5415.2011.03847.x.CrossRefGoogle ScholarPubMed
Anderson, TS, Ayanian, JZ, Souza, J, Landon, BE. Representativeness of participants eligible to be enrolled in clinical trials of Aducanumab for Alzheimer disease compared with medicare beneficiaries with Alzheimer disease and mild cognitive impairment. JAMA 2021; 326(16): 16271629. DOI 10.1001/jama.2021.15286.CrossRefGoogle ScholarPubMed
National Institute on Aging. 2020 National Research Summit on Care, Services, and Supports for Persons with Dementia and their Caregivers, 2020. (https://www.nia.nih.gov/2020-dementia-care-summit)Google Scholar
Iversen, TN, Larsen, L, Solem, PE. A conceptual analysis of Ageism. Nordic Psychology 2012; 61(3): 422. DOI 10.1027/1901-2276.61.3.4.CrossRefGoogle Scholar
Riley, WJ. Health disparities: gaps in access, quality and affordability of medical care. Transactions of the American Clinical and Climatological Association 2012; 123: 167172, discussion 172–164. PMCID: PMC3540621.Google ScholarPubMed
Hansen, BR, Hodgson, NA, Gitlin, LN. It’s a matter of trust: older African Americans speak about their health care encounters. Journal of Applied Gerontology 2016; 35: 10581076. DOI 10.1177/0733464815570662.CrossRefGoogle ScholarPubMed
U.S. Department of Health and Human Services Food and Drug Administration (FDA). Enhancing the Diversity of Clinical Trial Populations — Eligibility Criteria, Enrollment Practices, and Trial Designs Guidance for Industry. U.S. Department of Health and Human Services Food and Drug Administration (FDA), 2020.Google Scholar
The National Institutes of Health. Glossary, 2017. (https://diversity.nih.gov/find-read-learn/glossary)Google Scholar
Bowling, CB, Whitson, HE, Johnson, TM. The 5Ts: preliminary development of a framework to support inclusion of older adults in research. Journal of the American Geriatrics Society 2019; 67(2): 342346. DOI 10.1111/jgs.15785.CrossRefGoogle ScholarPubMed
Shore, N. Re-conceptualizing the Belmont Report. Journal of Community Practice 2006; 14(4): 526.CrossRefGoogle Scholar
Jacelon, CS. Older adults’ participation in research. Nurse Researcher 2007; 14(4): 6473. DOI 10.7748/nr2007.07.14.4.64.c6044.CrossRefGoogle ScholarPubMed
Colantuoni, E, Rosenblum, M. Leveraging prognostic baseline variables to gain precision in randomized trials. Statistics in Medicine 2015; 34(18): 26022617.CrossRefGoogle ScholarPubMed
Pallmann, P, Bedding, AW, Choodari-Oskooei, B, et al. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Medicine 2018; 16(1): 29. DOI 10.1186/s12916-018-1017-7.CrossRefGoogle Scholar
Lewis, CC, Fischer, S, Weiner, BJ, Stanick, C, Kim, M, Martinez, RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implemention Science 2015; 10(1): 155. DOI 10.1186/s13012-015-0342-x.CrossRefGoogle ScholarPubMed
Proctor, E, Silmere, H, Raghavan, R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research 2011; 38(2): 6576. DOI 10.1007/s10488-010-0319-7.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Key themes and recommendations

Supplementary material: File

Petrovsky et al. supplementary material

Table S1

Download Petrovsky et al. supplementary material(File)
File 13.8 KB