Hostname: page-component-78c5997874-t5tsf Total loading time: 0 Render date: 2024-11-15T17:20:52.721Z Has data issue: false hasContentIssue false

Information specialist collaboration in Europe: collaborative methods, processes, and infrastructure through EUnetHTA

Published online by Cambridge University Press:  21 October 2020

Siw Waffenschmidt*
Affiliation:
Institute for Quality and Efficiency in Health Care (IQWiG), Cologne, Germany
Marli van Amsterdam-Lunze
Affiliation:
National Health Care Institute Netherlands (ZIN), Diemen, Netherlands
Rebeca Isabel Gomez
Affiliation:
Andalusian Health Technology Assessment Area (AETSA), Sevilla, Spain
Maike Rehrmann
Affiliation:
Institute for Quality and Efficiency in Health Care (IQWiG), Cologne, Germany
Ingrid Harboe
Affiliation:
Norwegian Institute of Public Health (NIPH), Oslo, Norway
Elke Hausner
Affiliation:
Institute for Quality and Efficiency in Health Care (IQWiG), Cologne, Germany
*
Author for correspondence: Siw Waffenschmidt, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

The history of European health technology assessment (HTA) goes back more than 30 years. Almost as old as HTA agencies themselves is the desire to achieve European collaboration. This gained further impetus with the establishment of the European Network of Health Technology Assessment (EUnetHTA) in 2006. In this context, the field of information management faced specific challenges. Although these services are an integral part of HTA and information specialists play a key role here, this field is often not adequately represented in the HTA agencies within EUnetHTA. Furthermore, the organization of HTA production, including the types of HTAs produced, as well as funding, varies considerably. In order to meet these different conditions, information specialists have created various products and defined processes. With the EUnetHTA guideline, a common methodological understanding for the production of rapid Relative Effectiveness Assessments now exists. Furthermore, the Standard Operating Procedures map the complex information retrieval processes within EUnetHTA in a hands-on manner. The newly established Information Specialist Network (ISN) will in future ensure that information specialists are involved in all EUnetHTA assessments and that the methods are applied consistently in all assessments. In addition, the steering committee of the ISN manages enquiries and can be contacted to discuss methodological issues. Major barriers such as heterogeneity in the daily work of the EUnetHTA members can only be overcome through more collaboration and training.

Type
Article Commentary
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Institute for Quality and Efficiency in Health Care, 2020. Published by Cambridge University Press

Introduction

The history of European health technology assessment (HTA) goes back more than 30 years. In 1987, the Swedish Agency for Health Technology Assessment and Assessment of Social Services (SBU) was established as the first European HTA agency (1). Since then, nearly all European countries have established at least one HTA agency (2). These agencies differ considerably, not only in the way they are organized and funded, but also in the tasks they perform and in their legal framework. For example, the British National Institute for Health and Care Excellence (NICE) produces HTAs and other evidence syntheses for all health care services, including clinical practice guidelines, and issues decisions on the reimbursement of services provided by the National Health Service (NHS). Moreover, NICE cooperates with external HTA producers. The German Institute for Quality and Efficiency in Health Care (IQWiG) mainly produces HTAs and other evidence syntheses on drugs and nondrug interventions. IQWiG produces only the assessment reports, whereas the supreme decision maker in the German health care system, the Federal Joint Committee (G-BA) decides on the reimbursement of services provided by the Statutory Health Insurance (SHI). IQWiG currently does not produce clinical practice guidelines but assesses them.

Almost as old as the HTA agencies themselves is the desire to achieve European collaboration. This gained further impetus with the establishment of the European Network of Health Technology Assessment (EUnetHTA) in 2006 (https://eunethta.eu/). Over the past 14 years, this EU- and member-state-funded network has aimed to establish scientific and technical standards for HTA collaboration across the EU.

On the basis of EUnetHTA's work, European member states are currently negotiating regulations to establish a legal foundation for long-term, EU-wide HTA collaboration (3). To prepare for this, EUnetHTA has invested substantial resources in the Joint Action 3 program (4).

In this context, the field of information management faced specific challenges. In our understanding, information management includes systematic searching (“information retrieval”, e.g. developing search strategies and conducting searches) as well as supportive tasks (“library tasks”, e.g. ordering full-texts, organizing subscriptions, and editing reference lists). Additional aspects are repository management, information dissemination, etc. Although these services are an integral part of HTA in which information specialists play a key role, this field is often not adequately represented in the HTA agencies of the EUnetHTA member states. Furthermore, the organization of HTA production, including the types of HTAs produced, as well as funding, varies considerably (Table 1). Consequently, the number of information specialists employed, their involvement in HTA production, and daily tasks differ. In some agencies, information specialists are responsible for developing information retrieval methods and conducting literature searches; in others, they also perform library tasks, such as ordering full texts. Furthermore, the different languages and cultural differences in Europe pose a challenge.

Table 1. Information Specialist Involvement per Product within the Six European Agencies Employing Information Specialist Teams

NICE, National Institute for Health and Care Excellence; UK, United Kingdom; G-BA, Federal Joint Committee; HAS, Haute Autorité de santé; IQWiG, Institute for Quality and Efficiency in Health Care; NIPHNO, Norwegian Institute of Public Health; NOR, Norway; SBU, Swedish Agency for Health Technology Assessment and Assessment of Social Services (1) confirmed information, (2) estimation but not officially confirmed.

In order to meet these different conditions, information specialists involved in EUnetHTA have created various products and defined processes. These include the development of a guideline (5), as well as several process descriptions for rapid Relative Effectiveness Assessments (REAs), which are described below. Furthermore, we discuss a future long-term collaboration model within the EU based on sophisticated information management services.

The development of the EUnetHTA guideline on information retrieval

Some of the authors of this article are also the authors of the EUnetHTA guideline. When we started working on the EUnetHTA guideline in 2014 “Process of information retrieval for systematic reviews and health technology assessments on clinical effectiveness” (referred to below as the [EUnetHTA] guideline), most of us had never worked on EUnetHTA assessments before and were not familiar with the EUnetHTA structures. Initially, the guideline mostly summarized recommendations from existing manuals. Since then, we have added information from evidence-based methodological papers identified by systematic literature scanning in each update. The guideline fulfils two main purposes: (a) to increase collaboration between EUnetHTA members; and (b) to allow EUnetHTA members to reflect on which methods and key points they consider important. In addition, we are not aware of any information retrieval manuals that update their content as regularly as we do with the EUnetHTA guideline.

The EUnetHTA guideline was developed as part of Joint Action 2 (6). The aim was to provide an up-to-date and transparent overview of information retrieval methods for EUnetHTA assessments. The guideline is based both on manuals of other organizations, such as the Agency for Healthcare Research and Quality (7;8) and the Cochrane Collaboration (Reference Higgins, Thomas, Chandler, Cumpston, Li and Page9), as well as literature searches by EUnetHTA members. The guideline provides orientation for systematic searches on clinical effectiveness conducted within the framework of EUnetHTA, and was developed in collaboration with the EUnetHTA members IQWiG, the Norwegian Institute of Public Health (NIPH) and the Andalusian Agency for Health Technology Assessment Area (AETSA), Version 2.0 has recently been published (5).

Guideline structure

The guideline comprises three parts. Part 1 consists of evidence-based recommendations for different aspects of the information retrieval process such as searching in bibliographic databases, study registries, and further information sources. Part 2 provides a practical example with screenshots and further explanations, while Part 3 summarizes the EUnetHTA standards for the work on EUnetHTA assessments.

Special features

The most notable feature of the EUnetHTA guideline is that many members are involved in its development and updating. With IQWiG as the main HTA agency responsible, and NIPH and AETSA as co-authors, a well-established authoring team exists that has been working on the guideline since 2014. Since then, two minor updates and one major update (Version 2.0) have been published, with public consultation on the latter in which nine stakeholders provided 196 comments.

New content in Version 2.0

Most of the work on the guideline was invested in the original Version 1.0 in 2014/2015, but each update involves a substantial additional amount of work. For instance, including new literature means checking whether the corresponding text in the guideline changes and the previous citations still apply or should be deleted. In the case of completely new sections, duplication of previous sections should be avoided and whether the guideline structure is still consistent needs to be checked. In the current Version 2.0, we revised and added the following content:

  1. (a) Further information on Clinical Study Reports (CSRs)

The search for and handling of CSRs is a dynamic field. Due to recent legal changes, access to CSRs and thus their relevance have increased considerably. In this section, we now also provide a clearer distinction between the different types of documents that can be identified via the regulatory agency Web sites, that is, complete CSRs as well as documents provided by the agencies (e.g. Food and Drug Administration [FDA], Medical and Statistical Review documents)

  1. (b) Automation

Automation plays an increasingly important role in information retrieval. This concerns search strategy development as well as study selection. The guideline presents the latest developments and refers, for example, to the Systematic Review Toolbox Web site (10), which offers various tools for the production of HTAs and systematic reviews (summarized as “systematic reviews” below).

  1. (c) Layered searching approach based on systematic reviews

The main methodological change is described in Chapter 4. In recent years, the use of existing systematic reviews has gained considerable importance. In this approach, the relevant systematic reviews are used as the main source for the primary studies considered in the assessment and whether they are of high quality and up-to-date must be checked in advance. In addition, an update search for primary studies is conducted. In our experience, this procedure is used by many HTA agencies. However, standardized methods are still lacking. To the best of our knowledge, this is the first time that the process is described outside the context of rapid reports.

  1. (d) Definition of EUnetHTA standards

As the literature does not always provide clear information retrieval standards, we defined such standards within the context of EUnetHTA (see new table in the appendix of the EUnetHTA guideline) where necessary.

For example, the literature recommends that information specialists should form an integral part of the assessment team of a systematic review (8;11;12). We have made this recommendation a mandatory component of EUnetHTA assessments, where both the authoring team and the dedicated reviewer group have to include an information specialist. Another example is the question regarding when the last search should be conducted before the planned publication of the assessment report. The available evidence suggests that the last search in a review should be conducted less than 12 months before publication. However, within EUnetHTA, we have agreed that the last search in an assessment is conducted less than 6 months before the planned publication of the assessment report.

Next steps

The future form of collaboration between EUnetHTA members is still being discussed. We assume that the EUnetHTA guideline—in whatever form—will continue to exist. This will also include regular updating. Feedback from the public consultation states that it would be desirable if a guideline update contained a description of information retrieval for further domains of HTAs (economic, ethical, and legal aspects) as well as a specific focus on searching for nonrandomized studies.

Standard Operating Procedures (SOPs)

The systematic development and establishment of quality management for EUnetHTA processes and products were initiated in Joint Action 3 (2016–2021) in order to improve the efficiency and quality of joint work. Thus, in addition to the methodological standards, EUnetHTA processes for information retrieval are also described in a step-by-step manner in SOPs.

So far, six information retrieval SOPs have been completed for rapid REAs on the assessment branches “pharmaceutical technologies” and “other technologies” (Table 2).

Table 2. Distribution of Information Specialist Tasks in EUnetHTA Assessments

Shaded box, SOP available 2020.

PICOS, Patient or Population, Intervention, Comparison, Outcome, Study design.

REA, Relative Effectiveness Assessment.

Different SOPs for the two branches are required, as the assessments are based on different approaches to information retrieval. The rapid REAs on “other technologies” (https://eunethta.eu/assessments/) are systematic reviews based on literature searches performed by the EUnetHTA authoring team's information specialist. In this team, the information specialist supports the development of the project plan and conducts the literature search. In the dedicated reviewer group, she or he checks the quality of reporting on information retrieval in the project plan and assessment report.

In rapid REAs on “pharmaceutical technologies,” information retrieval is performed and a dossier is submitted by the market authorization holder. The information specialist in the EUnetHTA authoring team checks the information retrieval presented in the dossier. The results are documented in an assessment report. The information specialist in the dedicated reviewer group checks the assessment of information retrieval and the supplementary search performed by the authoring team, as well as additional formal aspects. Examples of assessment reports of pharmaceutical technologies can be found on the EUnetHTA Web site (13).

As stated, the SOPs prescribe the involvement of an information specialist. In order to meet this requirement, the EUnetHTA project manager selects an information specialist from a list of project team members using specific selection criteria at the beginning of a rapid REA. If information retrieval expertise is insufficient in the project team, EUnetHTA's newly established Information Specialist Network (ISN) can be asked to support the assessment.

Information Specialist Network

The plan of establishing support groups of specialists (e.g. information specialists, statisticians) from different HTA members to support the HTA production teams was already part of the first proposal for EUnetHTA Joint Action 3. Due to a lack of resources, this initially had to be abandoned. Besides enhancing the quality of joint assessments, the idea was that an ISN would allow a scientific dialogue among information specialists from different European HTA agencies and promote improved joint understanding of qualitative and methodological issues in HTA.

The idea of an ISN was revived after publication of the SOPs on information retrieval. As not all HTA agencies were able to fulfil the mandatory requirement of the involvement of an information specialist, there was a need for support from agencies able to provide one. The ISN was established by information specialists already involved in EUnetHTA.

The network can be contacted whenever information specialists are needed in an authoring team or dedicated reviewer group. A steering committee—including information specialists from the Austrian Institute for Health Technology Assessment (AIHTA), NIPH, and IQWiG—has been established to manage enquiries and can be contacted to discuss methodological issues.

The EUnetHTA ISN currently consists of seventy-one information specialists, located in twenty-six EUnetHTA member agencies in fourteen countries (Italy, Sweden, Spain, the Netherlands, France, Ireland, Norway, the UK, Estonia, Belgium, Germany, Austria, Finland, and Poland). There are six HTA agencies with information specialist teams (number of information specialists: NICE: 30, G-BA: 8, Haute Autorité de santé [HAS]: 7, IQWiG: 6 (+4 library technicians), NIPH: 6, SBU: 4); thirteen agencies employ one or two information specialists, and seven none.

Implementation issues with the ISN

So far, the ISN has been involved in finding information specialists for individual assessments (mostly as a dedicated reviewer), and in providing advice via e-mail to other information specialists on how to apply the SOPs. A further goal is to provide targeted training on SOP/guideline content, for example, as webinars, and to continue working on structures and processes. Considerable efforts will be needed before EUnetHTA requirements for information retrieval become a standard component in all EUnetHTA assessments.

  • Not all agencies involve an information specialist when dealing with information retrieval in EUnetHTA assessments, even if an information specialist is employed in the agency.

  • The majority of EUnetHTA members employ only 1–2 information specialists or none at all. For these information specialists, it is difficult to incorporate additional tasks for EUnetHTA assessments.

  • The information specialists have varying levels of expertise in the different product types (e.g. dossier-based assessments, guidelines, etc.).

  • Although the methodological framework and SOPs for information retrieval are available, their standard use needs to be reinforced.

What future priorities were identified?

The EUnetHTA project will be extended until May 2021 and the negotiations on the proposal for the regulation of HTA (3) will presumably be concluded in 2020. Considerable progress has been made in EUnetHTA over the past 10 years. However, if EUnetHTA assessments are to be jointly prepared in the future, many questions need to be resolved.

Currently, EUnetHTA is preparing the transition from project-based to long-term collaboration. In the following, we discuss the information management tasks required (Table 3) and how they could be implemented (Figure 1).

Figure 1. Centralized and decentralized information management services.

Table 3. Different Information Management Tasks and Infrastructure

As stated, information management can be roughly divided into information retrieval as well as library tasks (14;15). This also includes provision of infrastructure and training.

The services could be organized into three different tiers: a central service unit, a supervising steering group committee (part of the ISN), and the individual information specialists in the assessment teams (Figure 1).

A central service unit could provide library tasks, training, and support for general methodological tasks in information retrieval (Table 3) and support the information specialists in the authoring teams and dedicated reviewer groups. It would also be responsible for providing and maintaining information management infrastructure and support, administration issues (e.g. dissemination of reports, copyright issues, etc.), and training. The central service unit and the individual information specialists could be supported by the ISN steering committee, which could supervise the development of methodological information retrieval standards and adherence thereto. For the establishment of a central service unit, general issues on infrastructure, sharing and management of literature, and copyright issues requiring legal clarification and amendment need to be discussed and solved.

Conclusion

Information management in EUnetHTA has made considerable progress over the past 10 years. With the EUnetHTA guideline, a common methodological understanding for the production of rapid REAs now exists. In addition, the guideline can serve as a general guide for the worldwide HTA information retrieval community. Furthermore, the SOPs map the complex information retrieval processes within EUnetHTA in a hands-on manner. The newly established ISN will in the future ensure that information specialists are involved in all EUnetHTA assessments and that the methods are applied consistently. In addition, the steering committee of the ISN manages enquiries and can be contacted to discuss methodological issues. For future long-term HTA collaboration, we propose a division of work between three different tiers: a central service unit, a steering group, and the individual information specialist. However, more collaboration and training are needed to overcome major barriers such as heterogeneity in the daily work of EUnetHTA members.

Acknowledgements

The authors thank Natalie McGauran for editorial support.

Financial support

This research received no specific funding from any agency, commercial or not-for-profit sectors.

Footnotes

*

Author surname has been corrected since publication. A correction notice was also published (DOI: https://doi.org/10.1017/S0266462321000076).

References

Swedish Agency for Health Technology Assessment and Assessment of Social Services [Internet]. About SBU [cited 2020 Mar 6]. Available from: https://www.sbu.se/en/about-sbu/.Google Scholar
European Commission [Internet]. Mapping of HTA national organisations, programmes and processes in EU and Norway [cited 2020 Mar 6]. Available from: https://ec.europa.eu/health/sites/health/files/technology_assessment/docs/2018_mapping_npc_en.pdf.Google Scholar
European Commission [Internet]. Proposal for a REGULATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL on health technology assessment and amending Directive 2011/24/EU. 2018 [cited 2020 Mar]. Available from: https://ec.europa.eu/health/sites/health/files/technology_assessment/docs/com2018_51final_en.pdf.Google Scholar
EUnetHTA [Internet]. EUnetHTA Joint Action 3 (2016–2020) [cited Mar 9]. Available from: https://eunethta.eu/ja3-archive/.Google Scholar
EUnetHTA JA3WP6B2-2 Authoring Team [Internet]. Process of information retrieval for systematic reviews and health technology assessments on clinical effectiveness: Guideline; version 2.0. [cited 2020 Feb 7]. Available from: https://eunethta.eu/wp-content/uploads/2020/01/EUnetHTA_Guideline_Information_Retrieval_v2-0.pdf.Google Scholar
EUnetHTA [Internet]. EUnetHTA Joint Action 2 (2012–2015). [cited 2020 Jan 14]. Available from: https://www.eunethta.eu/ja2-archive/.Google Scholar
Relevo, R, Balshem, H [Internet]. Finding evidence for comparing medical interventions: Methods guide for comparative effectiveness reviews; AHRQ publication no. 11-EHC021-EF 2011 [cited 2019 May 27]. Available from: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-guidance-finding-evidence_methods.pdf.CrossRefGoogle Scholar
Balshem, H, Stevens, A, Ansari, M, Norris, S, Kansagara, D, Shamliyan, T et al. Finding grey literature evidence and assessing for outcome and analysis reporting biases when comparing medical interventions: AHRQ and the Effective Health Care Program; methods guide for comparative effectiveness reviews; AHRQ publication no. 13(14)-EHC096-EF Rockville: Agency for Healthcare Research and Quality; [cited 2019 Mar 18]. Available from: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-guidance-reporting-bias_methods.pdf.Google Scholar
Higgins, JPT, Thomas, J, Chandler, J, Cumpston, M, Li, T, Page, MJ et al. [Internet] Cochrane handbook for systematic reviews of interventions: Version 6.0 [cited 2019 Nov 5]. Available from: https://training.cochrane.org/handbook.CrossRefGoogle Scholar
[Internet]. SR Toolbox. [cited 2020 Mar 26]; Available from: systematicreviewtools.com.Google Scholar
Centre for Reviews and Dissemination [Internet]. Systematic reviews: CRD's guidance for undertaking reviews in health care. 1.3 Undertaking the review. York: CRD ;, 2009 [cited 2014 Jun 11]. Available from: http://www.york.ac.uk/inst/crd/pdf/Systematic_Reviews.pdf.Google Scholar
Spencer, AJ, Eldredge, JD. Roles for librarians in systematic reviews: A scoping review. J Med Libr Assoc. 2018;106:4656.CrossRefGoogle ScholarPubMed
EUnetHTA [Internet]. Assessments REA (2016–2021). [cited 2020 Feb 10]. Available from: https://eunethta.eu/rapid-reas/.Google Scholar
Waffenschmidt, S, Hausner, E. Collaborative working to improve searching. In: Levay, P, Craven, J, editors. Systematic searching: Practical ideas for improving results. London: Facet Publishing; 2019. p. 229–48.Google Scholar
Brettle, A. The information specialist as an expert searcher. In: Levay, P, Craven, J, editors. Systematic searching: Practical ideas for improving results. London: Facet Publishing; 2019. p. 269–88.Google Scholar
Figure 0

Table 1. Information Specialist Involvement per Product within the Six European Agencies Employing Information Specialist Teams

Figure 1

Table 2. Distribution of Information Specialist Tasks in EUnetHTA Assessments

Figure 2

Figure 1. Centralized and decentralized information management services.

Figure 3

Table 3. Different Information Management Tasks and Infrastructure