Prospective systematic review registration: perspective from the Guidelines International Network (G-I-N)

Abstract

Clinical practice and public health guidelines are important tools for translating research findings into practice with the aim of assisting health practitioners as well as patients and consumers in health behavior and healthcare decision-making. Numerous programs for guideline development exist around the world, with growing international collaboration to improve their quality. One of the key features in developing trustworthy guidelines is that recommendations should be based on high-quality systematic reviews of the best available evidence. The review process used by guideline developers to identify and grade relevant evidence for developing recommendations should be systematic, transparent and unbiased. In this paper, we provide an overview of current international developments in the field of practice guidelines and methods to develop guidelines, with a specific focus on the role of systematic reviews. The Guidelines International Network (G-I-N) aims to stimulate collaboration between guideline developers and systematic reviewers to optimize the use of available evidence in guideline development and to increase efficiency in the guideline development process. Considering the significant benefit of systematic reviews for the guideline community, the G-I-N Board of Trustees supports the international prospective register of systematic reviews (PROSPERO) initiative. G-I-N also recently launched a Data Extraction Resource (GINDER) to present and share data extracted from individual studies in a standardized template. PROSPERO and GINDER are complementary tools to enhance collaboration between guideline developers and systematic reviewers to allow for alignment of activities and a reduction in duplication of effort.

Background

Clinical practice and public health guidelines are "systematically developed statements designed to help practitioners and patients to make decisions about appropriate healthcare for specific circumstances" [1] (p. 38). The Institute of Medicine recently updated this early definition to underscore the importance of systematic review of the evidence and both benefits and harms assessment as essential characteristics of practice guidelines: "Clinical practice guidelines are statements that include recommendations intended to optimize patient care, that are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options" [2] (p. 4). In healthcare services, clinical guidelines are considered important instruments with which to improve and manage the care process [3–6]. Important goals in developing and implementing guidelines are higher quality and improved cost-effectiveness of interventions, ideally resulting in improved health outcomes [7, 8].

The growing body of knowledge in the field of clinical guidelines has provided opportunities for international collaboration. In 2002, the Guidelines International Network (G-I-N) was founded to provide a network and partnerships for guideline organizations, implementers, researchers and other stakeholders in healthcare [9]. G-I-N seeks to improve the quality of health care by promoting the systematic development of guidelines and their application to practice.

One of the key features in developing guidelines is to ensure that guideline recommendations are based, as much as possible, on high-quality systematic reviews of the best available evidence. Similarly, the review process used by guideline developers to identify and grade relevant evidence for developing recommendations should be systematic, transparent and unbiased. The medical literature is expanding quickly [10], and ongoing collaboration between guideline developers and systematic reviewers is needed to maximize the use of the best available evidence to support guideline recommendations. The international prospective register of systematic reviews (PROSPERO) is a promising new initiative whose purpose is to stimulate collaboration, reduce duplication of research efforts and improve quality [11].

In this paper, we introduce the international guideline community and describe current methods for developing guidelines with a specific focus on the role of systematic reviews in guideline development. The aim of this paper is to create common ground for guideline developers and systematic reviewers on which to base their collaboration.

The Guidelines International Network (G-I-N)

G-I-N is a global network which comprises 93 organizations and 89 individuals as members representing 46 countries from all continents (as of January 2012). The network supports evidence-based healthcare and improvement of health outcomes throughout the world. The specific aims of G-I-N are to promote best practices and reduce duplication of research efforts by improving the efficiency and effectiveness of evidence-based guideline development, adaptation, dissemination and implementation. One of the main assets of G-I-N is its International Guideline Library. The library contains more than 7,400 documents (as of January 2012) and includes guidelines (N = 3,636), evidence reports, methodologies and other related documents developed or endorsed by G-I-N member organizations [12].

A recent, important new product of G-I-N in relation to systematic reviews has been developed by G-I-N's Evidence Tables Working Group. This group has developed a minimum data set that can be used to summarize published studies. A template for intervention studies has been developed [13] in addition to a template for diagnostic studies. Templates for healthcare economic and prognostic studies are in preparation. The templates allow for consistent comparison across studies and to inform a group process in synthesizing evidence. On this basis, a resource has been developed to allow reviewers to present data extracted from individual studies using a standardized template (called a "summary" for short). This resource forms the foundation for development of evidence tables which summarize data based on a defined question. The summaries can then be used by G-I-N members in their guideline development process to populate their evidence tables using the data directly as presented in the original research articles or modified according to their specific needs. The registry was launched in August 2011 at the Eighth G-I-N Conference in Seoul under the acronym of GINDER: G-I-N Data Extraction Resource [12].

Methodology for guideline development

Methods for guideline development have been harmonized to a certain degree [14, 15]. Core elements of the process are formulating the relevant healthcare clinical questions, identifying relevant outcomes, systematically identifying and summarizing the relevant evidence, synthesizing the evidence by evaluation of its quality and formulating recommendations for daily practice or healthcare policy. The steps in guideline development are given in Table 1.

Table 1 Elements in guideline development^a

A standard guideline development process is essential to ensuring that developers publish valid, reliable guidelines that can be used in their research. The Appraisal of Guidelines, Research and Evaluation (AGREE II) instrument is a valuable tool with which to analyze the rigor of development of a good guideline [16], and standards for guideline development have been developed at the national level, such as the recently published standards for trustworthy guidelines issued by the Institute of Medicine [2]. Thus far, however, the guideline community has not established a common set of internationally recognized standards to help improve the development of high quality guidelines. International standards will facilitate information sharing and adaptation to reduce duplication of efforts and support initiatives for the development of high-quality national or local guidelines. The G-I-N Board of Trustees recently prepared a position paper with key components describing how to develop and evaluate quality clinical practice guidelines (Qaseem A. et al, Guidelines International Network: Towards International Standards for Clinical Practice Guidelines, Annals of Internal Medicine 2012;156 (forthcoming)). This position paper should contribute to further harmonization of the guideline development process and stimulate the development of international guideline standards.

The role of systematic reviews in guideline development

Recommendations in guidelines are typically derived from a set of key questions for prevention, diagnosis and/or treatment for the target group of patients. Key questions should include elements that will guide the literature review process: the familiar patient problem or population, intervention, comparison and outcomes (PICO) format [17]. Other issues to be considered are the importance of the effectiveness of interventions by estimating the effect sizes for the relevant outcomes and whether the desirable effects (benefits) outweigh the undesirable effects (harms) [18]. Weighing benefits and harms also requires the collection of empirical data or qualitative information about the values and preferences of patients.

The literature review to identify and summarize the evidence must be carried out in such a way that the potential for any bias is minimized. Some manuals of national guideline programs include the production of full systematic reviews, whereas others primarily identify existing systematic reviews and conduct additional reviews if necessary and feasible [19–23]. Depending on the number of questions, multiple systematic reviews may be required to inform a guideline. A recent editorial published in the Cochrane Database of Systematic Reviews shows that the National Institute of Health and Clinical Excellence frequently uses the Cochrane reviews in issuing guidelines, although the authors of the editorial advocate better use of Cochrane reviews, as well as more collaboration between groups, in developing guidelines [24]. Another option used by guideline developers is to identify evidence in existing guidelines, because guideline databases are growing [12, 25].

Systematic reviews intended to inform the development of clinical guidelines should follow principles outlined in published checklists such as the PRISMA statement for transparent reporting of systematic reviews and meta-analyses [26]. The Institute of Medicine recently published standards for systematic reviews, which include a standard for interaction between guideline developers and systematic reviewers [27]. Use of an explicit and transparent strategy to evaluate evidence helps users to interpret the relative strength of the evidence [28, 29]. Identified studies are systematically appraised by assessing the methodological quality and relevance of the clinical context in the study. On the basis of the quality of individual studies, an overall synthesis of the evidence will result in evidence statements, usually expressed as levels of evidence. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach is increasingly being adopted by guideline development organizations worldwide [18]. The use of observational data has been advocated to create evidence for everyday practice needs, and adaptive approaches have been proposed to synthesize evidence using outcomes of both randomized trials and observational research [30, 31]. International collaboration to address these issues is important for building a body of knowledge and standards in guideline development.

Translating evidence into recommendations for clinical practice

Once the evidence is identified and appraised, the guideline development group must consider its relevance and applicability to practice, including anticipated benefits and harms, to formulate recommendations that can be put into action [32]. Guideline developers must make a considered judgment about the generalizability, applicability, consistency and clinical impact of the evidence to create a clear link between recommendations and the underlying evidence. This is a crucial part of the guideline development process in which local circumstances need to be taken into account. The strength of recommendations included in guidelines is usually subject to a grading system, such as the GRADE approach, that takes into account the quality of the evidence and the considered judgment of the guideline developers [18]. Transparency of the considered judgment of guideline development groups is important to understanding the arguments for specific recommendations. Guideline recommendations should be expressed in clear, unambiguous language to facilitate implementation [33].

Perspective for collaboration

Because developing new systematic reviews and using existing ones are essential components of the guideline development process, there is clearly potential for better collaboration between guideline developers and systematic reviewers. Interaction between guideline developers and systematic reviewers is important for formulating PICO questions, conducting the review of the evidence, compiling the evidence tables and summarizing and presenting the evidence. Resource constraints on guideline development may limit the number of new systematic reviews that can actually be carried out in a guideline project. In addition, many systematic reviews do not meet the standards that are essential for use in developing a good guideline [2, 27]. Collaborative approaches to further improvement of the quality of systematic reviews and the use of high-quality reviews in translating evidence into guideline recommendations are therefore essential.

Alderson and Tan [24] made a plea for better use of Cochrane reviews in guideline development, and PROSPERO may help to achieve that objective. A crucial factor in fostering better collaboration is alignment of activities at the very start of the process. Guideline developers should be aware of existing or expected systematic reviews to support their project, and systematic reviewers should be aware of the relevant healthcare or clinical questions in focusing their reviews. The prospective registration of systematic review protocols provides an excellent basis from which to seek alignment and create opportunities for including systematic reviewers as members of the guideline development group. Identification of upcoming or existing systematic reviews can reduce the workload and resources needed for guideline development. The participation of systematic reviewers in the guideline development process enhances the application of their research findings to practice and help bridge the gap between research and practice. The GINDER registry of evidence summaries can further enhance collaboration and reduce duplication of efforts.

G-I-N and PROSPERO have recognized the possibility of closer collaboration and have started to encourage their members and affiliates to work together. G-I-N stimulates its members to use PROSPERO in searching for published systematic reviews and systematic review protocols, and G-I-N promotes the registration of systematic reviews within guideline development projects. PROSPERO has created a link to G-I-N's website to raise awareness among systematic reviewers of the potential impact of their work on the development of guideline recommendations and to facilitate the use of GINDER.

Conclusion

A registry of high-quality systematic reviews based on rigorous standards is a topic of international interest. We think that the international prospective register of systematic reviews is of significant value for the international guideline community. This paper summarizes the view of G-I-N's Board of Trustees that high-quality systematic reviews are essential for developing good clinical practice and public health guidelines and that G-I-N supports the PROSPERO initiative. PROSPERO and GINDER are important complementary tools with which to enhance collaboration between guideline developers and systematic reviewers and allow for alignment of activities and reduced duplication of efforts.