Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-02-06T09:18:08.725Z Has data issue: false hasContentIssue false

SHAPING QUALITY THROUGH VISION, STRUCTURE, AND MONITORING OF PERFORMANCE AND QUALITY INDICATORS: IMPACT STORY FROM THE QUEBEC TRAUMA NETWORK

Published online by Cambridge University Press:  05 June 2017

Catherine Truchon
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux catherine.truchon@inesss.qc.ca
Lynne Moore
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Amina Belcaid
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Julien Clément
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Nathalie Trudelle
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Marie-Andrée Ulysse
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Benoît Grolleau
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Jacinthe Clusiau
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Danielle Lévesque
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Michèle de Guise
Affiliation:
Trauma Unit, Institut national d'excellence en santé et services sociaux
Rights & Permissions [Opens in a new window]

Abstract

Objectives: The Quebec Trauma Care Continuum (TCC) was initiated in 1991 with the objective of providing accessible, continuous, efficient, and high quality services for all injury cases in the province.

Methods: The TCC design relied on three key components: (i) the designation of a network of acute care and rehabilitation facilities with specific mandates and responsibilities; (ii) the elaboration of transfer protocols, standing agreements, and governing structures to ensure fluid and optimal patient flow; and (iii) the close monitoring of several indicators to facilitate the continuous evaluation and improvement of the network.

Results: Between 1992 and 2002, in-hospital mortality following major trauma decreased from 51.8 percent to 8.6 percent, followed by an additional 24 percent drop between 1999 and 2012. We also observed a 16 percent decrease in average LOS but no change in the incidence of complications or unplanned readmissions. These changes translate into 186 lives saved per year and cost savings, due to shorter LOS, of 6.3 million CD$ per year. The risk-adjusted incidence of in-hospital mortality following major injury between 2006 and 2012 (7 percent) was the lowest of all Canadian provinces.

Conclusions: Strategic transformation of a network's structure and processes, supported by continuous monitoring of validated quality indicators, can lead to significant and sustainable improvements in clinical outcomes. It is hoped that the Quebec trauma story will inspire other jurisdictions and other healthcare sectors.

Type
Theme Submissions
Copyright
Copyright © Cambridge University Press 2017 

THE NEED FOR CHANGE

Before the 1990s, there were in Quebec no regulated prehospital triage system and poor inter-hospital communication and transfer mechanisms. Trauma victims were taken to the nearest hospital, regardless of the severity of the injury and the capacity of the facility, which translated into undue delays, suboptimal transfers, and decreased capacity to intervene properly. Moreover there were no quality standards, control processes, and evaluation mechanisms at the time. Not surprisingly, this situation was associated with an increased rate of mortality and morbidity as compared to other hospitals in Canada and in the United States (Reference Liberman, Mulder, Lavoie and Sampalis1;2). Determined to change this unenviable record, the Quebec government made trauma a provincial priority in 1990 and initiated a series of measures and changes based on best practices and continuous quality monitoring that would transform the Quebec's field of trauma care into becoming one of the best organized systems in the country and beyond (Reference Liberman, Mulder, Lavoie and Sampalis1;2).

Initiated in 1991 and inspired by other high-performing systems in the world, the creation of the Quebec trauma care continuum (TCC) aimed to provide accessible, continuous, efficient, and high quality services for all trauma victims in the province. Its design relied on three key components: (i) the designation of a network of acute care and rehabilitation facilities with specific mandates and responsibilities; (ii) the elaboration of transfer protocols, standing agreements, and governing structures to ensure fluid and optimal patient flow throughout the continuum; and (iii) the close monitoring of several structure, process, and results indicators to facilitate the continuous evaluation and improvement of the network.

None of these three components could have, by itself, allowed the TCC to take form and reach its full potential. Structural elements and coordination mechanisms serve as the backbone of the entire system. However, the continuous evaluation and retroaction process, solidly anchored in evidence-based knowledge, is central to the system's sustainability, responsiveness, and most of all, to its capacity to drive improvements and generate tangible results.

Positioning the Structure and Process Backbone of the Network

Lead by a partnership between the ministère de la Santé et des Services sociaux (MSSS) and the Régie de l'assurance automobile du Québec (RAAQ, which became in 1990 the “SAAQ” for Société de l'assurance automobile du Québec), the TCC was implemented in several phases over a period of 20 years (see reference 3 for a detailed account of the history and key components of the TCC). The first step involved the designation of individual hospitals into one of four levels of a hierarchical system of specialized trauma services developed by the American College of Surgeons based on various criteria pertaining to volume, availability of resources, expertise, etc. (3;Reference Boyd and Cowley4).

A trauma advisory expert group first audited over 70 facilities, using a structured assessment grid based on available evidence (mainly the various standards put forward by the American College of Surgeons) (Reference Boyd and Cowley4) and expert opinions. The assessment criteria included an array of components, for example, admission volumes, transfer number, delays, length of stay, medical staff, technical plateau, staff training, and clinical protocols. Field triage guidelines and prehospital protocols were introduced to ensure the transportation of trauma victims to the designated facility in minimal delays. Over time, the list of evaluation criteria was updated based on evolving literature and practice-based knowledge, leading to a reduction in the number of facilities involved and an adjustment of the levels of designation to meet regional and provincial needs.

Similar designation processes were conducted during that period with rehabilitation facilities as well as consortiums of facilities and centers of expertise, thereby ensuring better flow of services and high expertise for specific patient populations (e.g., traumatic brain injury, spinal cord injury, severe burns, amputations). The overall resulting trauma system is now composed of fifty-nine trauma centers including three adult and two pediatric level 1, five level II, twenty-one level III, and twenty-eight level IV centers. Standardized prehospital protocols ensure that major traumas are directed to these designated hospitals and standing agreements regulate transfers between hospitals and between hospitals and rehabilitation facilities (Reference Moore, Turgeon and Lauzier5).

To ensure the carry-over and strengthening effects of the audits, each trauma designation came with a list of obligations and reporting requirements for the facilities, consortiums, and regional health authorities, such as the maintenance of local and regional trauma committees, the elaboration of various collaboration agreements, and the production of action plans and annual reports. These elements were validated by the evaluation team and the status of completion of each facility was color-coded and posted on the trauma Web site described below. Still today, a permanent trauma committee, now based at the Institut national d'excellence en santé et en services sociaux (see Figure 1), monitors the presence and conformity of these requirements on a continuous basis and advises the MSSS of situations requiring action.

Figure 1. Mission of the Institut national d'excellence en santé et en services sociaux (INESSS).

SETTING UP THE CONTINUOUS MONITORING SYSTEM

One of the key ingredients of the vision and planning of the TCC was the implementation, along with the designation of the first trauma centers, of a centralized trauma registry. This enabled the trauma evaluation team to directly extract and analyze the data of each facility and compare them with other facilities of the same level throughout the province. This gradually led to the development of a centralized assessment-management Web site. Through this Web site, the trauma evaluation team at INESSS can validate the presence and conformity of the different structural elements (e.g., standing agreements, governing structure, protocols, etc.) and processes (e.g., clinical activities) requirements linked to the designation of each facility.

Comprising three levels of accessibility, on the first level the Web site contains information on injury for the general public. On the second level, those involved in the trauma network can access, consult, and extract protocols, procedures, and algorithms produced by their and other facilities, enabling sharing of material and best practices. Finally, a third secure level, accessible to only certain individuals in each facility, provides access to statistics, performance data, and evaluation reports.

PROMOTING QUALITY THROUGH THE MONITORING OF KEY PROCESSES AND RESULTS

Although the original in-person audit model of evaluation was certainly relevant and helpful at the time of the creation of the TCC, it is perhaps less necessary now that the system has reached a certain level of maturity. The continuous evaluation of the trauma system now relies mainly on the exploitation of the trauma registry, the monitoring of quality indicators, and the systematic analyses of these data by governing authorities and key stakeholders in each facility.

Each year, Trauma Registry data are extracted and analyzed at the provincial level as well as site by site. Reports layering out either 3 or 5 years of cumulative data are produced for each facility every year for level I and II centers and every 3–5 years for level III and IV data, depending on patient volume. These reports include descriptive statistics pertaining to the socio-demographic profile of the patients, patient volume, the origin and discharge destination of patients, length of stay, etc. Thirteen process indicators (Table 1) as well as twelve outcome indicators (Table 2), developed through a rigorous methodological protocol (Reference Moore, Lavoie, Bourgeois and Lapointe6Reference Moore, Lavoie and Sirois12) are calculated, and these results are tabulated in graphs positioning each facility among all designated sites in the province (see example in Figure 2).

Table 1. Process Indicators

GCS, Glasgow Coma Scale; ICU, intensive care unit; ISS, Injury Severity Score.

Table 2. Outcomes Indicators

ISS, Injury Severity Score; LOS, length of stay.

Figure 2. Adjusted mortality rate of all trauma facilities.

These graphs allow knowledge users to monitor provincial averages and identify facility outliers. Upon the reception of their data, the local trauma committee of each facility is required to analyze their statistics and indicators and submit a commented analysis grid and associated action plan to the trauma evaluation team. Programs experiencing particular difficulties or persistent poor performance are discussed with the ministry and relevant authorities. Specific visits can be conducted to further explore the potential sources of problems (structure or process elements) and help orient solutions. This continuous “assessment-retroaction-correction-reassessment” cycle is what essentially drives changes within each facility and allows the administrators and clinicians to continuously review and improve their processes.

THE IMPACT

Almost 25 years have passed since major changes have been initiated in the province of Quebec. A total of four full cycles of assessments have been completed with acute care centers, in addition to several evaluations of the designated consortia and centers of expertise. Although other factors certainly also contributed to the positive evolution of the trauma system and its outcomes during that period (e.g., aggressive prevention campaigns by the SAAQ), the process of monitoring and reporting on structural elements, organizational and clinical processes, as well as various clinical results have brought on incremental changes and improvement within the network. Transfer and communication protocols have been refined where delays and obstacles were shown to persist, adapted trajectories have been put in place to respond to specific needs, numerous clinical protocols were developed and implemented to better respect the established standards of care, to decrease complications and ultimately improve outcomes such as mortality.

The results of these combined efforts are eloquent and serve as a great testimony to the vision and innovative leadership demonstrated by a nucleus of real champions of change, but also to the powerful effect of continuous evaluation and reporting. (i) Between 1992 and 2002, the incidence of in-hospital mortality from major trauma decreased from 51.8 percent down to 8.6 percent (Reference Liberman, Mulder, Lavoie and Sampalis1) (although methodological limitations and differences in the two measurement periods are recognized by the authors). (ii) An additional 24 percent drop in in-hospital mortality was observed between 1999 and 2012, from 5.8 percent to 4.2 percent, accompanied by a 16 percent decrease in average length of stay (15.5 to 11.5 days) but no change in the incidence of complications or unplanned readmissions. These changes translate into 186 lives saved per year and cost savings, due to shorter LOS, of 6.3 million CD$ per year (Reference Moore, Turgeon and Lauzier5). (iii) The risk-adjusted incidence of in-hospital mortality following major injury between 2006 and 2012 (7 percent) was the lowest of all Canadian provinces (Reference Moore, Evans and Hameed13).

In addition to the various publications produced over the years on the development and validation of the Quebec quality framework described above, these outstanding achievements have been recognized by different authorities, serving as a specific example of the World Health Organization's manuscript on “Success stories and lessons from around the world” (2), receiving praise by the Auditor General of the province (14), in addition to numerous awards and distinctions granted to specific individuals having played key roles in the TCC's inception.

CHALLENGES AND FUTURE PERSPECTIVES

Transforming, step by step and over such a long period of time, a complex and multi-faceted system requires a lot of energy and will but ensuring its sustainability over time certainly comprises other important challenges. Financial strains, competing priorities, and changing environments make it more difficult to keep the different supporting structures as dynamic and proactive as when they were created. Governing bodies and hospitals are faced with emerging healthcare needs and priorities (e.g., aging population, cancer, and stroke, etc.) and may perceive a well-integrated and high-performing system as something that requires less investment.

In response to these growing concerns, the trauma evaluation team at INESSS has made significant efforts over the past few years to simplify and lighten the mechanisms used to evaluate the conformity of the different structure and processes components. As mentioned above, the ongoing development and monitoring of key indicators now serve as the primary method used for controlling quality and promoting continuous improvement. Facilities take on a more active role in this process and should gradually be able to take ownership of the quality improvement process within their organization, provided continuous support and some level of control are maintained centrally.

Not being as involved in system coordination activities and facility audits, the INESSS trauma evaluation unit can invest more time and resources in projects aimed at better supporting the network, such as the development of clinical guidelines, algorithms, and best practice implementation initiatives. It is hoped that this revamped process will ensure long-lasting results for all trauma victims and will inspire other jurisdictions and other sectors of activities. The successful story of the TCC, the lessons learned, and the adjustments made over time are incredibly rich sources of information that should guide decisions and reorganization efforts of numerous other fields of the healthcare system in great need of quality improvement and optimized performance.

CONFLICTS OF INTEREST

The authors have nothing to disclose.

References

REFERENCES

1. Liberman, M, Mulder, DS, Lavoie, A, Sampalis, JS. Implementation of a trauma care system: Evolution through evaluation. J Trauma. 2004;56:13301335.Google Scholar
2. World Health Organization. Strengthening care for the injured: Success stories and lessons learned from around the world. Geneva׃ World Health Organization; 2010. http://whqlibdoc.who.int/publications/2010/9789241563963_eng.pdf?ua=1 Google Scholar
3. Institut national d'excellence en santé et en services sociaux (INESSS). Les caractéristiques, l'historique et l'implantation du continuum de services en traumatologie du Québec (1991-2012). Montréal, Qc: INESSS; 2012. http://www.inesss.qc.ca/fileadmin/doc/INESSS/Rapports/Traumatologie/INESSS_historique_CST.pdf Google Scholar
4. Boyd, DR, Cowley, RA. Comprehensive regional trauma/emergency medical services (EMS) delivery systems: the United States experience. World J Surg. 1983;7:149.Google Scholar
5. Moore, L, Turgeon, AF, Lauzier, F, et al. Evolution of patient outcomes over 14 years in a mature, inclusive Canadian trauma system. World J Surg. 2015;39:13971405.CrossRefGoogle Scholar
6. Moore, L, Lavoie, A, Bourgeois, G, Lapointe, J. Donabedian's structure-process-outcome quality of care model: Validation in an integrated trauma system. J Trauma Acute Care Surg. 2015;78:11681175.Google Scholar
7. Moore, L, Lauzier, F, Stelfox, HT, et al. Validation of complications selected by consensus to evaluate the acute phase of adult trauma care: A multicenter cohort study. Ann Surg. 2015;262:11231129.Google Scholar
8. Moore, L, Stelfox, HT, Turgeon, AF, et al. Derivation and validation of a quality indicator for 30-day unplanned hospital readmission to evaluate trauma care. J Trauma Acute Care Surg. 2014;76:13101316.Google Scholar
9. Moore, L, Stelfox, HT, Turgeon, AF, et al. Derivation and validation of a quality indicator of acute care length of stay to evaluate trauma care. Ann Surg. 2014;260:11211127.Google Scholar
10. Moore, L, Lavoie, A, Sirois, MJ, et al. Evaluating trauma center process performance in an integrated trauma system with registry data. J Emerg Trauma Shock. 2013;6:95105.Google Scholar
11. Moore, L, Lavoie, A, Sirois, MJ, et al. A comparison of methods to obtain a composite performance indicator for evaluating clinical processes in trauma care. J Trauma Acute Care Surg. 2013;74:13441350.Google Scholar
12. Moore, L, Lavoie, A, Sirois, MJ, et al. Evaluating trauma center structural performance: The experience of a Canadian provincial trauma system. J Emerg Trauma Shock. 2013;6:310.Google Scholar
13. Moore, L, Evans, D, Hameed, SM, et al. Mortality in Canadian trauma systems: A multicenter cohort study. Ann Surg. 2017;265:212217.Google Scholar
14. Vérificateur général du Québec. Rapport à l'Assemblée nationale pour l'année 2004-2005 – Tome II. Chapitre 2 : Continuum de services. Vérification menée auprès du ministère de la Santé et des Services sociaux, d'agences de développement de réseaux locaux de services de santé et de services sociaux et d’établissements du réseau de la santé et des services sociaux. Québec, Qc: Vérificateur général du Québec; 2005. http://www.vgq.gouv.qc.ca/fr/fr_publications/fr_rapport-annuel/fr_2004-2005-T2/fr_Rapport2004-2005-T2-Chap02.pdf Google Scholar
Figure 0

Figure 1. Mission of the Institut national d'excellence en santé et en services sociaux (INESSS).

Figure 1

Table 1. Process Indicators

Figure 2

Table 2. Outcomes Indicators

Figure 3

Figure 2. Adjusted mortality rate of all trauma facilities.