A regional massive hemorrhage protocol developed through a modified Delphi technique ==================================================================================== * Jeannie L. Callum * Calvin H. Yeh * Andrew Petrosoniak * Mark J. McVey * Stephanie Cope * Troy Thompson * Victoria Chin * Keyvan Karkouti * Avery B. Nathens * Kimmo Murto * Suzanne Beno * Jacob Pendergrast * Andrew McDonald * Russell MacDonald * Neill K.J. Adhikari * Asim Alam * Donald Arnold * Lee Barratt * Andrew Beckett * Sue Brenneman * Hina Razzaq Chaudhry * Allison Collins * Margaret Harvey * Jacinthe Lampron * Clarita Margarido * Amanda McFarlan * Barto Nascimento * Wendy Owens * Menaka Pai * Sandro Rizoli * Theodora Ruijs * Robert Skeate * Teresa Skelton * Michelle Sholzberg * Kelly Syer * Jami-Lynn Viveiros * Josee Theriault * Alan Tinmouth * Rardi Van Heest * Susan White * Michelle Zeller * Katerina Pavenski ## Abstract **Background:** A massive hemorrhage protocol (MHP) enables rapid delivery of blood components in a patient who is exsanguinating pending definitive hemorrhage control, but there is variability in MHP implementation rates, content and compliance owing to challenges presented by infrequent activation, variable team performance and patient acuity. The goal of this project was to identify the key evidence-based principles and quality indicators required to develop a standardized regional MHP. **Methods:** A modified Delphi consensus technique was performed in the spring and summer of 2018. Panellists used survey links to independently review and rate (on a 7-point Likert scale) 43 statements and 8 quality indicators drafted by a steering committee composed of transfusion medicine specialists and technologists, and trauma physicians. External stakeholder input from all hospitals in Ontario was sought. **Results:** Three rounds were held with 36 experts from diverse clinical backgrounds. Consensus was reached for 42 statements and 8 quality indicators. Additional modifications from external stakeholders were incorporated to form the foundation for the proposed MHP. **Interpretation:** This MHP template will provide the basis for the design of an MHP toolkit, including specific recommendations for pediatric and obstetrical patients, and for hospitals with limited availability of blood components or means to achieve definitive hemorrhage control. We believe that harmonization of MHPs in our region will simplify training, increase uptake of evidence-based interventions, enhance communication, improve patient comfort and safety, and, ultimately, improve patient outcomes. Massive bleeding is a leading preventable cause of death following trauma, childbirth and surgery.1–3 There were 5.1 million deaths after traumatic injury worldwide in 2010, mostly affecting young people, accounting for nearly 10% of all deaths.4 In the United States, it is estimated that up to 20% of such deaths are the direct result of preventable hemorrhage.4–7 Management of unstable hemorrhagic shock is centred on stabilizing the patient with prompt transfusion of blood components, and rapid identification and treatment of the source of bleeding. Patient outcome is dependent on the availability of rapid definitive surgical intervention, support of a transfusion medicine and clinical laboratory, prompt access to hemostatic agents and care provided by a high-performing interdisciplinary team.8 In the trauma literature, protocolized delivery of massive transfusion streamlines the complexities of rapid access to surgical care and blood components, decreases variability of treatment, increases protocol compliance, reduces blood component wastage, facilitates interprofessional communication and allows for tracking of metrics for continuous quality improvement.9–12 Most academic institutions have a massive hemorrhage protocol (MHP) in place to rapidly deliver blood components and coordinate care in the setting of traumatic injury.13 However, in a recent survey of 150 hospitals in Ontario, the proportion of hospitals with MHPs in nonacademic settings was lower than that in academic settings, and there was significant protocol heterogeneity between hospitals.14 This was also seen in well-established trauma centres in the US,15 where civilian implementation is still highly variable.12 Compliance with MHPs is also highly variable,12 and low compliance may have ramifications for patient outcomes.16 A systematic review of before–after studies comparing patients with trauma managed in periods with and without an MHP showed an association between MHP use and better survival. 17 The benefits of an MHP have not been tested in rigorous prospective randomized trials. Maintaining high levels of compliance with MHPs appears to be a universal challenge. 12,16 Ontario has the largest population of all the Canadian provinces and provides hospital care in a diverse mixture of settings with high and low health care resources. Massive hemorrhage is an infrequent event in many areas served by small regional hospitals. As a result, access to blood components, laboratory tests of hemostasis and surgical expertise are highly variable. Instituting an adaptable MHP for the province based on the local health care resource setting is needed to streamline the complex logistics of rapid delivery of blood components, facilitate rapid patient transfer where required and reduce the cognitive burden on bedside clinicians. With the ultimate goal of developing such a protocol, we aimed to identify the key principles and quality indicators required to develop a provincial standardized evidence-based MHP template for hospitals. ## Methods ### Steering committee and panellists A steering committee composed of transfusion medicine specialists and technologists, and trauma physicians selected the panel members, organized the MHP forum, administered the surveys and analyzed the results. The steering committee assembled a panel of 36 content experts to represent relevant stakeholders. The panel members were selected through the Ontario Regional Blood Coordinating Network, which oversees transfusion use, audits of practice and educational initiatives for the region. The steering committee selected members for their broad expertise and responsibility in administering MHPs across Ontario’s geographically diverse network. Panel participation was voluntary and not financially remunerated. Travel reimbursement and meals were provided, and authorship was afforded only to those who participated in all phases of the Delphi process. The panel included anesthesiologists, trauma surgeons, obstetricians, hematologists, transfusion medicine physicians, emergency physicians, prehospital and transport medicine physicians, intensivists, blood supplier representatives, nurses, technologists and a patient. The group represented the geographically diverse health care programs in the province, with representatives from academic hospitals, specialized pediatric institutions, suburban hospitals and smaller, rural hospitals. The panellists were informed of the purpose and scope of the exercise, and of the requirement to attend a 2-day MHP forum in Toronto and complete all rounds of the Delphi exercise. To standardize the knowledge base of panellists, they were provided with copies of original papers selected by the steering committee and reflecting the most up-to-date evidence in the area of massive hemorrhage management before the first round. The MHP forum had both didactic and interactive sessions, in which content experts reviewed each area of the MHP for 15 minutes, after which there was a 15-minute discussion period for the attendees. ### Study design We chose a modified Delphi technique to establish consensus and the framework for the provincial MHP toolkit. The Delphi technique is a systematic, interactive method that relies on a panel of experts to converge on consensus statements following a series of iterative surveys.18 Rounds of surveys are continued until consensus is achieved. The Delphi technique is deemed a relevant source of evidence in health care research and is particularly important if randomized controlled trials are unavailable to set health care policies.19 Our group used this method previously20 and noted its ability to cost-effectively include a large number of participants who are geographically dispersed, while preventing unequal representation or biasing of opinions in the consensus through iterations of anonymous voting.21 We modified the Delphi technique to allow for open forum of discussion in round 1 only, to ensure that the broadest range of expert experience was captured in the consensus. The modified Delphi rounds were conducted independently by each panellist via an emailed survey link (Lime-Survey). Survey responses were anonymized before centralized review. Each statement was independently rated on a 7-point Likert scale from “Definitely should not include” to “Definitely should include” in the MHP, with cut-offs based on previously established Delphi criteria.20 There was an “opt out” option for each statement to account for possible lack of expertise in a specific area (“Unable to rate as outside area of expertise”). Panellists were asked to provide suggestions to enhance statement clarity with each numerical ranking. Panellists were instructed to answer questions on the basis of what they considered optimal patient care or best practices, rather than what they believed was currently operationally feasible at their institution. The first round consisted of 43 statements and 8 quality indicators that had been drafted by the steering committee based on available literature and existing MHPs. The statements were based on the core tenets of existing MHPs, such as rapid and reliable access to blood components, tertiary care transfer and use of antifibrinolytic agents, and the quality indicators were based on quality measures established by the National Surgical Quality Improvement Program. The first round was conducted 1 month before the MHP forum. The survey responses of the first round were anonymized and presented to the panellists and the steering committee on day 2 of the MHP forum for discussion of the phrasing and structure of statements scoring below a median Likert score of 5.5 (see a priori criteria below), as the modification to the Delphi methodology. Round 1 provided panellists with the ability to add statements and quality indicators. To ensure nonbiased and independent statement review, panellists were not provided the ratings and survey comments of the other panel members. After round 1, no further inperson meetings or formal interactions between panellists took place. ### Criteria for disposition of items A priori criteria for disposition of the items in the first round were established as follows: 1. Items receiving a median Likert score of at least 5.5 (out of 7) would be accepted as written and not subject to further rounds. These statements were to be incorporated into a provincial MHP as written, unless a clear improvement in phrasing was suggested by a panellist that would not change the intent of the item. 2. Items with a median score of 2.6 to 5.4 were to be discussed at the in-person meeting with all the panellists. Following discussion, the items would be revised by the steering committee and sent out electronically in the second round. 3. Items with a median score of 2.5 or less were to be removed from further rounds, unless there was strong opposition by the panel, in which case a revision would be drafted for the second round. 4. Panellists were provided with a comment box to allow for addition of novel statements and quality indicators on the first round and were allowed to suggest additional statements and quality indicators at the in-person meeting. No additional statements were added after round 2. A priori criteria for disposition of the items in the second or later round were established as follows: 1. Items receiving a median Likert score of at least 5.5 would be accepted as written and not subject to further rounds, unless a clear improvement in phrasing was suggested by a panellist that would not change the intent of the item. 2. Items with a median score of 2.5 to 5.4 were to be rewritten on the basis of comments by the panellists and sent out in the third or subsequent round. 3. Items with a median score of 2.4 or less were to be removed from further rounds of scoring. 4. Where suggested by panellists and/or the steering committee, merging or division of statements could occur where appropriate. After consensus was reached in the final Delphi round, the statements were circulated via email to the medical directors of transfusion medicine responsible for 150 of the 262 Ontario hospitals with licensed transfusion laboratories. The accompanying letter included a request to distribute the statements to members of their hospital transfusion committees and MHP leaders for feedback. These 304 people represented the clinical and technical leads of the laboratories. All hospitals in Ontario able to issue red blood cells have a medical director who is registered with the provincial Ministry of Health and Long-Term Care, which provided us with an up-to-date email contact list. Feedback was collated and recommendations were incorporated by the steering committee where necessary to improve the clarity of the statements and their justification. The initial drafting of the consensus statements was completed by March 2018. Round 1 of the consensus panel was completed on Apr. 13, 2018, and was discussed in person on Apr. 21, 2018 in the MHP forum. Rounds 2 and 3 were subsequently completed in June 2018 and August 2018, respectively. ### Ethics approval Ethics approval was not required for this Delphi exercise. ## Results Of the 44 experts invited to participate, 36 agreed (Appendix 1, available at [www.cmajopen.ca/content/7/3/E546/suppl/DC1](http://www.cmajopen.ca/content/7/3/E546/suppl/DC1)). A 100% response rate was achieved from panellists in all 3 rounds of the modified Delphi exercise. The progression toward consensus based on Likert scores is shown in Figure 1, and the overall degree of consensus for each statement by the last round is shown in Figure 2. Consensus was achieved for all statements by round 3, yielding a final consensus document with 42 statements and 8 quality indicators. Owing to lack of consensus on round 1, statements 7, 22, 23 and 34 were broken into their individual components for rounds 2 and 3 to assist with understanding the components driving the lack of consensus (Figure 1). Unless otherwise specified, all statements and quality metrics also apply to a pediatric MHP. The statements together with a brief rationale for each are presented in Table 1, in a logical order rather than in order of clinical importance. ![Figure 1:](http://www.cmajopen.ca/https://www.cmajopen.ca/content/cmajo/7/3/E546/F1.medium.gif) [Figure 1:](http://www.cmajopen.ca/content/7/3/E546/F1) Figure 1: Median scores on a 7-point Likert scale for the 3 rounds of the Delphi exercise. Counts are provided for cases in which panellists were asked to rank or choose between options rather than use the Likert scale. Green = passed with minor or no phrasing adjustment (empty green box = passed on a preceding round); red = statements that did not pass based on numerical scoring and/or critical written comments, resulting in a major content revision; gray = statements that were not accepted and were then merged for the subsequent round; blue = a new statement that was added after round 1. Split rows denote the need for division of the statement into its components for the scoring round. Note: CBC = complete blood count, iCalcium = ionized calcium, INR = international normalized ratio, NA = not applicable, aPTT = activated partial thromboplastin time. ![Figure 2:](http://www.cmajopen.ca/https://www.cmajopen.ca/content/cmajo/7/3/E546/F2.medium.gif) [Figure 2:](http://www.cmajopen.ca/content/7/3/E546/F2) Figure 2: Proportion of Likert scores at the time of the final consensus round for each statement. Panellists were asked to indicate agreement on a 7-point Likert scale (7 = highest level of agreement). Black and gray = scores less than 5; green shades = scores of 5 or more. Responses of “no,” “uncertain” and “yes” are denoted as black, gray and green, respectively. View this table: [Table 1:](http://www.cmajopen.ca/content/7/3/E546/T1) Table 1: Massive hemorrhage protocol statements and rationale Box 1: ### **Quality metrics to be tracked on all activations of the protocol** | Quality metric | Local reporting | Provincial reporting | |:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | --------------- | -------------------- | | Q1. Proportion of patients receiving tranexamic acid within 1 h of protocol activation | X | X | | Q2. Proportion of patients in whom RBC transfusion is initiated within 15 min of protocol activation | X | X | | Q3. Proportion of patients (of patients requiring transfer for definitive care) with initiation of call for transfer within 60 min of protocol activation | X | | | Q4. Proportion of patients achieving temperature ≥ 35°C at termination of the protocol | X | | | Q5. Proportion of patients with hemoglobin levels maintained between 60 and 110 g/L during protocol activation, excluding certain pediatric populations (e.g., neonates) that may require higher hemoglobin values | X | | | Q6. Proportion of patients transitioned to group-specific red blood cells and plasma within 90 min of arrival/onset of hemorrhage | X | X | | Q7. Proportion of patients with appropriate activation (≥ 6 RBC units in first 24 h, > 40 mL/kg per 24 h of RBCs in pediatric patients) or before this level in patients dying due to hemorrhage within 24 h | X | | | Q8. Proportion of patients without any blood component wastage (including plasma that is thawed and not used within the 5-day limit on another patient) | X | | Four areas required additional rounds and major modifications: 1) selection of the name of the protocol, 2) selection of the laboratory resuscitation targets, 3) determination of the pack configurations and 4) clarification of the role of recombinant factor VIIa. The primary obstacle to selecting a name for the protocol was that many hospitals already had long-standing MHPs with specific names. Consensus on the laboratory targets and pack configuration was achieved in the third round by splitting statements into subsections. The recombinant factor VIIa statement required 3 rounds of review to ensure that the phrasing mitigated the panellists’ apprehensions regarding this controversial therapy. Following the generation of consensus statements, no substantive changes to the statements were made, but modifications were required to clarify the supporting text. The external review by the medical directors of transfusion did not necessitate changes to the statements; however, the feedback provided valuable input to strengthen the supporting text and provide input on logistical and implementation challenges. All statements and the contents of the manuscript were approved by all authors and panellists. ## Interpretation Through a modified Delphi iterative process, we selected and refined 42 statements and 8 quality indicators to form the foundation for the proposed provincial standardized, evidence-based MHP template for hospitals. The MHP toolkit will include training material, simulation exercises, checklists, template policies and procedures, and patient material. In addition to decreasing variability in care, reducing cognitive load on providers, improving communication between the clinical and laboratory teams, increasing uptake of evidence-based treatments and ultimately improving patient outcomes, we hope that this initiative will improve patient comfort and safety, communication with families and disclosure of transfusion risks to patients. Although the lists of statements are not exhaustive, we hope that they address the current widespread variability in MHP structure.14,15 Both the modified Delphi process and the external stakeholder consultation assisted with statement construction to ensure clarity for both experts in transfusion medicine and health care personnel working outside of the laboratory. This consensus document created by the modified Delphi method is a powerful tool that is broadly applicable and adaptable to many hospital settings. The consensus panel included excellent representation by resource-limited and geographically constrained sites in rural Ontario, as well as resource-rich tertiary care centres. As a result, the recommendations reflect best practice but are also flexible, as they include modifiers for clinical environments with fewer team members and limited access to laboratory testing and blood product availability. For example, the MHP recommends that centres without the ability for definitive hemorrhage control call for early transport (statements 1 and 10), facilities where certain blood components are limited are offered alternatives (statement 34), and there is dosage modification for the initial antifibrinolytic agent for patients in remote locations to ensure administration of a timely and complete dose (statement 40). In comparison, a recent survey of hospitals with MHPs in the United States showed that the majority were in large academic centres, calling for a higher ratio of plasma:red blood cells (1:1), with very few unified MHPs in place to encompass nontrauma indications.101 The Delphi technique was chosen as the method to develop consensus statements from expert stakeholders because of the absence of clinical trial evidence for all aspects of the management of the massively bleeding patient.102 Although clinical trials provide considerable guidance on the utility of blood component ratios,80 antifibrinolytic agents,93,94 use of recombinant factor VIIa84,85 and other areas of management, they fail to provide recommendations on how to construct the protocol, modifications for community hospitals or specific patient populations.9,12,26 We modified the Delphi exercise to allow for an open forum after round 1 to increase input from experienced practitioners and to discuss the vast quantity of available literature to ensure that all participants had a foundation in MHP knowledge. This allowed for the broadest capture of areas of massive hemorrhage that are logistical in nature and do not lend themselves to evaluation in clinical trials, such as communication strategies and procedures, protocol nomenclature, frequency and type of laboratory testing, laboratory resuscitation targets, and blood component transport and bedside storage.26 Importantly, modification of the Delphi exercise also allowed the invaluable input of a patient representative, who provided insight into the importance of patient-related outcomes such as communication and hypothermia management to ensure comfort. ### Limitations The major limitations and challenges of our modified Delphi process included the limited number of panellists per specialty and hospital type (e.g., obstetrics, remote hospitals) owing to cost and logistical limitations. Furthermore, 1 panellist ranked the statements based on feasibility and/or cost of recommendations despite instructions to rank based on best practices; however, later in round 1, the panellist reranked based on best practices. Another limitation was the failure to include panellists involved in hospital blood/sample transportation and communications, as these colleagues are critically important to the success of the MHP (e.g., ensuring a constant supply of blood packs from the bank). Given the numerous items lacking clinical trial evidence, our recommendations will need to be revisited and updated at regular intervals to evolve with this rapidly changing field of medicine. We note a particular lack of high-quality evidence for pediatric patients owing to exclusion of these patients from many clinical trials. ### Conclusion We are confident that the 42 statements and 8 quality indicators, constructed through a highly structured process and with the involvement of a diverse and knowledgeable group of experts, will serve as a strong foundation for the creation of a robust MHP toolkit. The MHP toolkit, currently under development, will consist of recommendations and educational resources for 12 sections (patient transport; principals of damage control resuscitation; team dynamics; communication; laboratory testing; temperature management; use of blood components and adjuncts, including anticoagulant reversal; simulation and training tools; pediatric-specific recommendations; patient communication follow-up tools; research goals; and quality metrics and reporting) written by an expert working group, to be published and freely accessible in the spring of 2020 on the Ontario Regional Blood Coordinating Network website ([http://transfusionontario.org/en/](http://transfusionontario.org/en/)) and presented at the network’s spring Transfusion Committee Forum. We expect that, with the use of the toolkit, hospitals will achieve higher adoption of evidence-based care of the patient with massive hemorrhage, improved speed of delivery of blood components and hemostatic adjuncts, and more diligent monitoring of clinical and laboratory parameters. There is an opportunity to track patient outcomes in existing prospectively collected databases in trauma and obstetrics and for inpatients held by the Canadian Institutes for Health Information in Ontario to understand the impact of this effort to standardize the care of these complex, high-acuity patients. ## Footnotes * **Competing interests:** For panellists and conflicts of interest, see Appendix 1 (available at [www.cmajopen.ca/content/7/3/E546/suppl/DC1](http://www.cmajopen.ca/content/7/3/E546/suppl/DC1)). * This article has been peer reviewed. * **Contributors:** All of the steering committee members contributed to the study design and data analysis and interpretation, drafted the manuscript and critically revised it for important intellectual content. All of the panel members contributed to data interpretation, drafted the manuscript and critically revised it for important intellectual content. All of the authors approved the final version to be published and agreed to act as guarantors of the work. * **Funding:** This work was supported by the Ontario Regional Blood Coordinating Network through the Ontario Ministry of Health and Long-Term Care and Canadian Blood Services. * **Supplemental information:** For reviewer comments and the original submission of this manuscript, please see [www.cmajopen.ca/content/7/3/E546/suppl/DC1](http://www.cmajopen.ca/content/7/3/E546/suppl/DC1). ## References 1. Harvin JA, Maxim T, Inaba K, et al. (2017) Mortality after emergent trauma laparotomy: a multicenter, retrospective study. J Trauma Acute Care Surg 83:464–8. 2. Creanga AA, Syverson C, Seed K, et al. (2017) Pregnancy-related mortality in the United States, 2011–2013. Obstet Gynecol 130:366–73. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/AOG.0000000000002114&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=28697109&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 3. Farooq N, Galiatsatos P, Aulakh JK, et al. (2018) Massive transfusion practice in non-trauma related hemorrhagic shock. J Crit Care 43:65–9. 4. Spinella PC (2017) Zero preventable deaths after traumatic injury: an achievable goal. J Trauma Acute Care Surg 82:S2–8. 5. Tien HC, Spencer F, Tremblay LN, et al. (2007) Preventable deaths from hemorrhage at a level I Canadian trauma center. J Trauma 62:142–6. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/01.ta.0000251558.38388.47&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=17215745&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000243490100027&link_type=ISI) 6. Deneux-Tharaux C, Saucedo M (2017) Epidemiology of maternal mortality in France, 2010–2012 [article in French]. Gynecol Obstet Fertil Senol 45:S8–21. 7. Berg CJ, Harper MA, Atkinson SM, et al. (2005) Preventability of pregnancy-related deaths: results of a state-wide review. Obstet Gynecol 106:1228–34. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/01.AOG.0000187894.71913.e8&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=16319245&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000233695200003&link_type=ISI) 8. Young PP, Cotton BA, Goodnough LT (2011) Massive transfusion protocols for patients with substantial hemorrhage. Transfus Med Rev 25:293–303. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/j.tmrv.2011.04.002&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=21664104&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 9. Milligan C, Higginson I, Smith JE (2011) Emergency department staff knowledge of massive transfusion for trauma: the need for an evidence-based protocol. Emerg Med J 28:870–2. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZW1lcm1lZCI7czo1OiJyZXNpZCI7czo5OiIyOC8xMC84NzAiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzcvMy9FNTQ2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 10. Khan S, Allard S, Weaver A, et al. (2013) A major haemorrhage protocol improves the delivery of blood component therapy and reduces waste in trauma massive transfusion. Injury 44:587–92. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/j.injury.2012.09.029&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=23127727&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 11. Nunez TC, Young PP, Holcomb JB, et al. (2010) Creation, implementation, and maturation of a massive transfusion protocol for the exsanguinating trauma patient. J Trauma 68:1498–505. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/TA.0b013e3181d3cc25&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=20539192&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 12. Cotton BA, Dossett LA, Au BK, et al. (2009) Room for (performance) improvement: provider-related factors associated with poor outcomes in massive transfusion. J Trauma 67:1004–12. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/TA.0b013e3181bcb2a8&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=19901661&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 13. Treml AB, Gorlin JB, Dutton RP, et al. (2017) Massive transfusion protocols: a survey of academic medical centers in the United States. Anesth Analg 124:277–81. 14. Chin V, Cope S, Yeh CH, et al. (2019) Massive hemorrhage protocol survey: marked variability and absent in one-third of hospitals in Ontario, Canada. Injury 50:46–53. 15. Etchill E, Sperry J, Zuckerbraun B, et al. (2016) The confusion continues: results from an American Association for the Surgery of Trauma survey on massive transfusion practices among United States trauma centers. Transfusion 56:2478–86. 16. Bawazeer M, Ahmed N, Izadi H, et al. (2015) Compliance with a massive transfusion protocol (MTP) impacts patient outcome. Injury 46:21–8. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/j.injury.2014.09.020&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=25452004&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 17. Cannon JW, Khan MA, Raja AS, et al. (2017) Damage control resuscitation in patients with severe traumatic hemorrhage: a practice management guideline from the Eastern Association for the Surgery of Trauma. J Trauma Acute Care Surg 82:605–17. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 18. Boulkedid R, Abdoul H, Loustau M, et al. (2011) Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One 6:e20476. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1371/journal.pone.0020476&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=21694759&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 19. Jünger S, Payne SA, Brine J, et al. (2017) Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med 31:684–706. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 20. Meyer E, Delaney M, Lin Y, et al. (2013) A reporting guideline for clinical platelet transfusion studies from the BEST Collaborative. Transfusion 53:1328–34. 21. Humphrey-Murto S, Varpio L, Gonsalves C, et al. (2017) Using consensus group methods such as Delphi and Nominal Group in medical education research. Med Teach 39:14–9. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=27841062&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 22. Benz D, Balogh ZJ (2017) Damage control surgery: current state and future directions. Curr Opin Crit Care 23:491–7. 23. Germanos S, Gourgiotis S, Villias C, et al. (2008) Damage control surgery in the abdomen: an approach for the management of severe injured patients. Int J Surg 6:246–52. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/j.ijsu.2007.05.003&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=17574943&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 24. Rossaint R, Bouillon B, Cerny V, et al. (2016) The European guideline on management of major bleeding and coagulopathy following trauma: fourth edition. Crit Care 20:100. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/s13054-016-1265-x&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=27072503&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 25. Khan S, Davenport R, Raza I, et al. (2015) Damage control resuscitation using blood component therapy in standard doses has a limited effect on coagulopathy during trauma hemorrhage. Intensive Care Med 41:239–47. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1007/s00134-014-3584-1&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=25447807&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 26. Etchill EW, Myers SP, McDaniel LM, et al. (2017) Should all massively transfused patients be treated equally? An analysis of massive transfusion ratios in the nontrauma setting. Crit Care Med 45:1311–6. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 27. Teixeira PG, Inaba K, Karamanos E, et al. (2017) The survival impact of plasma to red blood cell ratio in massively transfused non-trauma patients. Eur J Trauma Emerg Surg 43:393–8. 28. Gorlin JB, Peters J, Van Buren N, et al. (2017) The confusion continues: evolving nature of massive transfusion protocol practice may reflect lack of evidence to support a single solution that fits all. Transfusion 57:1322–4. 29. Plackett TP, Cherry DC, Delk G, et al. (2017) Clinical practice guideline adherence during Operation Inherent Resolve. J Trauma Acute Care Surg 83:S66–70. 30. Gillissen A, van den Akker T, Caram-Deelder C, et al. (2018) Coagulation parameters during the course of severe postpartum hemorrhage: a nationwide retrospective cohort study. Blood Adv 2:2433–42. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYmxvb2RvYSI7czo1OiJyZXNpZCI7czo5OiIyLzE5LzI0MzMiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzcvMy9FNTQ2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 31. Revert M, Rozenberg P, Cottenet J, et al. (2018) Intrauterine balloon tamponade for severe postpartum hemorrhage. Obstet Gynecol 131:143–9. 32. Jairath V, Kahan BC, Logan RF, et al. (2012) Outcomes following acute nonvariceal upper gastrointestinal bleeding in relation to time to endoscopy: results from a nationwide study. Endoscopy 44:723–30. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1055/s-0032-1309736&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=22752889&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 33. Shemesh E, Czerniak A, Klein E, et al. (1990) A comparison between emergency and delayed endoscopic injection sclerotherapy of bleeding esophageal varices in nonalcoholic portal hypertension. J Clin Gastroenterol 12:5–9. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=2303688&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=A1990CL49100003&link_type=ISI) 34. Karkouti K, Callum J, Wijeysundera DN, et al. (2016) Point-of-care hemostatic testing in cardiac surgery: a stepped-wedge clustered randomized controlled trial. Circulation 134:1152–62. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6ImNpcmN1bGF0aW9uYWhhIjtzOjU6InJlc2lkIjtzOjExOiIxMzQvMTYvMTE1MiI7czo0OiJhdG9tIjtzOjIwOiIvY21ham8vNy8zL0U1NDYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 35. Lee AC, Reduque LL, Luban NL, et al. (2014) Transfusion-associated hyperkalemic cardiac arrest in pediatric patients receiving massive transfusion. Transfusion 54:244–54. 36. Girelli G, Antoncecchi S, Casadei AM, et al. (2015) Recommendations for transfusion therapy in neonatology. Blood Transfus 13:484–97. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 37. Muszynski JA, Reeder RW, Hall MW, et al. (2018) RBC transfusion practice in pediatric extracorporeal membrane oxygenation support. Crit Care Med 46:e552–9. 38. Howarth C, Banerjee J, Aladangady N (2018) Red blood cell transfusion in preterm infants: current evidence and controversies. Neonatology 114:7–16. 39. Hilton G, Daniels K, Goldhaber-Fiebert SN, et al. (2016) Checklists and multidisciplinary team performance during simulated obstetric hemorrhage. Int J Obstet Anesth 25:9–16. 40. Delaney M, Roberts J, Mazor R, et al. (2018) Bleeding emergencies in neonatal and paediatric patients: improving the quality of care using simulation. Transfus Med 28:405–12. 41. Kamerer JL (2012) Massive transfusion protocol simulation: compound femur fracture and hypovolemic shock. Simul Healthc 7:196–200. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=21937961&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 42. Brydges R, Hatala R, Zendejas B, et al. (2015) Linking simulation-based educational assessments and patient-related outcomes: a systematic review and meta-analysis. Acad Med 90:246–56. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/ACM.0000000000000549&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=25374041&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 43. Gjeraa K, Moller TP, Ostergaard D (2014) Efficacy of simulation-based trauma team training of non-technical skills. A systematic review. Acta Anaesthesiol Scand 58:775–87. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1111/aas.12336&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=24828210&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000339718500002&link_type=ISI) 44. Murphy M, Curtis K, Lam MK, et al. (2018) Simulation-based multidisciplinary team training decreases time to critical operations for trauma patients. Injury 49:953–8. 45. Josey K, Smith ML, Kayani AS, et al. (2018) Hospitals with more-active participation in conducting standardized in-situ mock codes have improved survival after in-hospital cardiopulmonary arrest. Resuscitation 133:47–52. 46. Maddry JK, Perez CA, Mora AG, et al. (2018) Impact of prehospital medical evacuation (MEDEVAC) transport time on combat mortality in patients with non-compressible torso injury and traumatic amputations: a retrospective study. Mil Med Res 5:22. 47. Meyer DE, Vincent LE, Fox EE, et al. (2017) Every minute counts: time to delivery of initial massive transfusion cooler and its impact on mortality. J Trauma Acute Care Surg 83:19–24. 48. Acker SN, Bredbeck B, Partrick DA, et al. (2017) Shock index, pediatric age-adjusted (SIPA) is more accurate than age-adjusted hypotension for trauma team activation. Surgery 161:803–7. 49. Schroll R, Swift D, Tatum D, et al. (2018) Accuracy of Shock Index versus ABC score to predict need for massive transfusion in trauma patients. Injury 49:15–9. 50. Meyer DE, Cotton BA, Fox EE, et al. (2018) A comparison of resuscitation intensity and critical administration threshold in predicting early mortality among bleeding patients: a multicenter validation in 680 major transfusion patients. J Trauma Acute Care Surg 85:691–6. 51. Neff LP, Cannon JW, Morrison JJ, et al. (2015) Clearly defining pediatric massive transfusion: cutting through the fog and friction with combat data. J Trauma Acute Care Surg 78:22–8, discussion 8–9. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=25539199&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 52. Foster JC, Sappenfield JW, Smith RS, et al. (2017) Initiation and termination of massive transfusion protocols: current strategies and future prospects. Anesth Analg 125:2045–55. 53. Briggs A, Raja AS, Joyce MF, et al. (2015) The role of nontechnical skills in simulated trauma resuscitation. J Surg Educ 72:732–9. 54. McLaughlin CM, Wieck MM, Barin EN, et al. (2018) Impact of simulation-based training on perceived provider confidence in acute multidisciplinary pediatric trauma resuscitation. Pediatr Surg Int 34:1353–62. 55. Gregg SC, Heffernan DS, Connolly MD, et al. (2016) Teaching leadership in trauma resuscitation: immediate feedback from a real-time, competency-based evaluation tool shows long-term improvement in resident performance. J Trauma Acute Care Surg 81:729–34. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 56. Khan S, Brohi K, Chana M, et al. (2014) Hemostatic resuscitation is neither hemostatic nor resuscitative in trauma hemorrhage. J Trauma Acute Care Surg 76:561–7, discussion 7–8. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=24553520&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 57. Johnsen BH, Westli HK, Espevik R, et al. (2017) High-performing trauma teams: frequency of behavioral markers of a shared mental model displayed by team leaders and quality of medical performance. Scand J Trauma Resusc Emerg Med 25:109. 58. Graw JA, Eymann K, Kork F, et al. (2018) Risk perception of blood transfusions — a comparison of patients and allied healthcare professionals. BMC Health Serv Res 18:122. 59. Schonewille H, Honohan A, van der Watering LM, et al. (2016) Incidence of alloantibody formation after ABO-D or extended matched red blood cell transfusions: a randomized trial (MATCH study). Transfusion 56:311–20. 60. Barty RL, Pai M, Liu Y, et al. (2017) Group O RBCs: Where is universal donor blood being used? Vox Sang 112:336–42. 61. Zeller MP, Barty R, Dunbar NM, et al. (2018) An international investigation into AB plasma administration in hospitals: How many AB plasma units were infused? The HABSWIN study. Transfusion 58:151–7. 62. Valentine J, Lane T, Miller N, et al. (2013) Two transfusion-related acute lung injury episodes in a recipient of AB plasma from multiparous donors. Ther Apher Dial 17:640–2. 63. Brohi K, Singh J, Heron M, et al. (2003) Acute traumatic coagulopathy. J Trauma 54:1127–30. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/01.TA.0000069184.82147.06&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=12813333&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000183727400019&link_type=ISI) 64. Chandler WL, Ferrell C, Trimble S, et al. (2010) Development of a rapid emergency hemorrhage panel. Transfusion 50:2547–52. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1111/j.1537-2995.2010.02753.x&link_type=DOI) 65. Baxter J, Cranfield KR, Clark G, et al. (2016) Do lactate levels in the emergency department predict outcome in adult trauma patients? A systematic review. J Trauma Acute Care Surg 81:555–66. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 66. Bouzat P, Ageron FX, Charbit J, et al. (2018) Modelling the association between fibrinogen concentration on admission and mortality in patients with massive transfusion after severe trauma: an analysis of a large regional database. Scand J Trauma Resusc Emerg Med 26:55. 67. Alam A, Olarte R, Callum J, et al. (2018) Hypothermia indices among severely injured trauma patients undergoing urgent surgery: a single-centred retrospective quality review and analysis. Injury 49:117–23. 68. Margarido C, Ferns J, Chin V, et al. (2019) Massive hemorrhage protocol activation in obstetrics: a 5-year quality performance review. Int J Obstet Anesth 38:37–45. 69. Jurkovich GJ, Greiser WB, Luterman A, et al. (1987) Hypothermia in trauma victims: an ominous predictor of survival. J Trauma 27:1019–24. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/00005373-198709000-00011&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=3656464&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=A1987K262100011&link_type=ISI) 70. Lester ELW, Fox EE, Holcomb JB, et al. (2019) The impact of hypothermia on outcomes in massively transfused patients. J Trauma Acute Care Surg 86:458–63. 71. Perlman R, Callum J, Laflamme C, et al. (2016) A recommended early goal-directed management guideline for the prevention of hypothermia-related transfusion, morbidity, and mortality in severely injured trauma patients. Crit Care 20:107. 72. Rajagopalan S, Mascha E, Na J, et al. (2008) The effects of mild perioperative hypothermia on blood loss and transfusion requirement. Anesthesiology 108:71–7. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/01.anes.0000296719.73450.52&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=18156884&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000251905400012&link_type=ISI) 73. Lundgren P, Henriksson O, Naredi P, et al. (2011) The effect of active warming in prehospital trauma care during road and air ambulance transportation — a clinical randomized trial. Scand J Trauma Resusc Emerg Med 19:59. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/1757-7241-19-59&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=22017799&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 74. Fadeyi EA, Emery W, Simmons JH, et al. (2017) Implementation of a new blood cooler insert and tracking technology with educational initiatives and its effect on reducing red blood cell wastage. Transfusion 57:2477–82. 75. Metcalf RA, Baker SA, Goodnough LT, et al. (2016) Transportation cooler interventions reduce plasma and RBC product wastage. Am J Clin Pathol 146:18–24. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1093/ajcp/aqw082&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=27357292&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 76. Gonzalez-Porras JR, Graciani IF, Perez-Simon JA, et al. (2008) Prospective evaluation of a transfusion policy of D+ red blood cells into D− patients. Transfusion 48:1318–24. 77. Yazer MH, Triulzi DJ (2007) Detection of anti-D in D− recipients transfused with D+ red blood cells. Transfusion 47:2197–201. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1111/j.1537-2995.2007.01446.x&link_type=DOI) 78. Bhella S, Gerard L, Lin Y, et al. (2012) Obstetric and trauma database review at a single institution finds the optimal maternal age restriction for the transfusion of O− blood to women involved in trauma to be 45 years. Transfusion 52:2488–9. 79. Cid J, Lozano M, Ziman A, et al. (2015) Low frequency of anti-D alloimmunization following D+ platelet transfusion: the Anti-D Alloimmunization after D-incompatible Platelet Transfusions (ADAPT) study. Br J Haematol 168:598–603. 80. Holcomb JB, Tilley BC, Baraniuk S, et al. (2015) Transfusion of plasma, platelets, and red blood cells in a 1:1:1 vs a 1:1:2 ratio and mortality in patients with severe trauma: the PROPPR randomized clinical trial. JAMA 313:471–82. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1001/jama.2015.12&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=25647203&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 81. Nascimento B, Callum J, Tien H, et al. (2013) Effect of a fixed-ratio (1:1:1) transfusion protocol versus laboratory-results–guided transfusion in patients with severe trauma: a randomized feasibility trial. CMAJ 185:E583–9. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMToiMTg1LzEyL0U1ODMiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzcvMy9FNTQ2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 82. Mesar T, Larentzakis A, Dzik W, et al. (2017) Association between ratio of fresh frozen plasma to red blood cells during massive transfusion and survival among patients without traumatic injury. JAMA Surg 152:574–80. 83. Dzik WH, Blajchman MA, Fergusson D, et al. (2011) Clinical review: Canadian National Advisory Committee on Blood and Blood Products — Massive Transfusion Consensus Conference 2011: report of the panel. Crit Care 15:242. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/cc10498&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=22188866&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 84. Simpson E, Lin Y, Stanworth S, et al. (2012) Recombinant factor VIIa for the prevention and treatment of bleeding in patients without haemophilia. Cochrane Database Syst Rev 3:CD005011. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=22419303&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 85. Ranucci M, Isgro G, Soro G, et al. (2008) Efficacy and safety of recombinant activated factor VII in major surgical procedures: systematic review and meta-analysis of randomized clinical trials. [discussion]. Arch Surg 143:296–304. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1001/archsurg.2007.66&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=18347278&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000253904800021&link_type=ISI) 86. Karkouti K, Callum J, Rao V, et al. (2018) Protocol for a phase III, non-inferiority, randomised comparison of a new fibrinogen concentrate versus cryoprecipitate for treating acquired hypofibrinogenaemia in bleeding cardiac surgical patients: the FIBRES trial. BMJ Open 8:e020741. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiOC80L2UwMjA3NDEiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzcvMy9FNTQ2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 87. Galas FR, de Almeida JP, Fukushima JT, et al. (2014) Hemostatic effects of fibrinogen concentrate compared with cryoprecipitate in children after cardiac surgery: a randomized pilot trial. J Thorac Cardiovasc Surg 148:1647–55. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/j.jtcvs.2014.04.029&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=24951020&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 88. Schöchl H, Nienaber U, Maegele M, et al. (2011) Transfusion in trauma: thromboelastometry-guided coagulation factor concentrate-based therapy versus standard fresh frozen plasma-based therapy. Crit Care 15:R83. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/cc10078&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=21375741&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 89. Schlimp CJ, Voelckel W, Inaba K, et al. (2013) Impact of fibrinogen concentrate alone or with prothrombin complex concentrate (+/− fresh frozen plasma) on plasma fibrinogen level and fibrin-based clot strength (FIBTEM) in major trauma: a retrospective study. Scand J Trauma Resusc Emerg Med 21:74. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/1757-7241-21-74&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=24103457&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 90. Noga T, Bruce AA, Blain H, et al. (2016) Four-factor prothrombin complex concentrates in paediatric patients — a retrospective case series. Vox Sang 110:253–7. 91. Maskens C, Downie H, Wendt A, et al. (2014) Hospital-based transfusion error tracking from 2005 to 2010: identifying the key errors threatening patient transfusion safety. Transfusion 54:66–73, quiz 65. 92. Strauss R, Downie H, Wilson A, et al. (2018) Sample collection and sample handling errors submitted to the transfusion error surveillance system, 2006 to 2015. Transfusion 58:1697–707. 93. CRASH-2 Trial Collaborators, Shakur H, Roberts I, Bautista R, et al. (2010) Effects of tranexamic acid on death, vascular occlusive events, and blood transfusion in trauma patients with significant haemorrhage (CRASH-2): a randomised, placebo-controlled trial. Lancet 376:23–32. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/S0140-6736(10)60835-5&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=20554319&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000279841600021&link_type=ISI) 94. Woman Trial Collaborators (2017) Effect of early tranexamic acid administration on mortality, hysterectomy, and other morbidities in women with post-partum haemorrhage (WOMAN): an international, randomised, double-blind, placebo-controlled trial. Lancet 389:2105–16. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/S0140-6736(17)30638-4&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=28456509&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 95. Gayet-Ageron A, Prieto-Merino D, Ker K, et al. (2018) Effect of treatment delay on the effectiveness and safety of antifibrinolytics in acute severe haemorrhage: a meta-analysis of individual patient-level data from 40 138 bleeding patients. Lancet 391:125–32. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/S0140-6736(17)32455-8&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=29126600&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 96. Roberts I, Shakur H, Coats T, et al. (2013) The CRASH-2 trial: a randomised controlled trial and economic evaluation of the effects of tranexamic acid on death, vascular occlusive events and transfusion requirement in bleeding trauma patients. Health Technol Assess 17:1–79. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.3310/hta17370&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=23972041&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000317180500001&link_type=ISI) 97. Morrison JJ, Dubose JJ, Rasmussen TE, et al. (2012) Military Application of Tranexamic Acid in Trauma Emergency Resuscitation (MATTERs) Study. Arch Surg 147:113–9. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1001/archsurg.2011.287&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=22006852&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000300524500005&link_type=ISI) 98. Beno S, Ackery AD, Callum J, et al. (2014) Tranexamic acid in pediatric trauma: Why not? Crit Care 18:313. 99. Nishijima DK, Monuteaux MC, Faraoni D, et al. (2016) Tranexamic acid use in United States children’s hospitals. J Emerg Med 50:868–74.e1. 100.Roberts I, Coats T, Edwards P, et al. (2014) HALT-IT — tranexamic acid for the treatment of gastrointestinal bleeding: study protocol for a randomised controlled trial. Trials 15:450. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/1745-6215-15-450&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=25409738&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) 101.Chang R, Holcomb JB (2017) Implementation of massive transfusion protocols in the United States: the relationship between evidence and practice. Anesth Analg 124:9–11. 102.Humphrey-Murto S, Varpio L, Wood TJ, et al. (2017) The use of the Delphi and other consensus group methods in medical education research: a review. Acad Med 92:1491–8. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/ACM.0000000000001812&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=28678098&link_type=MED&atom=%2Fcmajo%2F7%2F3%2FE546.atom) * Copyright 2019, Joule Inc. or its licensors