National research guideline for prehospital emergency medical care ================================================================== * Abdulrhman S. Alghamdi * Ahmed M. Alotaibi * Khaled J. Alshammari * Abdulrahman J. Alharbi * Rayyan S. Alrabiah * Abdulmohsen Y. Hadadi * Mohammed M. Albloushi * Abdullah A. Alabdali ## A prospective Delphi-study ## Abstract **Objectives:** To identify the most important research topics to establish a national research agenda and protocol for prehospital research in Saudi Arabia (KSA). **Methods:** A 3-round modified Delphi consensus methods were used to determine high-priority research topics. Round I included an open-ended question to list all high-priority research topics in a prehospital setting in Riyadh, KSA. Rounds II and III included ranking evaluation and consensus agreement. The included topics were listed based on the agreement of ≥70% of the experts participating in the study. The study was carried out between November 2021 and February 2022. **Results:** In total, 100 prehospital experts in KSA were invited to participate in all 3 rounds. Of these, 47 responded in round I, 34 in round II, and 39 in round III. In round I, participants submitted 278 research topics. After deduplication and sorting, 78 topics were assessed in the other 2 rounds. **Conclusion:** In this modified Delphi study, an expert panel identified the top prehospital emergency medical services (EMS) care research priorities. The leading research priorities included clinical and operational ideas. The proposed 32 high-priority topics can be used to guide researchers, research networks, policymakers, and funding organizations involved in EMS. Keywords: * emergency medical service * research * Saudi Arabia **T**he quality of prehospital emergency care for populations can be improved by using emergency medical services (EMS). A number of stakeholders, professionals, and researchers have created prehospital emergency care-related study agendas.1-4 Numerous recent studies have been carried out to examine the priorities for prehospital emergency care research, some of which have focused on specific aspects of prehospital treatment (such as disaster, pediatric, etc.).1-4 To efficiently target research that has the highest potential public health value, the process of establishing research priorities is crucial for researchers in the medical sector.5,6 While there are many ways to prioritize health research, there is no consensus on what constitutes the best approach. Setting health research priorities is essential to efforts to create national health research systems.7 Many researchers in different healthcare fields have adapted and utilized this approach. Several worldwide studies have prioritized prehospital emergency care research. A research agenda is a significant part of research.8 The desirability approach in such a plan is to include a wide range of stakeholders and experts in a structured manner.9-11 Therefore, the main objective of this study was to develop and establish a prehospital emergency setting research guideline with the help of experts in the prehospital care settings in KSA. This will lead to an improvement in research quality in KSA, which, in turn, will enhance health care in the prehospital setting. ## Methods A 3-round modified Delphi survey technique was used to identify research topic consensus among experts in prehospital care settings in Riyadh, KSA. Prehospital care experts were identified based on their involvement in prehospital policy, practice, and research. The modified Delphi methodology is an iterative process of multiple rounds of expert voting to reach a consensus in situations where there is minimal or no evidence and expert opinion is significant.12 The study was carried out between November 2021 and February 2022. In the first round, research topics were generated. In the second round, the topics submitted from the first round were evaluated, and the presence or absence of consensus was determined. In the third round, we verified and validated if consensus existed or not. A predefined consensus threshold was set at ≥70% in both the second and third rounds for either inclusion or exclusion. The study team made use of their prior expertise to approach possible policymakers, specialists, and researchers in prehospital emergency care. The team agreed to nominate participants from different specialties working in various Saudi Arabian organizations. The eligibility criteria were as follows: I) academicians or emergency clinicians with expertise in emergency medicine or prehospital emergency care; II) researchers and experts with work experience of at least 3 years. Participants who did not meet the inclusion criteria were excluded from the study. Prior to the study, an Institutional Review Board approval was obtained from King Abdullah International Medical Research Center, Riyadh, KSA (IRBC/1971/21). The study team identified and invited 100 participants for the 3 rounds. The identified experts were: I) emergency medicine physicians; II) academicians or researchers in prehospital emergency care; III) paramedics; and IV) emergency nurses. Additionally, all experts involved in this study had at least 3 years of experience in either prehospital emergency research or care. Thus, we expected a variation in opinions among the participants based on their clinical experience, research experience, interest, education level, and career level. Finally, no sample size calculation was carried out as Delphi studies rely on reaching a consensus rather than a sample size.13 In addition, all 100 participants were contacted in all 3 rounds. ### Statistical analysis After collating all responses from round I, 2 investigators merged the suggestions that noticeably indicated the same research topic and excluded the responses that were undoubtedly irrelevant to the prehospital setting. In rounds II and III, for each research topic, 3-point Likert scale responses were presented using frequencies and percentages. The threshold for inclusion consensus was identified as ≥70% of participants agreeing on a research topic, while the threshold for exclusion consensus was identified as ≥70% of participants disagreeing on a topic. Microsoft 365 Excel for Mac, version 16.65 (Microsoft, Redmond, WA., USA) was carried out for data analysis. ## Results In round I, 47 (47%) of 100 participants invited through email completed the online survey. Most round I respondents (n=22, 46.8%) were paramedics. Furthermore, most participants (n=15, 31.9%) had 3-5 and 11-15 years of experience (Table 1). In round II, 34 (34%) of the selected participants completed the online survey. Like round I, most of these responders were paramedics (n=20, 58.8%), and most participants had at least 3-5 years of experience (n=13, 38.2%). In round III, 39 (39%) of all selected participants completed the online survey. Most of these responders were paramedics (n=18,46.2%) and most participants had 11-15 years of experience (n=13, 33.3%; Table 1). View this table: [Table 1](http://smj.org.sa/content/43/11/1265/T1) Table 1 - Participants’ demographics. In round I, participants were requested to list all the research topics they felt required investigation. A total of 47 participants provided 287 statements. After deduplication, sorting, and removing irrelevant statements, 78 research topics were eligible for inclusion in round II. In round II, the participants were requested to categorize the 78 topics on a 3-point Likert scale. The results were sorted into high, low, and uncertain priority categories, in which 51 topics were included as they met the inclusion threshold, and none met the threshold for exclusion. The remaining 26 topics met the non-consensus threshold. Moreover, round III included high and uncertain priority (non-consensus) topics for further assessment. Therefore, all 78 topics were included in the final round (round III). In round III, participants were again given the 78 topics from round II (Figure 1). ![Figure 1](http://smj.org.sa/https://smj.org.sa/content/smj/43/11/1265/F1.medium.gif) [Figure 1](http://smj.org.sa/content/43/11/1265/F1) Figure 1 - Flow chart of the study process. In round III, the participants were requested to categorize all 78 topics using a 3-point Likert scale. This resulted in 32 topics meeting the inclusion threshold (Table 2). Additionally, the experts changed their opinion regarding 20 topics that had met the inclusion consensus in round II to non-consensus in this round (Table 3). View this table: [Table 2](http://smj.org.sa/content/43/11/1265/T2) Table 2 - Research priorities met, including criteria from round II and III. View this table: [Table 3](http://smj.org.sa/content/43/11/1265/T3) Table 3 - Research priorities excluded after round III. ## Discussion This study carried out a gap analysis for prehospital research by inviting clinicians, researchers, and experts interested in prehospital emergency care to initiate and determine the top research priorities for prehospital emergency care. A total of 32 research topics met the inclusion threshold (≥70% agreement) and were considered important. Several studies have reported the importance of repeating rounds for consensus studies, allowing participants to reflect on alternate views they may have missed and reconsider their initial responses.14,15 In our study, the significance of repeating the ranking evaluation in round III for all topics that reached the inclusion consensus increased its validity. By doing so, the experts re-ranked all 51 included topics from round II. Only 32 out of 51 topics reached the inclusion consensus. As a result, only high-priority topics were agreed upon by the experts. The ideas developed and prioritized in this study represent a comprehensive list generated by prehospital emergency care stakeholders and experts from various backgrounds and experiences using the Delphi methodology. The results of this study are intended to serve as a guideline for future prehospital research and related funding. Patient care and outcomes were essential components of the high-priority topics in our study. Both were mentioned in the context of observational and interventional research (namely, the effectiveness of prehospital critical care, survival rate following out-of-hospital cardiac arrest, and prehospital pain management). In addition, experts provided several ideas related to system-level research and system benchmarks. Despite the importance of system benchmarks in the process, time, and efficiency of care, the main emphasis of experts’ view was based on ideas related to improving patient’s care and reducing mortality. This reflects the significant effort the study participants placed on designing prehospital research studies to impact patient’s outcomes and save lives. Likewise, several previous health care research priority studies focused on patient care outcomes.16-20 Similarly, international studies have explored prehospital emergency care focusing on patient care outcomes.1-4 ### Study limitations The response rate in round II was relatively low (32%). However, the Delphi study aims to have a good representation of research ideas from the participants rather than getting a high response rate, which was achieved. Despite the extensive list of research topics, the study focus was to determine prehospital research priorities in KSA, so the results of this Delphi study may not apply to other counties. In conclusion, in this modified Delphi study, an expert panel identified the top prehospital EMS care research priorities. The leading research priorities included clinical and operational ideas. The proposed 32 high-priority ideas can be used to guide researchers, research networks, policymakers, and funding organizations involved in EMS. The study’s implication is to determine research priorities which will be provided to the Saudi Research, Development and Innovation Authority, Ministry of Health, Saudi Red Crescent Authority, and research centers to disseminate our results, apprise future prehospital research plans, and prioritize funding. Overall, the results of this study can significantly improve the care and quality of EMS. ## Acknowledgment *The authors gratefully acknowledge Editage (www.editage.com) for English language editing.* ## Footnotes * **Disclosure.** Authors have no conflict of interests, and the work was not supported or funded by any drug company. * Received July 28, 2022. * Accepted October 19, 2022. * Copyright: © Saudi Medical Journal This is an Open Access journal and articles published are distributed under the terms of the Creative Commons Attribution-NonCommercial License (CC BY-NC). Readers may copy, distribute, and display the work for non-commercial purposes with the proper citation of the original work. ## References 1. 1.Richards CT, Fishe JN, Cash RE, Rivard MK, Brown KM, Martin-Gill C, et al. Priorities for prehospital evidence-based guideline development: a modified Delphi analysis. Prehosp Emerg Care 2022; 26: 286–304. 2. 2.van de Glind I, Berben S, Zeegers F, Poppen H, Hoogeveen M, Bolt I, et al. A national research agenda for pre-hospital emergency medical services in the Netherlands: a Delphi-study. Scand J Trauma Resusc Emerg Med 2016; 24: 2. [PubMed](http://smj.org.sa/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) 3. 3.Rosengart MR, Nathens AB, Schiff MA. The identification of criteria to evaluate prehospital trauma care using the Delphi technique. J Trauma 2007; 62: 708–713. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1097/01.ta.0000197150.07714.c2&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=17414352&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) [Web of Science](http://smj.org.sa/lookup/external-ref?access_num=000244877300032&link_type=ISI) 4. 4.Newgard CD, Braverman MA, Phuong J, Shipper ES, Price MA, Bixby PJ, et al. Developing a national trauma research action plan: results from the prehospital and mass casualty research Delphi survey. J Trauma Acute Care Surg 2022; 92: 398–406. 5. 5.Viergever RF, Olifson S, Ghaffar A, Terry RF. A checklist for health research priority setting: nine common themes of good practice. Health Res Policy Syst 2010; 8: 36. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1186/1478-4505-8-36&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=21159163&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) 6. 6.Fleurence RL, Torgerson DJ. Setting priorities for research. Health Policy 2004; 69: 1–10. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1016/j.healthpol.2003.11.002&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=15484602&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) [Web of Science](http://smj.org.sa/lookup/external-ref?access_num=000222297000001&link_type=ISI) 7. 7.Nyanchoka L, Tudur-Smith C, Thu VN, Iversen V, Tricco AC, Porcher R. A scoping review describes methods used to identify, prioritize and display gaps in health research. J Clin Epidemiol 2019; 109: 99–110. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1016/j.jclinepi.2019.01.005&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) 8. 8.Christian S, Anderson S. Review of research needs and priorities 2007. The National Institute for Health Research Service Delivery and Organisation Programme. 2007. 9. 9.Vella K, Goldfrad C, Rowan K, Bion J, Black N. Use of consensus development to establish national research priorities in critical care. BMJ 2000; 320: 976–980. [Abstract/FREE Full Text](http://smj.org.sa/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMjAvNzI0MC85NzYiO3M6NDoiYXRvbSI7czoyMDoiL3Ntai80My8xMS8xMjY1LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 10. 10.Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs 2000; 32: 1008–1015. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1046/j.1365-2648.2000.01567.x&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=11095242&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) [Web of Science](http://smj.org.sa/lookup/external-ref?access_num=000165405100046&link_type=ISI) 11. 11.Jones J, Hunter D. Consensus methods for medical and health services research. BMJ (Clinical research ed) 1995; 311: 376–380. [FREE Full Text](http://smj.org.sa/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMTEvNzAwMS8zNzYiO3M6NDoiYXRvbSI7czoyMDoiL3Ntai80My8xMS8xMjY1LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 12. 12.Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess 1998; 2: i-iv, 1–88. [PubMed](http://smj.org.sa/lookup/external-ref?access_num=9621129&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) 13. 13.Chiarotto A, Boers M, Deyo RA, Buchbinder R, Corbin TP, Costa LOP, et al. Core outcome measurement instruments for clinical trials in nonspecific low back pain. Pain 2018; 159: 481–495. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1097/j.pain.0000000000001117&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) 14. 14.Holey EA, Feeley JL, Dixon J, Whittaker VJ. An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Med Res Methodol 2007; 7: 52. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1186/1471-2288-7-52&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=18045508&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) 15. 15.West A. Using the Delphi Technique: Experience from the world of counselling and psychotherapy. C&PR 2011; 11: 237–242. 16. 16.McLachlan S, Bungay H. Consensus on research priorities for Essex & Herts air ambulance: a Delphi study. Scand J Trauma Resusc Emerg Med 2021; 29: 25. 17. 17.Rodger M, Hills J, Kristjanson L. A Delphi study on research priorities for emergency nurses in Western Australia. J Emerg Nurs 2004; 30: 117–125. [CrossRef](http://smj.org.sa/lookup/external-ref?access_num=10.1016/j.jen.2004.01.005&link_type=DOI) [PubMed](http://smj.org.sa/lookup/external-ref?access_num=15039667&link_type=MED&atom=%2Fsmj%2F43%2F11%2F1265.atom) 18. 18.Bautista C, Hinkle JL, Alexander S, Hundt B, Rhudy L. A Delphi study to establish research priorities for neuroscience nursing. J Neurosci Nurs 2022; 54: 74–79. 19. 19.Al-Yateem N, Al-Tamimi M, Brenner M, Al Tawil H, Ahmad A, Brownie S, et al. Nurse-identified patient care and health services research priorities in the United Arab Emirates: a Delphi study. BMC Health Serv Res 2019; 19: 77. 20. 20.Chipps EM, Joseph ML, Alexander C, Lyman B, McGinty L, Nelson-Brantley H, et al. Setting the research agenda for nursing administration and leadership science: a Delphi Study. J Nurs Adm 2021; 51: 430–438.