What is the Delphi Method?

The Delphi method is a structured communication technique used to obtain consensus from a group of experts through a series of iterative questionnaires and feedback. Originally developed in the 1950s by the RAND Corporation for forecasting purposes, the method has since been adapted for various applications, particularly in fields like healthcare, policy-making, and technology assessment. The Delphi method is particularly useful in situations where consensus is required but where the topic may be controversial or complex.[1] It has been widely applied in healthcare for developing clinical guidelines, assessing needs, and evaluating the effectiveness of interventions. The three key features of the Delphi method are 1) Anonymity: Participants provide their responses anonymously, which helps reduce the influence of dominant individuals and encourages honest feedback, 2) Iteration: having multiple rounds of questioning, where responses from previous rounds are summarized and shared with the participants. This iterative process allows experts to revise their opinions based on the collective input of the group, 3) Controlled Feedback: After each round, participants receive feedback on the group’s responses, enabling them to reflect on their views and consider the perspectives of others.[2]

5 Best Practices

1. Defining Clear Objectives and Scope – The establishment of clear objectives and a well-defined scope is crucial because it provides a framework that guides the panel members in their responses, ensuring that their insights are relevant and aligned with the study’s goals. A focused objective is necessary for determining the specific questions posed to the panel, as well as for the overall direction of the research. Furthermore, a clearly defined scope allows researchers to articulate the significance of their study and fosters a deeper understanding among the participating experts. It is imperative for researchers to articulate specific research questions, outline the potential implications of the findings, and define the target population for the study. This clarity helps with creating a targeted data collection process but also enhances the meaningfulness of the resulting consensus.[3] 

2. Selecting a Diverse and Relevant Expert Panel – The composition of the expert panel is another critical factor influencing the effectiveness of the Delphi method. A diverse and relevant panel can provide a broad range of perspectives, which is particularly important in the multifaceted field of healthcare. Involving experts from various disciplines ensures that multiple aspects of a problem are addressed, facilitating a more comprehensive understanding of the issue at hand. This diversity can include various healthcare professionals, researchers, policymakers, and even patients, depending on the focus of the study. The inclusion of experts with different backgrounds, experiences, and viewpoints enriches the discussion while minimizing potential biases that may arise. Researchers should carefully consider the selection criteria for their expert panel, ensuring that they represent a balance of disciplines, geographical regions, and cultural contexts. This thoughtful selection process can significantly enhance the depth and validity of the consensus achieved.[4] 

3. Utilizing Iterative Rounds with Controlled Feedback – The iterative nature of the Delphi method is instrumental in refining expert opinions and achieving consensus. By employing multiple rounds of questioning, researchers can create a dynamic dialogue among experts, allowing them to reconsider their initial responses based on the feedback received in previous rounds. The iterative process can reveal areas of agreement and disagreement, enabling experts to adjust their views as new information emerges. Having controlled feedback allows participants to reflect on their opinions while remaining anonymous, reducing peer pressure and promoting honest and thoughtful responses. Researchers should plan for multiple rounds of questionnaires, providing summaries of previous responses to facilitate this reflective process. Each iteration serves as an opportunity for experts to gain insights from their peers, leading to a more robust and nuanced consensus.[5] 

4. Employing Robust Data Analysis Techniques – The analysis of data collected through the Delphi method is a critical in finding consensus. Robust statistical techniques enhance the reliability of the findings and contribute to a clearer understanding of the consensus reached. Systematic data analysis identifies the level of agreement among experts and captures the degree of variability in their opinions. Researchers should employ a combination of quantitative and qualitative analysis methods to provide a comprehensive view of the data. By employing robust data analysis methods, researchers can enhance the credibility and applicability of their findings.[6] 

5. Ensuring Transparent Reporting and Documentation – Transparent reporting and documentation of the Delphi process are crucial for ensuring the credibility and reproducibility of the study. Detailed documentation allows other researchers to understand the methodology and context of the findings, fostering trust and enabling critical evaluation. Researchers should publish a comprehensive account of the Delphi process, including the criteria for expert selection, the development of questionnaires, and the statistical methods employed in analyzing the data. It is also essential to discuss the limitations and potential biases in the study.[7]

Conclusion

The Delphi method serves as a beneficial tool for achieving consensus among researchers in the medical health field. By implementing best practices such as defining clear objectives, selecting a diverse expert panel, utilizing iterative rounds with controlled feedback, employing robust data analysis techniques, and ensuring transparent reporting, researchers can ensure the accuracy and reliability of their findings. These practices contribute to a deeper understanding of complex health issues.

Take Away

This article examines 5 best practices to ensure accurate consensus building using the Delphi method in medical health research.

[1] Dalkey, N. C., & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9(3), 458-467.

[2] Hsu, C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research, and Evaluation, 12(10), 1-8.

[3] Hsu, C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research, and Evaluation, 12(10), 1-8.

[4] Murphy, M. K., Black, N., Lamping, D. L., et al. (1998). Consensus development methods and their use in clinical guideline development. Health Technology Assessment, 2(3), 1-88.

[5] Dalkey, N. C., & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9(3), 458-467.

[6] Okoli, C., & Pawlowski, S. D. (2004). The Delphi method as a research tool: An example, design considerations, and applications. Information & Management, 42(1), 15-29.

[7] von der Gracht, H. A. (2012). Consensus measurement in Delphi studies: Review and guidelines. Technological Forecasting and Social Change, 79(8), 1525-1536.