Methods to Summarize Discrete-Choice Experiments in a Systematic Review: A Scoping Review

Background And Objective: Systematic reviews of discrete-choice experiments (DCEs) are being increasingly conducted. The objective of this scoping review was to identify and describe the methodologies that have been used to summarize results across DCEs.

Methods: We searched the electronic databases MEDLINE and EMBASE from inception to March 18, 2021, to identify English-language systematic reviews of patient preferences that included at least two DCEs and extracted data on attribute importance. The methods used to summarize results across DCEs were classified into narrative, semi-quantitative, and quantitative (meta-analytic) approaches and compared. Approaches to characterize the extent of preference heterogeneity were also described.

Results: From 7362 unique records, we identified 54 eligible reviews from 2010 to Mar 2021, across a broad range of health conditions. Most (83%) used a narrative approach to summarize findings of DCEs, often citing differences in studies as the reason for not formally pooling findings. Semi-quantitative approaches included summarizing the frequency of the most important attributes, the frequency of attribute statistical significance, or tabulated comparisons of attribute importance for each pair of attributes. One review conducted a meta-analysis using the maximum acceptable risk. While reviews often commented on the heterogeneity of patient preferences, few (6%) addressed this systematically across studies.

Conclusion: While not commonly used, several semi-quantitative and one quantitative approach for synthesizing results of DCEs were identified, which may be useful for generating summary estimates across DCEs when appropriate. Further work is needed to assess the validity and usefulness of these approaches.