Abstract
Abstract
Background: Alcohol brief interventions can support those aged 16 or over to reduce the harm associated with their alcohol use outside the formal treatment setting. Applied in a variety of contexts including online, primary and other healthcare, workplaces, Universities, and other settings, there is a diversity of outcomes used to evaluate whether alcohol brief interventions are effective/efficacious. This diversity reduces the quality of research and the ability to synthesise evidence to understand what works. We report the “Outcome Reporting in Brief Intervention Trials: Alcohol” (ORBITAL) recommended core outcome set (COS) for efficacy/effectiveness evaluations for alcohol brief interventions (ABIs) and how this was developed.
Methods: To develop the core outcome set we followed COMET Initiative methods including a systematic review, e-Delphi, consensus meeting, psychometric evaluation, explored question order bias, and reflected on the approach. The development was supported by the International Network on Brief Interventions for Alcohol and Other Drugs (INEBRIA) Measurement Special Interest Group.
Results: The review identified 2,641 outcomes in 401 ABI articles measured 1,560 different ways. In a two-round e-Delphi, 150 participants from 19 countries prioritized 15 outcome categories which were discussed at the consensus meeting. The ORBITAL COS has 10 outcomes, decided at the consensus meeting: (a) typical frequency, (b) typical quantity, (c) frequency of heavy episodic drinking, (d) combined consumption measure, (e) hazardous drinking (average consumption), (f) past week standard drinks (recent consumption), (g) alcohol-related consequences, (h) alcohol-related injury, (i) emergency healthcare service use (impact of alcohol use), and (j) quality of life. A psychometric evaluation and vote determined how to measure outcomes including those experiencing unhealthy alcohol use providing living expertise to decision making. An evaluation of question order bias revealed that the order of the questions matters for implementation.
Conclusions: The ORBITAL COS is the recommended minimum and does not exclude the measurement of additional outcomes alongside the core. Online testing of the questions in the COS showed they were easy and quick to complete. Core outcome sets improve evidence synthesis, improve the inclusion of new research works, reduce redundant/selective reporting, improve between-study comparisons, easily justify measure choice to funders, and enhance the relevance of evaluation findings to decision makers. The review has identified the urgency of addressing the diversity of the field, and provides the tools to advance. We critically reflect on processes and lessons learned, plans for reviewing the core outcome set, and invite the development of core outcome sets to improve the quality of evaluation in the addiction the field.
Background: Alcohol brief interventions can support those aged 16 or over to reduce the harm associated with their alcohol use outside the formal treatment setting. Applied in a variety of contexts including online, primary and other healthcare, workplaces, Universities, and other settings, there is a diversity of outcomes used to evaluate whether alcohol brief interventions are effective/efficacious. This diversity reduces the quality of research and the ability to synthesise evidence to understand what works. We report the “Outcome Reporting in Brief Intervention Trials: Alcohol” (ORBITAL) recommended core outcome set (COS) for efficacy/effectiveness evaluations for alcohol brief interventions (ABIs) and how this was developed.
Methods: To develop the core outcome set we followed COMET Initiative methods including a systematic review, e-Delphi, consensus meeting, psychometric evaluation, explored question order bias, and reflected on the approach. The development was supported by the International Network on Brief Interventions for Alcohol and Other Drugs (INEBRIA) Measurement Special Interest Group.
Results: The review identified 2,641 outcomes in 401 ABI articles measured 1,560 different ways. In a two-round e-Delphi, 150 participants from 19 countries prioritized 15 outcome categories which were discussed at the consensus meeting. The ORBITAL COS has 10 outcomes, decided at the consensus meeting: (a) typical frequency, (b) typical quantity, (c) frequency of heavy episodic drinking, (d) combined consumption measure, (e) hazardous drinking (average consumption), (f) past week standard drinks (recent consumption), (g) alcohol-related consequences, (h) alcohol-related injury, (i) emergency healthcare service use (impact of alcohol use), and (j) quality of life. A psychometric evaluation and vote determined how to measure outcomes including those experiencing unhealthy alcohol use providing living expertise to decision making. An evaluation of question order bias revealed that the order of the questions matters for implementation.
Conclusions: The ORBITAL COS is the recommended minimum and does not exclude the measurement of additional outcomes alongside the core. Online testing of the questions in the COS showed they were easy and quick to complete. Core outcome sets improve evidence synthesis, improve the inclusion of new research works, reduce redundant/selective reporting, improve between-study comparisons, easily justify measure choice to funders, and enhance the relevance of evaluation findings to decision makers. The review has identified the urgency of addressing the diversity of the field, and provides the tools to advance. We critically reflect on processes and lessons learned, plans for reviewing the core outcome set, and invite the development of core outcome sets to improve the quality of evaluation in the addiction the field.
| Original language | English |
|---|---|
| Publication status | Published - 23 Oct 2024 |
| Event | Lisbon Addictions 2024 - Lisbon Conference Centre, Lisbon, Portugal Duration: 23 Oct 2024 → 25 Oct 2024 http://www.lisbonaddictions.eu |
Conference
| Conference | Lisbon Addictions 2024 |
|---|---|
| Country/Territory | Portugal |
| City | Lisbon |
| Period | 23/10/2024 → 25/10/2024 |
| Internet address |
UN SDGs
This output contributes to the following UN Sustainable Development Goals (SDGs)
-
SDG 3 Good Health and Well-being
Fingerprint
Dive into the research topics of 'Crafting the international standard: Establishing and implementing core outcome measures for alcohol brief interventions'. Together they form a unique fingerprint.Research output
- 4 Article
-
The effect of question order on outcomes in the ORBITAL core outcome set for alcohol brief interventions among online help-seekers (QOBCOS): findings from a randomised factorial trial
Bendtsen, M., Garnett, C., Toner, P. & Shorter, G. W., 12 Feb 2023, In: Digital Health. 9, p. 1-13 13 p.Research output: Contribution to journal › Article › peer-review
Open AccessFile1 Link opens in a new tab Citation (Scopus)48 Downloads (Pure) -
The ORBITAL Core Outcome Set: Response to de Bejczy et al., 2022 on biomarkers and methodological innovation in core outcome sets
Shorter, G. W., Heather, N., Berman, A. H., Giles, E. L., Barbosa, C., Monteiro, M. G., Cowell, A., Toner, P. & Bray, J. W., 08 Mar 2022, In: Journal of Studies on Alcohol and Drugs. 83, 2, p. 298-300Research output: Contribution to journal › Article › peer-review
Open AccessFile3 Link opens in a new tab Citations (Scopus)66 Downloads (Pure) -
The “Outcome Reporting in Brief Intervention Trials: Alcohol” (ORBITAL) Core Outcome Set: International Consensus on Outcomes to Measure in Efficacy and Effectiveness Trials of Alcohol Brief Interventions
Shorter, G. W., Bray, J. W., Heather, N., Berman, A. H., Giles, E. L., Clarke, M., Barbosa, C., O'Donnell, A. J., Holloway, A., Riper, H., Daeppen, J.-B., Monteiro, M. G., Saitz, R., McNeely, J., McKnight-Eily, L., Cowell, A., Toner, P. & Newbury-Birch, D., 19 Sept 2021, In: Journal of Studies on Alcohol and Drugs. 82, 5, p. 638-646 9 p.Research output: Contribution to journal › Article › peer-review
Open AccessFile41 Link opens in a new tab Citations (Scopus)160 Downloads (Pure)
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver