The ENCOMPASS Framework: a Practical Guide for the Evaluation of Public Health Programmes in Complex Adaptive Systems

Overview

Journal Int J Behav Nutr Phys Act

Publisher Biomed Central

Specialties Nutritional Sciences
Orthopedics
Social Sciences

Date 2022 Mar 29

PMID 35346233

Authors

Angie Luna Pinzon

Karien Stronks

Coosje Dijkstra

Carry Renders

Teatske Altenburg

Karen den Hertog

Stef P J Kremers

Mai J M Chinapaw

Arnoud P Verhoeff

Wilma Waterlander

Affiliations

Soon will be listed here.

Abstract

Background: Systems thinking embraces the complexity of public health problems, including childhood overweight and obesity. It aids in understanding how factors are interrelated, and it can be targeted to produce favourable changes in a system. There is a growing call for systems approaches in public health research, yet limited practical guidance is available on how to evaluate public health programmes within complex adaptive systems. The aim of this paper is to present an evaluation framework that supports researchers in designing systems evaluations in a comprehensive and practical way.

Methods: We searched the literature for existing public health systems evaluation studies. Key characteristics on how to conduct a systems evaluation were extracted and compared across studies. Next, we overlaid the identified characteristics to the context of the Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme evaluation and analyzed which characteristics were essential to carry out the LIKE evaluation. This resulted in the Evaluation of Programmes in Complex Adaptive Systems (ENCOMPASS) framework.

Results: The ENCOMPASS framework includes five iterative stages: (1) adopting a system dynamics perspective on the overall evaluation design; (2) defining the system boundaries; (3) understanding the pre-existing system to inform system changes; (4) monitoring dynamic programme output at different system levels; and (5) measuring programme outcome and impact in terms of system changes.

Conclusions: The value of ENCOMPASS lies in the integration of key characteristics from existing systems evaluation studies, as well as in its practical, applied focus. It can be employed in evaluating public health programmes in complex adaptive systems. Furthermore, ENCOMPASS provides guidance for the entire evaluation process, all the way from understanding the system to developing actions to change it and to measuring system changes. By the nature of systems thinking, the ENCOMPASS framework will likely evolve further over time, as the field expands with more completed studies.

Citing Articles

Monitoring and adaptation of a system dynamics approach to prevent childhood overweight and obesity: findings from the LIKE programme.

de Pooter N, Luna Pinzon A, den Hertog K, Altenburg T, Busch V, Dijkstra C Health Res Policy Syst. 2025; 23(1):30.

PMID: 40038671 PMC: 11881247. DOI: 10.1186/s12961-025-01301-3.

Evaluating a whole-school approach to addressing gender-based violence in Scottish secondary schools (Equally Safe at School): a study protocol for a type I hybrid effectiveness-implementation trial.

Hamilton C, Lewis R, Blake C, Purvis A, Vaczy C, Deidda M BMJ Open. 2025; 15(2):e096596.

PMID: 39956602 PMC: 11831264. DOI: 10.1136/bmjopen-2024-096596.

Identification of Clusters in a Population With Obesity Using Machine Learning: Secondary Analysis of The Maastricht Study.

Beuken M, Kleynen M, Braun S, Van Berkel K, van der Kallen C, Koster A JMIR Med Inform. 2025; 13:e64479.

PMID: 39908080 PMC: 11840370. DOI: 10.2196/64479.

'It's about collaboration': a whole-systems approach to understanding and promoting movement in Suffolk.

Brinkley A, Cusimano K, Freeman P, Southall-Edwards R, Gladwell V Int J Behav Nutr Phys Act. 2025; 22(1):7.

PMID: 39819450 PMC: 11740498. DOI: 10.1186/s12966-024-01688-2.

Guiding prevention initiatives by applying network analysis to systems maps of adverse childhood experiences and adolescent suicide.

Maldonado B, Schuerkamp R, Martin C, Rice K, Nataraj N, Brown M Netw Sci (Camb Univ Press). 2024; 12(3):234-260.

PMID: 39664320 PMC: 11633372. DOI: 10.1017/nws.2024.8.

References

Stansfield J, South J, Mapplethorpe T . What are the elements of a whole system approach to community-centred public health? A qualitative study with public health leaders in England's local authority areas. BMJ Open. 2020; 10(8):e036044. PMC: 7451485. DOI: 10.1136/bmjopen-2019-036044. View

Hawe P, Shiell A, Riley T . Theorising interventions as events in systems. Am J Community Psychol. 2009; 43(3-4):267-76. DOI: 10.1007/s10464-009-9229-9. View

Waterlander W, Luna Pinzon A, Verhoeff A, den Hertog K, Altenburg T, Dijkstra C . A System Dynamics and Participatory Action Research Approach to Promote Healthy Living and a Healthy Weight among 10-14-Year-Old Adolescents in Amsterdam: The LIKE Programme. Int J Environ Res Public Health. 2020; 17(14). PMC: 7400640. DOI: 10.3390/ijerph17144928. View

Karacabeyli D, Allender S, Pinkney S, Amed S . Evaluation of complex community-based childhood obesity prevention interventions. Obes Rev. 2018; 19(8):1080-1092. DOI: 10.1111/obr.12689. View

Foster-Fishman P, Nowell B, Yang H . Putting the system back into systems change: a framework for understanding and changing organizational and community systems. Am J Community Psychol. 2007; 39(3-4):197-215. DOI: 10.1007/s10464-007-9109-0. View

McGlashan J, Nichols M, Korn A, Millar L, Marks J, Sanigorski A . Social network analysis of stakeholder networks from two community-based obesity prevention interventions. PLoS One. 2018; 13(4):e0196211. PMC: 5922530. DOI: 10.1371/journal.pone.0196211. View

Carey G, Malbon E, Carey N, Joyce A, Crammond B, Carey A . Systems science and systems thinking for public health: a systematic review of the field. BMJ Open. 2016; 5(12):e009002. PMC: 4710830. DOI: 10.1136/bmjopen-2015-009002. View

Foster-Fishman P, Behrens T . Systems change reborn: rethinking our theories, methods, and efforts in human services reform and community-based change. Am J Community Psychol. 2007; 39(3-4):191-6. DOI: 10.1007/s10464-007-9104-5. View

Brown A, Whelan J, Bolton K, Nagorcka-Smith P, Hayward J, Fraser P . A Theory of Change for Community-Based Systems Interventions to Prevent Obesity. Am J Prev Med. 2021; 62(5):786-794. DOI: 10.1016/j.amepre.2021.10.006. View

10.

McGlashan J, Johnstone M, Creighton D, de la Haye K, Allender S . Quantifying a Systems Map: Network Analysis of a Childhood Obesity Causal Loop Diagram. PLoS One. 2016; 11(10):e0165459. PMC: 5082925. DOI: 10.1371/journal.pone.0165459. View

11.

Resnicow K, Vaughan R . A chaotic view of behavior change: a quantum leap for health promotion. Int J Behav Nutr Phys Act. 2006; 3:25. PMC: 1586207. DOI: 10.1186/1479-5868-3-25. View

12.

Maitland N, Wardle K, Whelan J, Jalaludin B, Creighton D, Johnstone M . Tracking implementation within a community-led whole of system approach to address childhood overweight and obesity in south west Sydney, Australia. BMC Public Health. 2021; 21(1):1233. PMC: 8236147. DOI: 10.1186/s12889-021-11288-5. View

13.

McGlashan J, Hayward J, Brown A, Owen B, Millar L, Johnstone M . Comparing complex perspectives on obesity drivers: action-driven communities and evidence-oriented experts. Obes Sci Pract. 2018; 4(6):575-581. PMC: 6298210. DOI: 10.1002/osp4.306. View

14.

Johnston L, Matteson C, Finegood D . Systems science and obesity policy: a novel framework for analyzing and rethinking population-level planning. Am J Public Health. 2014; 104(7):1270-8. PMC: 4056198. DOI: 10.2105/AJPH.2014.301884. View

15.

Bagnall A, Radley D, Jones R, Gately P, Nobles J, van Dijk M . Whole systems approaches to obesity and other complex public health challenges: a systematic review. BMC Public Health. 2019; 19(1):8. PMC: 6318991. DOI: 10.1186/s12889-018-6274-z. View

16.

Walton M . Applying complexity theory: a review to inform evaluation design. Eval Program Plann. 2014; 45:119-26. DOI: 10.1016/j.evalprogplan.2014.04.002. View

17.

Matheson A, Walton M, Gray R, Lindberg K, Shanthakumar M, Fyfe C . Evaluating a community-based public health intervention using a complex systems approach. J Public Health (Oxf). 2017; 40(3):606-613. DOI: 10.1093/pubmed/fdx117. View

18.

Garcia L, Hunter R, de la Haye K, Economos C, King A . An action-oriented framework for systems-based solutions aimed at childhood obesity prevention in US Latinx and Latin American populations. Obes Rev. 2021; 22 Suppl 3:e13241. PMC: 8217154. DOI: 10.1111/obr.13241. View

19.

Skivington K, Matthews L, Simpson S, Craig P, Baird J, Blazeby J . A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021; 374:n2061. PMC: 8482308. DOI: 10.1136/bmj.n2061. View

20.

Kreger M, Brindis C, Manuel D, Sassoubre L . Lessons learned in systems change initiatives: benchmarks and indicators. Am J Community Psychol. 2007; 39(3-4):301-20. DOI: 10.1007/s10464-007-9108-1. View