Table 1

The YoPA SUPER-AIM evaluation framework

Component and definitionOutcomeMethods
Systems—identification of the drivers of unhealthy movement behaviours at multiple levels of the system including linkages, relationships, feedback loops and interactions among system parts
  1. Maps of the local system and its stakeholders, displaying knowledge gaps, leverage points for interventions and insights

  2. Overview of both intended and emergent outcomes of interventions across various levels, interactions with the local context and adaptation of interventions

  1. Developing local system maps based on, for example, Group Model Building,88 Social Network Analysis.89

  2. Ripple Effects Mapping90 91: in several group sessions, different key stakeholders participate to provide their perspective on the outcomes (appreciative inquiry) and collaboratively explore the contribution of the implemented interventions to these outcomes in mind maps. This provides practice-based knowledge about effective principles as well as the broader impact of the interventions.

User perspectives—identification of the user perspective on implemented interventions, for example, on the attractiveness and acceptabilityAccessibility, acceptability and adaptations of interventions, for example, perceived physical activity friendliness, perceived inclusiveness of interventions, perceived safety and fear of crime; satisfaction with interventions and use of interventionsParticipant observation and in-depth formal and informal interviews with adolescents, for example, using photo-diaries,92 go-along interviews,93 94 neighbourhood audit,95 focus group interviews.96 97
Participatory co-creation process—identification of important barriers and facilitators of the participatory co-creation process
  1. Adolescents’ motivations to participate in the project

  2. Satisfaction with the co-creation process among involved stakeholders*

  3. Mechanisms underlying co-creation

  1. Participatory observations, focus group interviews, reflection scheme after each co-creation meeting.

  2. Online satisfaction measurement, focus group interviews.

  3. In-depth focus group interviews98 with project team; realist context-mechanism-outcome causal analysis.

Effects—identification of desired outcomes among the adolescents. If necessary, measures of locally defined impact will be added to examine factors of greatest interest to local stakeholders
  1. Well-being

  2. Personal and collective agency

  3. 24 hour movement behaviours (physical activity, sedentary behaviour, sleep)

  1. EPOCH measure of adolescent well-being.99

  2. GEAS survey on freedom of movement, voice, behavioural control and decision making.100

  3. Accelerometers, self-report and systematic observation (adapted SOPLAY96/SOPARC97).

Reach—adolescents whose behaviours and well-being we aim to benefit: (1) co-creation participants; (2) users of interventions; (3) adolescent citizens in the selected communitiesCharacteristics of adolescents
  1. Focus group interviews with co-creation participants.

  2. Systematic observations of intervention users.

  3. Existing databases (eg, from municipality) and survey data of adolescent citizens in the selected communities.

Adoption—identification of engagement and commitment with (1) implemented interventions; (2) teen-centred co-creationEngagement and commitment of relevant stakeholders*Focus group interviews.
Implementation—identification of adaptations, potential barriers and facilitators of implementation
  1. Satisfaction with implementation of youth-centred co-creation among involved stakeholders*

  2. Number, type and quality of implemented interventions

  3. Satisfaction with implementation of interventions among involved stakeholders*

  4. Costs of intervention implementation

  1. Participatory observations and focus group interviews.

  2. Calculation of the resources needed to implement the interventions using microcosting.85

Maintenance—identification of sustained use of (1) implemented interventions; (2) teen-centred co-creation
  1. Sustained use of interventions

  2. Sustained use of youth-centred co-creation in the communities

  1. Systematic observation (eg, adapted SOPLAY96/SOPARC97).

  2. Focus group interviews.

  • *Involved stakeholders: for example, adolescents, public health professionals, urban planners/designers, policy makers.

  • EPOCH, Engagement, Perseverance, Optimism, Connectedness, and Happiness; GEAS, Global Early Adolescent Study; SOPARC, System for Observing Play and Recreation in Communities; SOPLAY, System for Observing Play and Leisure Activity in Youth; SUPER-AIM, Systems, User perspectives, Participatory co-creation process, Effects, Reach, Adoption, Implementation and Maintenance; YoPA, Youth-centred Participatory Action.