Prototyping, developing, and iterating a gamified survey to evaluate participatory systems modelling for youth mental health: Quality assurance pilot

Abstract

Gamification is rapidly gaining popularity in research, including in participatory modelling programs. To facilitate stakeholder engagement and learning, gamification is utilised to communicate complex systems challenges at all stages of participatory modelling. However, this has excluded evaluation processes. We argue that evaluation of participatory modelling is important for refining and improving participatory processes and describe the potential for gamification to provide a more appealing platform for participants to engage in evaluation activities, eliciting richer data. This paper describes a quality assurance pilot to prototype, develop, and iterate online surveys - specifically its gamified activities - in the context of evaluating a national youth mental health participatory systems modelling program. Usability testing of the gamified surveys will be undertaken with diverse participants, which includes a rigorous process to reflect user feedback into functional improvements of the gamified activities. Potential benefits of gamification, such as participant empowerment and depth (of stakeholder learning, data, etc), are also explored. Though described in the context of an evaluation study for a national youth mental health participatory systems modelling program, this paper encourages researchers across disciplines to flexibly adapt and consider the benefits of gamification in participatory modelling including evaluation.