Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions

Background: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multip...

Descripción completa

Detalles Bibliográficos
Autores: Tsantila, Fotini, Amann, Benedikt Lorenz, Van Audenhove, Chantal
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2023
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/59259
Acceso en línea:http://hdl.handle.net/10230/59259
http://dx.doi.org/10.1186/s12889-023-16092-x
Access Level:acceso abierto
Palabra clave:Complex interventions
Evaluation
Implementation
Intervention development
MENTUPP
Medical Research Council framework
Organizational interventions
Theory of Change
Small and Medium Enterprises (SMEs)
Workplace-based mental health/health interventions
id ES_0f9fed77f48bb29d89c55c2c7eef89b8
oai_identifier_str oai:recercat.cat:10230/59259
network_acronym_str ES
network_name_str España
repository_id_str
dc.title.none.fl_str_mv Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
spellingShingle Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
Tsantila, Fotini
Complex interventions
Evaluation
Implementation
Intervention development
MENTUPP
Medical Research Council framework
Organizational interventions
Theory of Change
Small and Medium Enterprises (SMEs)
Workplace-based mental health/health interventions
title_short Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_full Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_fullStr Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_full_unstemmed Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_sort Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
dc.creator.none.fl_str_mv Tsantila, Fotini
Amann, Benedikt Lorenz
Van Audenhove, Chantal
author Tsantila, Fotini
author_facet Tsantila, Fotini
Amann, Benedikt Lorenz
Van Audenhove, Chantal
author_role author
author2 Amann, Benedikt Lorenz
Van Audenhove, Chantal
author2_role author
author
dc.subject.none.fl_str_mv Complex interventions
Evaluation
Implementation
Intervention development
MENTUPP
Medical Research Council framework
Organizational interventions
Theory of Change
Small and Medium Enterprises (SMEs)
Workplace-based mental health/health interventions
topic Complex interventions
Evaluation
Implementation
Intervention development
MENTUPP
Medical Research Council framework
Organizational interventions
Theory of Change
Small and Medium Enterprises (SMEs)
Workplace-based mental health/health interventions
description Background: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. Method: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. Results: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). Conclusions: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace.
publishDate 2023
dc.date.none.fl_str_mv 2023
2024
2024
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/59259
http://dx.doi.org/10.1186/s12889-023-16092-x
url http://hdl.handle.net/10230/59259
http://dx.doi.org/10.1186/s12889-023-16092-x
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv BMC Public Health. 2023 Jun 17;23(1):1171
info:eu-repo/grantAgreement/EC/H2020/848137
dc.rights.none.fl_str_mv http://creativecommons.org/licenses/by/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv BioMed Central
publisher.none.fl_str_mv BioMed Central
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869403464479539200
spelling Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventionsTsantila, FotiniAmann, Benedikt LorenzVan Audenhove, ChantalComplex interventionsEvaluationImplementationIntervention developmentMENTUPPMedical Research Council frameworkOrganizational interventionsTheory of ChangeSmall and Medium Enterprises (SMEs)Workplace-based mental health/health interventionsBackground: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. Method: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. Results: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). Conclusions: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace.This study is funded by the European Union’s Horizon 2020 research and innovation program under grant agreement No. 848137. The material presented and views expressed here are the responsibility of the author(s) only. The EU Commission takes no responsibility for any use made of the information set out.BioMed Central202420242023info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfapplication/pdfhttp://hdl.handle.net/10230/59259http://dx.doi.org/10.1186/s12889-023-16092-xreponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésBMC Public Health. 2023 Jun 17;23(1):1171info:eu-repo/grantAgreement/EC/H2020/848137© The Author(s) 2023. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.http://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:recercat.cat:10230/592592026-05-29T05:05:01Z
score 15,81155