Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study

Background: The use of ecological momentary assessment (EMA) designs has been on the rise in mental health epidemiology. However, there is a lack of knowledge of the determinants of participation in and compliance with EMA studies, reliability of measures, and underreporting of methodological detail...

ver descrição completa

Detalhes bibliográficos
Autores: Portillo-Van Diest, A, Mortier, P, Ballester, L, Amigo, F, Carrasco, P, Falcó, R, Gili, M, Kiekens, G, Machancoses, FH, Piqueras, JA, Rebagliato, M, Roca, M, Rodríguez-Jiménez, T, Alonso, J, Vilagut, G
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:España
Recursos:Fundación para el Fomento de la Investigación Sanitaria y Biomédica de la Comunitat Valenciana (FISABIO)
Repositorio:r-FISABIO. Repositorio Institucional de Producción Científica
OAI Identifier:oai:fisabio.fundanetsuite.com:p19631
Acesso em linha:https://fisabio.portalinvestigacion.com/publicaciones/19631
Access Level:acceso abierto
Palavra-chave:experience sampling method
ecological momentary assessment
mental health
university students
participation
compliance
reliability
sensitivity analysis
mobile phone
id ES_cd5ef0fdbfb11ff858dcd870ddaebee8
oai_identifier_str oai:fisabio.fundanetsuite.com:p19631
network_acronym_str ES
network_name_str España
repository_id_str
spelling Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation StudyPortillo-Van Diest, AMortier, PBallester, LAmigo, FCarrasco, PFalcó, RGili, MKiekens, GMachancoses, FHPiqueras, JARebagliato, MRoca, MRodríguez-Jiménez, TAlonso, JVilagut, Gexperience sampling methodecological momentary assessmentmental healthuniversity studentsparticipationcompliancereliabilitysensitivity analysismobile phoneBackground: The use of ecological momentary assessment (EMA) designs has been on the rise in mental health epidemiology. However, there is a lack of knowledge of the determinants of participation in and compliance with EMA studies, reliability of measures, and underreporting of methodological details and data quality indicators. Objective: This study aims to evaluate the quality of EMA data in a large sample of university students by estimating participation rate and mean compliance, identifying predictors of individual-level participation and compliance, evaluating between- and within-person reliability of measures of negative and positive affect, and identifying potential careless responding. Methods: A total of 1259 university students were invited to participate in a 15-day EMA study on mental health problems. Logistic and Poisson regressions were used to investigate the associations between sociodemographic factors, lifetime adverse experiences, stressful events in the previous 12 months, and mental disorder screens and EMA participation and compliance. Multilevel reliability and intraclass correlation coefficients were obtained for positive and negative affect measures. Careless responders were identified based on low compliance or individual reliability coefficients. Results: Of those invited, 62.1% (782/1259) participated in the EMA study, with a mean compliance of 76.9% (SD 27.7%). Participation was higher among female individuals (odds ratio [OR] 1.41, 95% CI 1.06-1.87) and lower among those aged >= 30 years (OR 0.20, 95% CI 0.08-0.43 vs those aged 18-21 years) and those who had experienced the death of a friend or family member in the previous 12 months (OR 0.73, 95% CI 0.57-0.94) or had a suicide attempt in the previous 12 months (OR 0.26, 95% CI 0.10-0.64). Compliance was particularly low among those exposed to sexual abuse before the age of 18 years (exponential of beta=0.87) or to sexual assault or rape in the previous year (exponential of beta=0.80) and among those with 12-month positive alcohol use disorder screens (exponential of beta=0.89). Between-person reliability of negative and positive affect was strong (R-kRn>0.97), whereas within-person reliability was fair to moderate (R-cn>0.43). Of all answered assessments, 0.86% (291/33,626) were flagged as careless responses because the response time per item was <1 second or the participants gave the same response to all items. Of the participants, 17.5% (137/782) could be considered careless responders due to low compliance (<25/56, 45%) or very low to null individual reliability (raw Cronbach alpha<0.11) for either negative or positive affect. Conclusions: Data quality assessments should be carried out in EMA studies in a standardized manner to provide robust conclusions to advance the field. Future EMA research should implement strategies to mitigate nonresponse bias as well as conduct sensitivity analyses to assess possible exclusion of careless responders.JMIR PUBLICATIONS, INC2024info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttps://fisabio.portalinvestigacion.com/publicaciones/19631JOURNAL OF MEDICAL INTERNET RESEARCHISSN: 14394456ISSNe: 14388871reponame:r-FISABIO. Repositorio Institucional de Producción Científicainstname:Fundación para el Fomento de la Investigación Sanitaria y Biomédica de la Comunitat Valenciana (FISABIO)Inglésinfo:eu-repo/semantics/openAccessoai:fisabio.fundanetsuite.com:p196312026-06-11T12:45:17Z
dc.title.none.fl_str_mv Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
title Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
spellingShingle Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
Portillo-Van Diest, A
experience sampling method
ecological momentary assessment
mental health
university students
participation
compliance
reliability
sensitivity analysis
mobile phone
title_short Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
title_full Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
title_fullStr Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
title_full_unstemmed Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
title_sort Ecological Momentary Assessment of Mental Health Problems Among University Students: Data Quality Evaluation Study
dc.creator.none.fl_str_mv Portillo-Van Diest, A
Mortier, P
Ballester, L
Amigo, F
Carrasco, P
Falcó, R
Gili, M
Kiekens, G
Machancoses, FH
Piqueras, JA
Rebagliato, M
Roca, M
Rodríguez-Jiménez, T
Alonso, J
Vilagut, G
author Portillo-Van Diest, A
author_facet Portillo-Van Diest, A
Mortier, P
Ballester, L
Amigo, F
Carrasco, P
Falcó, R
Gili, M
Kiekens, G
Machancoses, FH
Piqueras, JA
Rebagliato, M
Roca, M
Rodríguez-Jiménez, T
Alonso, J
Vilagut, G
author_role author
author2 Mortier, P
Ballester, L
Amigo, F
Carrasco, P
Falcó, R
Gili, M
Kiekens, G
Machancoses, FH
Piqueras, JA
Rebagliato, M
Roca, M
Rodríguez-Jiménez, T
Alonso, J
Vilagut, G
author2_role author
author
author
author
author
author
author
author
author
author
author
author
author
author
dc.subject.none.fl_str_mv experience sampling method
ecological momentary assessment
mental health
university students
participation
compliance
reliability
sensitivity analysis
mobile phone
topic experience sampling method
ecological momentary assessment
mental health
university students
participation
compliance
reliability
sensitivity analysis
mobile phone
description Background: The use of ecological momentary assessment (EMA) designs has been on the rise in mental health epidemiology. However, there is a lack of knowledge of the determinants of participation in and compliance with EMA studies, reliability of measures, and underreporting of methodological details and data quality indicators. Objective: This study aims to evaluate the quality of EMA data in a large sample of university students by estimating participation rate and mean compliance, identifying predictors of individual-level participation and compliance, evaluating between- and within-person reliability of measures of negative and positive affect, and identifying potential careless responding. Methods: A total of 1259 university students were invited to participate in a 15-day EMA study on mental health problems. Logistic and Poisson regressions were used to investigate the associations between sociodemographic factors, lifetime adverse experiences, stressful events in the previous 12 months, and mental disorder screens and EMA participation and compliance. Multilevel reliability and intraclass correlation coefficients were obtained for positive and negative affect measures. Careless responders were identified based on low compliance or individual reliability coefficients. Results: Of those invited, 62.1% (782/1259) participated in the EMA study, with a mean compliance of 76.9% (SD 27.7%). Participation was higher among female individuals (odds ratio [OR] 1.41, 95% CI 1.06-1.87) and lower among those aged >= 30 years (OR 0.20, 95% CI 0.08-0.43 vs those aged 18-21 years) and those who had experienced the death of a friend or family member in the previous 12 months (OR 0.73, 95% CI 0.57-0.94) or had a suicide attempt in the previous 12 months (OR 0.26, 95% CI 0.10-0.64). Compliance was particularly low among those exposed to sexual abuse before the age of 18 years (exponential of beta=0.87) or to sexual assault or rape in the previous year (exponential of beta=0.80) and among those with 12-month positive alcohol use disorder screens (exponential of beta=0.89). Between-person reliability of negative and positive affect was strong (R-kRn>0.97), whereas within-person reliability was fair to moderate (R-cn>0.43). Of all answered assessments, 0.86% (291/33,626) were flagged as careless responses because the response time per item was <1 second or the participants gave the same response to all items. Of the participants, 17.5% (137/782) could be considered careless responders due to low compliance (<25/56, 45%) or very low to null individual reliability (raw Cronbach alpha<0.11) for either negative or positive affect. Conclusions: Data quality assessments should be carried out in EMA studies in a standardized manner to provide robust conclusions to advance the field. Future EMA research should implement strategies to mitigate nonresponse bias as well as conduct sensitivity analyses to assess possible exclusion of careless responders.
publishDate 2024
dc.date.none.fl_str_mv 2024
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv https://fisabio.portalinvestigacion.com/publicaciones/19631
url https://fisabio.portalinvestigacion.com/publicaciones/19631
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv JMIR PUBLICATIONS, INC
publisher.none.fl_str_mv JMIR PUBLICATIONS, INC
dc.source.none.fl_str_mv JOURNAL OF MEDICAL INTERNET RESEARCH
ISSN: 14394456
ISSNe: 14388871
reponame:r-FISABIO. Repositorio Institucional de Producción Científica
instname:Fundación para el Fomento de la Investigación Sanitaria y Biomédica de la Comunitat Valenciana (FISABIO)
instname_str Fundación para el Fomento de la Investigación Sanitaria y Biomédica de la Comunitat Valenciana (FISABIO)
reponame_str r-FISABIO. Repositorio Institucional de Producción Científica
collection r-FISABIO. Repositorio Institucional de Producción Científica
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869419826367168512
score 15,81155

Registos relacionados