Quantitative and qualitative evaluation of the COMPASS mobile app: a citizen science project

To evaluate the usability of the COMPASS application with mixed-methodology, using a citizen science approach. Parents/tutors of 10-11 years old children attending a primary school in Barcelona, Spain, were invited to take part in the study. We conducted semi-structured interviews on a subset (n = 7...

Full description

Bibliographic Details
Authors: Díaz, Jorge L., Codern Bové, Núria, Zomeño Fajardo, María Dolores, Lassale, Camille, Schröder, Helmut, 1958-, Grau Magaña, Maria
Format: article
Status:Versión aceptada para publicación
Publication Date:2021
Country:España
Institution:Universitat Pompeu Fabra
Repository:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/48480
Online Access:http://hdl.handle.net/10230/48480
http://dx.doi.org/10.1080/17538157.2021.1902332
Access Level:Open access
Keyword:Cardiovascular diseases
eHealth
Mixed methodology
Mobile applications
Usability
Description
Summary:To evaluate the usability of the COMPASS application with mixed-methodology, using a citizen science approach. Parents/tutors of 10-11 years old children attending a primary school in Barcelona, Spain, were invited to take part in the study. We conducted semi-structured interviews on a subset (n = 7) of participants, two weeks after using the app for the first time. A list of suggestions of improvement was extracted from the interviews. The System Usability Scale (SUS, range 0-100) was administered to all participants before and after the improvements were implemented. We provide both a quantitative analysis (t-test of change in SUS scores) and a qualitative thematic analysis of the interviews. A total of 22 participants were included in the study. The mean score before implementation of changes was 68.5 (Standard deviation, SD = 11.1), and improved to 73.1 (10.5) (p-value = 0.025). Regarding the qualitative assessment, we obtained 24 codes and grouped them into 3 categories. It uncovered problems in the installation phase and the main barriers to use: lack of time and the need for the app to evolve. The new version of COMPASS, improved by taking into account the participants' comments and suggestions, was more usable than the initial version.