From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)

Background: Evaluation systems aim to embed evaluation as a standard and routine practice within public organizations. By integrating evaluation into the everyday operations of government, these systems have the potential to enhance the relevance and use of evaluation findings, support organizationa...

Descripción completa

Detalles Bibliográficos
Autores: Bustelo Ruesta, María Dolores, Jacob, Steve
Tipo de recurso: artículo
Fecha de publicación:2025
País:España
Institución:Universidad Complutense de Madrid (UCM)
Repositorio:Docta Complutense
Idioma:inglés
OAI Identifier:oai:docta.ucm.es:20.500.14352/130916
Acceso en línea:https://hdl.handle.net/20.500.14352/130916
Access Level:acceso abierto
Palabra clave:316
Institutionalization of evaluation
Evaluation systems
Ray Rist
Inteval Group
Public Sector Governance
Ciencias Sociales
59 Ciencia Política
id ES_7be7e4ee05ee41ecee261d6f94260f7e
oai_identifier_str oai:docta.ucm.es:20.500.14352/130916
network_acronym_str ES
network_name_str España
repository_id_str
spelling From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)Bustelo Ruesta, María DoloresJacob, Steve316Institutionalization of evaluationEvaluation systemsRay RistInteval GroupPublic Sector GovernanceCiencias Sociales59 Ciencia PolíticaBackground: Evaluation systems aim to embed evaluation as a standard and routine practice within public organizations. By integrating evaluation into the everyday operations of government, these systems have the potential to enhance the relevance and use of evaluation findings, support organizational learning, and contribute to more transparent and accountable governance. Although evaluation systems are often promoted as tools for strengthening the connection between evaluative knowledge and decision-making, it is important to examine how these systems may both facilitate and constrain the development and meaningful use of evaluation. Purpose: This article seeks to draw on the extensive body of knowledge developed by Ray Rist and the members of INTEVAL to better understand how evaluation systems are built, how they function, and what impacts they may have on the evaluation practice. By revisiting and synthesizing this extensive body of knowledge, we aim to extract key lessons for the design and implementation of evaluation systems that are both effective and adaptable to various contexts. Setting: As researchers and evaluators working within academic institutions, our work is informed by interdisciplinary and international perspectives that we use to examine the development of evaluation systems across diverse political and administrative contexts. Intervention: Not applicable. Research Design: Not applicable. Data Collection and Analysis: This article is based on a literature review focusing on the institutionalization of evaluation and the development of evaluation systems. Particular attention is given to the Comparative Policy Evaluation series established by Ray Rist, which offers an interdisciplinary and internationally comparative body of work spanning over three decades. Drawing on this series, we examined how evaluation systems have been conceptualized, implemented, and critiqued over time and across diverse national settings. Findings: This article highlights that evaluation systems are shaped by contextual factors, institutional arrangements, and the contributions of key individuals. The effectiveness of these evaluation systems depends not only on organizational design but also on the capacity and engagement of evaluators, commissioners, and decision makers. The effective functioning of such systems fosters an environment favorable to evaluation, achieves a balance between supply and demand, and safeguards the independence and integrity of evaluation.Western Michigan UniversityUniversidad Complutense de Madrid20252025-05-2520252025-05-25journal articlehttp://purl.org/coar/resource_type/c_6501AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/20.500.14352/130916reponame:Docta Complutenseinstname:Universidad Complutense de Madrid (UCM)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:docta.ucm.es:20.500.14352/1309162026-06-02T12:44:21Z
dc.title.none.fl_str_mv From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
title From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
spellingShingle From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
Bustelo Ruesta, María Dolores
316
Institutionalization of evaluation
Evaluation systems
Ray Rist
Inteval Group
Public Sector Governance
Ciencias Sociales
59 Ciencia Política
title_short From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
title_full From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
title_fullStr From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
title_full_unstemmed From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
title_sort From studies to systems: Ray Rist’s influence on evaluation systems: insights from international research group for policy and program evaluation (INTEVAL)
dc.creator.none.fl_str_mv Bustelo Ruesta, María Dolores
Jacob, Steve
author Bustelo Ruesta, María Dolores
author_facet Bustelo Ruesta, María Dolores
Jacob, Steve
author_role author
author2 Jacob, Steve
author2_role author
dc.contributor.none.fl_str_mv Universidad Complutense de Madrid
dc.subject.none.fl_str_mv 316
Institutionalization of evaluation
Evaluation systems
Ray Rist
Inteval Group
Public Sector Governance
Ciencias Sociales
59 Ciencia Política
topic 316
Institutionalization of evaluation
Evaluation systems
Ray Rist
Inteval Group
Public Sector Governance
Ciencias Sociales
59 Ciencia Política
description Background: Evaluation systems aim to embed evaluation as a standard and routine practice within public organizations. By integrating evaluation into the everyday operations of government, these systems have the potential to enhance the relevance and use of evaluation findings, support organizational learning, and contribute to more transparent and accountable governance. Although evaluation systems are often promoted as tools for strengthening the connection between evaluative knowledge and decision-making, it is important to examine how these systems may both facilitate and constrain the development and meaningful use of evaluation. Purpose: This article seeks to draw on the extensive body of knowledge developed by Ray Rist and the members of INTEVAL to better understand how evaluation systems are built, how they function, and what impacts they may have on the evaluation practice. By revisiting and synthesizing this extensive body of knowledge, we aim to extract key lessons for the design and implementation of evaluation systems that are both effective and adaptable to various contexts. Setting: As researchers and evaluators working within academic institutions, our work is informed by interdisciplinary and international perspectives that we use to examine the development of evaluation systems across diverse political and administrative contexts. Intervention: Not applicable. Research Design: Not applicable. Data Collection and Analysis: This article is based on a literature review focusing on the institutionalization of evaluation and the development of evaluation systems. Particular attention is given to the Comparative Policy Evaluation series established by Ray Rist, which offers an interdisciplinary and internationally comparative body of work spanning over three decades. Drawing on this series, we examined how evaluation systems have been conceptualized, implemented, and critiqued over time and across diverse national settings. Findings: This article highlights that evaluation systems are shaped by contextual factors, institutional arrangements, and the contributions of key individuals. The effectiveness of these evaluation systems depends not only on organizational design but also on the capacity and engagement of evaluators, commissioners, and decision makers. The effective functioning of such systems fosters an environment favorable to evaluation, achieves a balance between supply and demand, and safeguards the independence and integrity of evaluation.
publishDate 2025
dc.date.none.fl_str_mv 2025
2025-05-25
2025
2025-05-25
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
AM
http://purl.org/coar/version/c_ab4af688f83e57aa
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/20.500.14352/130916
url https://hdl.handle.net/20.500.14352/130916
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Western Michigan University
publisher.none.fl_str_mv Western Michigan University
dc.source.none.fl_str_mv reponame:Docta Complutense
instname:Universidad Complutense de Madrid (UCM)
instname_str Universidad Complutense de Madrid (UCM)
reponame_str Docta Complutense
collection Docta Complutense
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869411550350016512
score 15.812429