On the problem of evaluating the performance of multiprogrammed workloads

Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A methodology defines when the measurements for a given workload execution are taken. A metric combines those measurements to obtain a final eval...

Descripción completa

Detalles Bibliográficos
Autores: Cazorla, Francisco, Pajuelo González, Manuel Alejandro|||0000-0002-5510-6860, Santana Jaria, Oliverio J., Fernández Rodríguez, José Enrique, Valero Cortés, Mateo|||0000-0003-2917-2482
Tipo de recurso: artículo
Fecha de publicación:2010
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/106196
Acceso en línea:https://hdl.handle.net/2117/106196
https://dx.doi.org/10.1109/TC.2010.62
Access Level:acceso abierto
Palabra clave:Simultaneous multithreading processors
Microprocessors -- Design and construction
Multithreaded processors
Multiprogrammed workloads
Evaluation methodologies
Microprocessadors -- Disseny i construcció
Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors
Descripción
Sumario:Multithreaded architectures are becoming more and more popular. In order to evaluate their behavior, several methodologies and metrics have been proposed. A methodology defines when the measurements for a given workload execution are taken. A metric combines those measurements to obtain a final evaluation result. However, since current evaluation methodologies do not provide representative measurements for these metrics, the analysis and evaluation of novel ideas could be either unfair or misleading. Given the potential impact of multithreaded architectures on current and future processor designs, it is crucial to develop an accurate evaluation methodology for them. This paper presents FAME, a new evaluation methodology aimed to fairly measure the performance of multithreaded processors executing multiprogrammed workloads. FAME reexecutes all programs in the workload until all of them are fairly represented in the final measurements taken. We compare FAME with previously used methodologies showing that it provides more accurate measurements, becoming an ideal evaluation methodology to analyze proposals for multithreaded architectures.