A Systematic Evaluation Method of Graph-Derived Signals for Tabular Machine Learning

While graph-derived signals are widely used in tabular learning, existing studies typically rely on limited experimental setups and average performance comparisons, leaving the statistical reliability and robustness of observed gains largely unexplored. Consequently, it remains unclear which signals...

ver descrição completa

Detalhes bibliográficos
Autores: Heidrich, Mario, Heidemann, Jeffrey, Buchkremer, Rüdiger, Wandosell Fernández de Bobadilla, Gonzalo
Tipo de documento: artigo
Data de publicação:2026
País:España
Recursos:Universidad Católica San Antonio de Murcia (UCAM)
Repositório:RIUCAM. Repositorio Institucional de la Universidad Católica San Antonio de Murcia
OAI Identifier:oai:dnet:riucam______::6f58693f30ae522db3158c1b0ef99bb0
Acesso em linha:http://hdl.handle.net/10952/10930
Access Level:Acceso aberto
Palavra-chave:Graph-derived signals
Tabular machine learning
Graph signal taxonomy
Statistical significance
Robustness analysis
Fraud detection
Descrição
Resumo:While graph-derived signals are widely used in tabular learning, existing studies typically rely on limited experimental setups and average performance comparisons, leaving the statistical reliability and robustness of observed gains largely unexplored. Consequently, it remains unclear which signals provide consistent and robust improvements. This paper presents a taxonomy-driven empirical analysis of graph-derived signals for tabular machine learning. We propose a unified and reproducible evaluation method to systematically assess which categories of graph-derived signals yield statistically significant and robust performance improvements. The method provides an extensible setup for the controlled integration of diverse graph-derived signals into tabular learning pipelines. To ensure a fair and rigorous comparison, it incorporates automated hyperparameter optimization, multi-seed statistical evaluation, formal significance testing, and robustness analysis under graph perturbations. We demonstrate the applicability of the method through an extensive case study on a large-scale, imbalanced cryptocurrency fraud detection dataset. The analysis identifies signal categories providing consistently reliable performance gains and offers interpretable insights into which graph-derived signals indicate fraud-discriminative structural patterns. Furthermore, robustness analyses reveal pronounced differences in how various signals handle missing or corrupted relational data. These findings demonstrate the proposed taxonomy-driven evaluation method’s practical utility for fraud detection and illustrate how it can be applied in other application domains.