High-Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the “curse of dimensionality” states: many problems become exponentially difficult in high dimensio...

Descripción completa

Detalles Bibliográficos
Autores: Gorban, Alexander N., Makarov Slizneva, Valeriy, Tyukin, Ivan Y.
Tipo de recurso: artículo
Fecha de publicación:2020
País:España
Institución:Universidad Complutense de Madrid (UCM)
Repositorio:Docta Complutense
Idioma:inglés
OAI Identifier:oai:docta.ucm.es:20.500.14352/7496
Acceso en línea:https://hdl.handle.net/20.500.14352/7496
Access Level:acceso abierto
Palabra clave:004.8
Artificial intelligence
Mistake correction
Concentration of measure
Discriminant
Data mining
geometry
Inteligencia artificial (Informática)
Cibernética matemática
Geometría
Investigación operativa (Matemáticas)
1203.04 Inteligencia Artificial
1207.03 Cibernética
1204 Geometría
1207 Investigación Operativa
Descripción
Sumario:High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the “curse of dimensionality” states: many problems become exponentially difficult in high dimensions. Recently, the other side of the coin, the “blessing of dimensionality”, has attracted much attention. It turns out that generic high-dimensional datasets exhibit fairly simple geometric properties. Thus, there is a fundamental tradeoff between complexity and simplicity in high dimensional spaces. Here we present a brief explanatory review of recent ideas, results and hypotheses about the blessing of dimensionality and related simplifying effects relevant to machine learning and neuroscience.