Autoencoders for semi-supervised water level modeling in sewer pipes with sparse labeled data

More frequent and thorough inspection of sewer pipes has the potential to save billions in utilities. However, the amount and quality of inspection are impeded by an imprecise and highly subjective manual process. It involves technicians judging stretches of sewer based on video from remote-controll...

Descripción completa

Detalles Bibliográficos
Autores: Plana Rius, Ferran, Philipsen, Mark P., Mirats Tur, Josep Maria, Moeslund, Thomas, Angulo Bahón, Cecilio|||0000-0001-9589-8199, Casas, Marc|||0000-0003-4564-2093
Tipo de recurso: artículo
Fecha de publicación:2022
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/363386
Acceso en línea:https://hdl.handle.net/2117/363386
https://dx.doi.org/10.3390/w14030333
Access Level:acceso abierto
Palabra clave:Supervised learning (Machine learning)
Water-pipes
Self-supervised
Semi-supervised
Supervised
Autoencoders and latent space
Sparse data
Data distribution
Water
Aprenentatge supervisat (Aprenentatge automàtic)
Aigua -- Canonades
Àrees temàtiques de la UPC::Informàtica::Robòtica
Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Aprenentatge automàtic
Descripción
Sumario:More frequent and thorough inspection of sewer pipes has the potential to save billions in utilities. However, the amount and quality of inspection are impeded by an imprecise and highly subjective manual process. It involves technicians judging stretches of sewer based on video from remote-controlled robots. Determining the state of sewer pipes based on these videos entails a great deal of ambiguity. Furthermore, the frequency with which the different defects occur differs a lot, leading to highly imbalanced datasets. Such datasets represent a poor basis for automating the labeling process using supervised learning. With this paper we explore the potential of self-supervision as a method for reducing the need for large numbers of well-balanced labels. First, our models learn to represent the data distribution using more than a million unlabeled images, then a small number of labeled examples are used to learn a mapping from the learned representations to a relevant target variable, in this case, water level. We choose a convolutional Autoencoder, a Variational Autoencoder and a Vector-Quantised Variational Autoencoder as the basis for our experiments. The best representations are shown to be learned by the classic Autoencoder with the Multi-Layer Perceptron achieving a Mean Absolute Error of 9.93. This is an improvement of 9.62 over the fully supervised baseline.