An automatic deep reinforcement learning bolus calculator for automated insulin delivery systems

In hybrid automatic insulin delivery (HAID) systems, meal disturbance is compensated by feedforward control, which requires the announcement of the meal by the patient with type 1 diabetes (DM1) to achieve the desired glycemic control performance. The calculation of insulin bolus in the HAID system...

Descripción completa

Detalles Bibliográficos
Autores: Ahmad, Sayyar, Beneyto Tantiña, Aleix, Zhu, Taiyu, Contreras, Ivan, Georgiou, Pantelis, Vehí, Josep
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10256/25088
Acceso en línea:http://hdl.handle.net/10256/25088
Access Level:acceso abierto
Palabra clave:Control automàtic
Enginyeria biomèdica
Automatic control
Biomedical engineering
Control intel·ligent
Intelligent control systems
Pàncrees artificial
Artificial Pancreas
Intel·ligència artificial -- Aplicacions a la medicina
Artificial intelligence -- Medical applications
Aprenentatge per reforç
Reinforcement learning
Descripción
Sumario:In hybrid automatic insulin delivery (HAID) systems, meal disturbance is compensated by feedforward control, which requires the announcement of the meal by the patient with type 1 diabetes (DM1) to achieve the desired glycemic control performance. The calculation of insulin bolus in the HAID system is based on the amount of carbohydrates (CHO) in the meal and patient-specific parameters, i.e. carbohydrate-to-insulin ratio (CR) and insulin sensitivity-related correction factor (CF). The estimation of CHO in a meal is prone to errors and is burdensome for patients. This study proposes a fully automatic insulin delivery (FAID) system that eliminates patient intervention by compensating for unannounced meals. This study exploits the deep reinforcement learning (DRL) algorithm to calculate insulin bolus for unannounced meals without utilizing the information on CHO content. The DRL bolus calculator is integrated with a closed-loop controller and a meal detector (both previously developed by our group) to implement the FAID system. An adult cohort of 68 virtual patients based on the modified UVa/Padova simulator was used for in-silico trials. The percentage of the overall duration spent in the target range of 70-180 mg/dL was 71.2% and 76.2%, < 70 mg/dL was 0.9% and 0.1%, and > 180 mg/dL was 26.7% and 21.1%, respectively, for the FAID system and HAID system utilizing a standard bolus calculator (SBC) including CHO misestimation. The proposed algorithm can be exploited to realize FAID systems in the future