Biomaterial Database

Optimal adaptive control of drug dosing using integral reinforcement learning. 2019

Regina Padmanabhan, and Nader Meskin, and Wassim M Haddad

Department of Electrical Engineering, Qatar University, Qatar. Electronic address: regina.ajith@qu.edu.qa.

In this paper, a reinforcement learning (RL)-based optimal adaptive control approach is proposed for the continuous infusion of a sedative drug to maintain a required level of sedation. To illustrate the proposed method, we use the common anesthetic drug propofol used in intensive care units (ICUs). The proposed online integral reinforcement learning (IRL) algorithm is designed to provide optimal drug dosing for a given performance measure that iteratively updates the control solution with respect to the pharmacology of the patient while guaranteeing convergence to the optimal solution. Numerical results are presented using 10 simulated patients that demonstrate the efficacy of the proposed IRL-based controller.

UI	MeSH Term	Description	Entries
D007263	Infusions, Parenteral	The administration of liquid medication, nutrient, or other fluid through some other route than the alimentary canal, usually over minutes or hours, either by gravity flow or often by infusion pumping.	Intra-Abdominal Infusions,Intraperitoneal Infusions,Parenteral Infusions,Peritoneal Infusions,Infusion, Intra-Abdominal,Infusion, Intraperitoneal,Infusion, Parenteral,Infusion, Peritoneal,Infusions, Intra-Abdominal,Infusions, Intraperitoneal,Infusions, Peritoneal,Intra Abdominal Infusions,Intra-Abdominal Infusion,Intraperitoneal Infusion,Parenteral Infusion,Peritoneal Infusion
D008954	Models, Biological	Theoretical representations that simulate the behavior or activity of biological processes or diseases. For disease models in living animals, DISEASE MODELS, ANIMAL is available. Biological models include the use of mathematical equations, computers, and other electronic equipment.	Biological Model,Biological Models,Model, Biological,Models, Biologic,Biologic Model,Biologic Models,Model, Biologic
D003198	Computer Simulation	Computer-based representation of physical systems and phenomena such as chemical processes.	Computational Modeling,Computational Modelling,Computer Models,In silico Modeling,In silico Models,In silico Simulation,Models, Computer,Computerized Models,Computer Model,Computer Simulations,Computerized Model,In silico Model,Model, Computer,Model, Computerized,Model, In silico,Modeling, Computational,Modeling, In silico,Modelling, Computational,Simulation, Computer,Simulation, In silico,Simulations, Computer
D006801	Humans	Members of the species Homo sapiens.	Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000069550	Machine Learning	A type of ARTIFICIAL INTELLIGENCE that enable COMPUTERS to independently initiate and execute LEARNING when exposed to new data.	Transfer Learning,Learning, Machine,Learning, Transfer
D015742	Propofol	An intravenous anesthetic agent which has the advantage of a very rapid onset after infusion or bolus injection plus a very short recovery period of a couple of minutes. (From Smith and Reynard, Textbook of Pharmacology, 1992, 1st ed, p206). Propofol has been used as ANTICONVULSANTS and ANTIEMETICS.	Disoprofol,2,6-Bis(1-methylethyl)phenol,2,6-Diisopropylphenol,Aquafol,Diprivan,Disoprivan,Fresofol,ICI-35,868,ICI-35868,Ivofol,Propofol Abbott,Propofol Fresenius,Propofol MCT,Propofol Rovi,Propofol-Lipuro,Recofol,2,6 Diisopropylphenol,ICI 35,868,ICI 35868,ICI35,868,ICI35868
D054796	Drug Dosage Calculations	Math calculations done for preparing appropriate doses of medicines, taking into account conversions of WEIGHTS AND MEASURES. Mistakes are one of the sources of MEDICATION ERRORS.	Pharmaceutical Arithmetic,Pharmaceutical Calculations,Arithmetic, Pharmaceutical,Calculation, Drug Dosage,Calculation, Pharmaceutical,Calculations, Drug Dosage,Calculations, Pharmaceutical,Dosage Calculation, Drug,Dosage Calculations, Drug,Drug Dosage Calculation,Pharmaceutical Calculation
D018686	Anesthetics, Intravenous	Ultrashort-acting anesthetics that are used for induction. Loss of consciousness is rapid and induction is pleasant, but there is no muscle relaxation and reflexes frequently are not reduced adequately. Repeated administration results in accumulation and prolongs the recovery time. Since these agents have little if any analgesic activity, they are seldom used alone except in brief minor procedures. (From AMA Drug Evaluations Annual, 1994, p174)	Intravenous Anesthetic,Intravenous Anesthetics,Anesthetic, Intravenous