Evaluation of inherent performance of intelligent medical decision support systems: utilising neural networks as an example. 2003

A E Smith, and C D Nugent, and S I McClean
Medical Informatics, Faculty of Informatics, University of Ulster, Jordanstown, Newtownabbey, BT37 0QB, Northern Ireland, Antrim, UK. ae.smith@ulst.ac.uk

Researchers who design intelligent systems for medical decision support, are aware of the need for response to real clinical issues, in particular the need to address the specific ethical problems that the medical domain has in using black boxes. This means such intelligent systems have to be thoroughly evaluated, for acceptability. Attempts at compliance, however, are hampered by lack of guidelines. This paper addresses the issue of inherent performance evaluation, which researchers have addressed in part, but a Medline search, using neural networks as an example of intelligent systems, indicated that only about 12.5% evaluated inherent performance adequately. This paper aims to address this issue by concentrating on the possible evaluation methodology, giving a framework and specific suggestions for each type of classification problem. This should allow the developers of intelligent systems to produce evidence of a sufficiency of output performance evaluation.

UI MeSH Term Description Entries
D003658 Decision Making, Computer-Assisted Use of an interactive computer system designed to assist the physician or other health professional in choosing between certain relationships or variables for the purpose of making a diagnostic or therapeutic decision. Computer-Assisted Decision Making,Medical Decision Making, Computer-Assisted,Computer Assisted Decision Making,Decision Making, Computer Assisted,Medical Decision Making, Computer Assisted
D001185 Artificial Intelligence Theory and development of COMPUTER SYSTEMS which perform tasks that normally require human intelligence. Such tasks may include speech recognition, LEARNING; VISUAL PERCEPTION; MATHEMATICAL COMPUTING; reasoning, PROBLEM SOLVING, DECISION-MAKING, and translation of language. AI (Artificial Intelligence),Computer Reasoning,Computer Vision Systems,Knowledge Acquisition (Computer),Knowledge Representation (Computer),Machine Intelligence,Computational Intelligence,Acquisition, Knowledge (Computer),Computer Vision System,Intelligence, Artificial,Intelligence, Computational,Intelligence, Machine,Knowledge Representations (Computer),Reasoning, Computer,Representation, Knowledge (Computer),System, Computer Vision,Systems, Computer Vision,Vision System, Computer,Vision Systems, Computer
D015233 Models, Statistical Statistical formulations or analyses which, when applied to data and found to fit the data, are then used to verify the assumptions and parameters used in the analysis. Examples of statistical models are the linear model, binomial model, polynomial model, two-parameter model, etc. Probabilistic Models,Statistical Models,Two-Parameter Models,Model, Statistical,Models, Binomial,Models, Polynomial,Statistical Model,Binomial Model,Binomial Models,Model, Binomial,Model, Polynomial,Model, Probabilistic,Model, Two-Parameter,Models, Probabilistic,Models, Two-Parameter,Polynomial Model,Polynomial Models,Probabilistic Model,Two Parameter Models,Two-Parameter Model
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron
D020000 Decision Support Systems, Clinical Computer-based information systems used to integrate clinical and patient information and provide support for decision-making in patient care. Clinical Decision Support System,Clinical Decision Support Systems,Clinical Decision Support,Decision Support, Clinical,Clinical Decision Supports,Decision Supports, Clinical,Support, Clinical Decision,Supports, Clinical Decision

Related Publications

A E Smith, and C D Nugent, and S I McClean
January 1994, Scandinavian journal of clinical and laboratory investigation. Supplementum,
A E Smith, and C D Nugent, and S I McClean
August 2000, Clinical and investigative medicine. Medecine clinique et experimentale,
A E Smith, and C D Nugent, and S I McClean
January 2015, Studies in health technology and informatics,
A E Smith, and C D Nugent, and S I McClean
November 2008, Artificial intelligence in medicine,
A E Smith, and C D Nugent, and S I McClean
January 2005, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference,
A E Smith, and C D Nugent, and S I McClean
April 2001, Medical engineering & physics,
A E Smith, and C D Nugent, and S I McClean
January 1993, Medical informatics = Medecine et informatique,
A E Smith, and C D Nugent, and S I McClean
January 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium,
A E Smith, and C D Nugent, and S I McClean
May 1998, Journal of dentistry,
A E Smith, and C D Nugent, and S I McClean
January 2010, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Copied contents to your clipboard!