Biomaterial Database

Inter-observer and intra-observer variability in hepatology. 2003

Betsy Winkfield, and Christophe Aubé, and Pascal Burtin, and Paul Calès

Department of Hepatogastroenterology, University Hospital and University, Angers, France.

OBJECTIVE A determination of the inter-observer variability is an important step before determining diagnostic accuracy and requires a specific methodology and statistical tests. The aim of this study was to report the results, characteristics and methodological quality of agreement studies performed in hepatology. METHODS A search of published studies yielded 42 that could be used in this evaluation: three were clinical studies, 11 were in the field of endoscopy, 12 in histopathology and 16 in radiology. The studies were described with a grid of 28 items and evaluated with a quality score (QUAS; maximum, 35) including 22 items. RESULTS The following agreement level was noted: intra-observer > inter-observer > inter-centre. The following signs had good agreement. Endoscopy: size and red signs of oesophageal varices; histopathology: cirrhosis, fibrosis and steatosis; Doppler: mean portal vein and superior mesenteric artery velocities, hepatic artery area and perfusion indexes. Frequent methodological weaknesses were noted. The real agreement (such as the kappa index excluding chance), and the prevalence of signs and biases were rarely assessed. Standardized observations (67% of the studies), blind assessment (48%), simultaneous observations (7%), and the recording technique were not frequently used. The mean QUAS was 13 +/- 6 with 17 +/- 4 in histopathology versus 11 +/- 6 in radiology (P < 0.05). Using multiple regression, four variables independently predicted the QUAS with R2 = 0.77: adapted tests, multiple observations, intra-class correlation coefficient and agreement proportion. CONCLUSIONS Methodology was often insufficient. Agreement is often measured under biased conditions. Some areas were not or were rarely studied, e.g., biology and ultrasound. The agreement and QUAS were often poor, suggesting the need for studies with improved observation and methodological quality of agreement.

UI	MeSH Term	Description	Entries
D008103	Liver Cirrhosis	Liver disease in which the normal microcirculation, the gross vascular anatomy, and the hepatic architecture have been variably destroyed and altered with fibrous septa surrounding regenerated or regenerating parenchymal nodules.	Cirrhosis, Liver,Fibrosis, Liver,Hepatic Cirrhosis,Liver Fibrosis,Cirrhosis, Hepatic
D008107	Liver Diseases	Pathological processes of the LIVER.	Liver Dysfunction,Disease, Liver,Diseases, Liver,Dysfunction, Liver,Dysfunctions, Liver,Liver Disease,Liver Dysfunctions
D012106	Research	Critical and exhaustive investigation or experimentation, having for its aim the discovery of new facts and their correct interpretation, the revision of accepted conclusions, theories, or laws in the light of newly discovered facts, or the practical application of such new or revised conclusions, theories, or laws. (Webster, 3d ed)	Research Priorities,Laboratory Research,Research Activities,Research and Development,Activities, Research,Activity, Research,Development and Research,Priorities, Research,Priority, Research,Research Activity,Research Priority,Research, Laboratory
D012107	Research Design	A plan for collecting and utilizing data so that desired information can be obtained with sufficient precision or so that an hypothesis can be tested properly.	Experimental Design,Data Adjustment,Data Reporting,Design, Experimental,Designs, Experimental,Error Sources,Experimental Designs,Matched Groups,Methodology, Research,Problem Formulation,Research Methodology,Research Proposal,Research Strategy,Research Technics,Research Techniques,Scoring Methods,Adjustment, Data,Adjustments, Data,Data Adjustments,Design, Research,Designs, Research,Error Source,Formulation, Problem,Formulations, Problem,Group, Matched,Groups, Matched,Matched Group,Method, Scoring,Methods, Scoring,Problem Formulations,Proposal, Research,Proposals, Research,Reporting, Data,Research Designs,Research Proposals,Research Strategies,Research Technic,Research Technique,Scoring Method,Source, Error,Sources, Error,Strategies, Research,Strategy, Research,Technic, Research,Technics, Research,Technique, Research,Techniques, Research
D004932	Esophageal and Gastric Varices	Dilated blood vessels in the ESOPHAGUS or GASTRIC FUNDUS that shunt blood from the portal circulation (PORTAL SYSTEM) to the systemic venous circulation. Often they are observed in individuals with portal hypertension (HYPERTENSION, PORTAL).	Esophageal Varices,Gastric Varices,Esophageal Varix,Gastric Varix,Varices, Esophageal,Varices, Gastric,Varix, Esophageal,Varix, Gastric
D005234	Fatty Liver	Lipid infiltration of the hepatic parenchymal cells resulting in a yellow-colored liver. The abnormal lipid accumulation is usually in the form of TRIGLYCERIDES, either as a single large droplet or multiple small droplets. Fatty liver is caused by an imbalance in the metabolism of FATTY ACIDS.	Liver Steatosis,Steatohepatitis,Steatosis of Liver,Visceral Steatosis,Liver Steatoses,Liver, Fatty,Steatohepatitides,Steatoses, Liver,Steatoses, Visceral,Steatosis, Liver,Steatosis, Visceral,Visceral Steatoses
D006801	Humans	Members of the species Homo sapiens.	Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D013223	Statistics as Topic	Works about the science and art of collecting, summarizing, and analyzing data that are subject to random variation.	Area Analysis,Estimation Technics,Estimation Techniques,Indirect Estimation Technics,Indirect Estimation Techniques,Multiple Classification Analysis,Service Statistics,Statistical Study,Statistics, Service,Tables and Charts as Topic,Analyses, Area,Analyses, Multiple Classification,Area Analyses,Classification Analyses, Multiple,Classification Analysis, Multiple,Estimation Technic, Indirect,Estimation Technics, Indirect,Estimation Technique,Estimation Technique, Indirect,Estimation Techniques, Indirect,Indirect Estimation Technic,Indirect Estimation Technique,Multiple Classification Analyses,Statistical Studies,Studies, Statistical,Study, Statistical,Technic, Indirect Estimation,Technics, Estimation,Technics, Indirect Estimation,Technique, Estimation,Technique, Indirect Estimation,Techniques, Estimation,Techniques, Indirect Estimation
D015203	Reproducibility of Results	The statistical reproducibility of measurements (often in a clinical context), including the testing of instrumentation or techniques to obtain reproducible results. The concept includes reproducibility of physiological measurements, which may be used to develop rules to assess probability or prognosis, or response to a stimulus; reproducibility of occurrence of a condition; and reproducibility of experimental results.	Reliability and Validity,Reliability of Result,Reproducibility Of Result,Reproducibility of Finding,Validity of Result,Validity of Results,Face Validity,Reliability (Epidemiology),Reliability of Results,Reproducibility of Findings,Test-Retest Reliability,Validity (Epidemiology),Finding Reproducibilities,Finding Reproducibility,Of Result, Reproducibility,Of Results, Reproducibility,Reliabilities, Test-Retest,Reliability, Test-Retest,Result Reliabilities,Result Reliability,Result Validities,Result Validity,Result, Reproducibility Of,Results, Reproducibility Of,Test Retest Reliability,Validity and Reliability,Validity, Face
D015588	Observer Variation	The failure by the observer to measure or identify a phenomenon accurately, which results in an error. Sources for this may be due to the observer's missing an abnormality, or to faulty technique resulting in incorrect test measurement, or to misinterpretation of the data. Two varieties are inter-observer variation (the amount observers vary from one another when reporting on the same material) and intra-observer variation (the amount one observer varies between observations when reporting more than once on the same material).	Bias, Observer,Interobserver Variation,Intraobserver Variation,Observer Bias,Inter-Observer Variability,Inter-Observer Variation,Interobserver Variability,Intra-Observer Variability,Intra-Observer Variation,Intraobserver Variability,Inter Observer Variability,Inter Observer Variation,Inter-Observer Variabilities,Inter-Observer Variations,Interobserver Variabilities,Interobserver Variations,Intra Observer Variability,Intra Observer Variation,Intra-Observer Variabilities,Intra-Observer Variations,Intraobserver Variabilities,Intraobserver Variations,Observer Variations,Variabilities, Inter-Observer,Variabilities, Interobserver,Variabilities, Intra-Observer,Variabilities, Intraobserver,Variability, Inter-Observer,Variability, Interobserver,Variability, Intra-Observer,Variability, Intraobserver,Variation, Inter-Observer,Variation, Interobserver,Variation, Intra-Observer,Variation, Intraobserver,Variation, Observer,Variations, Inter-Observer,Variations, Interobserver,Variations, Intra-Observer,Variations, Intraobserver,Variations, Observer