An objective structured clinical examination for evaluating psychiatric clinical clerks. 1997

B Hodges, and G Regehr, and M Hanson, and N McNaughton
Department of Psychiatry, University of Toronto Faculty of Medicine, Ontario, Canada. brian.hodges@utoronto.ca

OBJECTIVE To assess the feasibility, reliability, and validity of an objective structured clinical examination (OSCE) for psychiatric clinical clerks. METHODS In 1995 two parallel forms of a ten-station OSCE (eight clinical stations, two writing stations) were developed at the University of Toronto Faculty of Medicine Each 12-minute performance-based clinical station was assessed by a faculty psychiatrist using both a checklist for each student's performance content and a global-rating scale of the performance process. The students' clinical-station scores were calculated as the average of their content and process scores (expressed as percentages). Examiners also recorded an overall judgment of each students' performance (pass, borderline, or fail) and wrote [in collaboration with the standardized patient (SP) at that station] comments on each student's performance. There were two criteria for a passing grade: a total mark of 60% or higher across all ten stations and a "pass" or "borderline" mark in at least five of the eight clinical stations. Each OSCE form was administered three times. RESULTS The first form was used to examine 94 clerks, the second form to examine 98 clerks. The students' mean scores for the two forms were 70.47% (SD, 6.33%) and 67.66% (SD, 7.05%), respectively. In addition to the standard evaluation information collected on the students, several critical incidents occurred (e.g., a student's loss of control of emotions) that may identify potential problems in professional conduct. The direct cost for one administration of the examination was approximately Can$3,300: the largest portion of this was for the SPs' time spent in training and performing their roles. CONCLUSIONS Preliminary evidence suggests that a psychiatry OSCE is feasible for assessing complex psychiatric skills. However, careful attention must be paid to SP training, examination monitoring, detection of critical incidents, and provision of feedback to students, faculty, and SPs. The university's previous system of oral examinations required approximately 600 faculty hours per year. The OSCE requires approximately 450 faculty hours, and the 150 hours saved almost cover the Can$20,000 that the examination costs each year. In all, the OSCE is an evaluation system that has demonstrable reliability and is more enjoyable for both the faculty and the students.

UI MeSH Term Description Entries
D009864 Ontario A province of Canada lying between the provinces of Manitoba and Quebec. Its capital is Toronto. It takes its name from Lake Ontario which is said to represent the Iroquois oniatariio, beautiful lake. (From Webster's New Geographical Dictionary, 1988, p892 & Room, Brewer's Dictionary of Names, 1992, p391)
D011570 Psychiatry The medical science that deals with the origin, diagnosis, prevention, and treatment of mental disorders.
D002982 Clinical Clerkship Undergraduate education programs for second- , third- , and fourth-year students in health sciences in which the students receive clinical training and experience in teaching hospitals or affiliated health centers. Clerkship, Clinical,Clerkships, Clinical,Clinical Apprenticeship,Clinical Clerkships,Apprenticeship, Clinical,Apprenticeships, Clinical,Clinical Apprenticeships
D003365 Costs and Cost Analysis Absolute, comparative, or differential costs pertaining to services, institutions, resources, etc., or the analysis and study of these costs. Affordability,Analysis, Cost,Cost,Cost Analysis,Cost Comparison,Cost Measures,Cost-Minimization Analysis,Costs and Cost Analyses,Costs, Cost Analysis,Pricing,Affordabilities,Analyses, Cost,Analyses, Cost-Minimization,Analysis, Cost-Minimization,Comparison, Cost,Comparisons, Cost,Cost Analyses,Cost Comparisons,Cost Measure,Cost Minimization Analysis,Cost, Cost Analysis,Cost-Minimization Analyses,Costs,Measure, Cost,Measures, Cost
D004521 Educational Measurement The assessing of academic or educational achievement. It includes all aspects of testing and test construction. Assessment, Educational,Graduate Records Examination,Educational Assessment,Examination, Graduate Records,Measurement, Educational,Assessments, Educational,Educational Assessments,Educational Measurements,Examinations, Graduate Records,Graduate Records Examinations,Measurements, Educational
D005240 Feasibility Studies Studies to determine the advantages or disadvantages, practicability, or capability of accomplishing a projected plan, study, or project. Feasibility Study,Studies, Feasibility,Study, Feasibility
D015203 Reproducibility of Results The statistical reproducibility of measurements (often in a clinical context), including the testing of instrumentation or techniques to obtain reproducible results. The concept includes reproducibility of physiological measurements, which may be used to develop rules to assess probability or prognosis, or response to a stimulus; reproducibility of occurrence of a condition; and reproducibility of experimental results. Reliability and Validity,Reliability of Result,Reproducibility Of Result,Reproducibility of Finding,Validity of Result,Validity of Results,Face Validity,Reliability (Epidemiology),Reliability of Results,Reproducibility of Findings,Test-Retest Reliability,Validity (Epidemiology),Finding Reproducibilities,Finding Reproducibility,Of Result, Reproducibility,Of Results, Reproducibility,Reliabilities, Test-Retest,Reliability, Test-Retest,Result Reliabilities,Result Reliability,Result Validities,Result Validity,Result, Reproducibility Of,Results, Reproducibility Of,Test Retest Reliability,Validity and Reliability,Validity, Face
D016544 Patient Simulation The use of persons coached to feign symptoms or conditions of real diseases in a life-like manner in order to teach or evaluate medical personnel. Patient Simulations,Simulation, Patient,Simulations, Patient

Related Publications

B Hodges, and G Regehr, and M Hanson, and N McNaughton
December 1997, Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
May 1998, Family medicine,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
January 2015, Nursing education perspectives,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
May 2017, Journal de medecine vasculaire,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
February 2008, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
May 2000, European urology,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
November 1993, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
August 1981, Harefuah,
B Hodges, and G Regehr, and M Hanson, and N McNaughton
July 1998, The Journal of the Association of Physicians of India,
Copied contents to your clipboard!