Feedback that Lands: Exploring How Residents Receive and Judge Feedback During Entrustable Professional Activities. 2023

Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
Oakville Trafalgar Memorial Hospital, Oakville, Ontario, Canada.

Receiving feedback from different types of assessors (e.g., senior residents, staff supervisors) may impact trainees' perceptions of the quantity and quality of data during entrustable professional activity (EPA) assessments. We evaluated the quality of EPA feedback provided by different assessors (senior residents, chief medical residents/subspecialty residents, and staff) and explored residents' judgements of the value of this feedback. From a database of 2228 EPAs, we calculated the frequency of contribution from three assessor groups. We appraised the quality of 60 procedure-related EPAs completed between July 2019 and March 2020 using a modified Completed Clinical Evaluation Report Rating (CCERR) tool. Next, we asked 15 internal medicine residents to sort randomly selected EPAs according to their judgements of value, as an elicitation exercise before a semi-structured interview. Interviews explored participants' perceptions of quality of written feedback and helpful assessors. Residents completed over 60% of EPA assessments. We found no difference in modified-CCERR scores between the three groups. When judging EPA feedback value, residents described a process of weighted deliberation, considering perceived assessor characteristics (e.g., credibility, experience with EPA system), actionable written comments, and their own self-assessment. Like other recent studies, we found that residents contributed most to procedure-related EPA assessments. To the established list of factors influencing residents' judgements of feedback value, we add assessors' adherence to, and their shared experiences of being assessed within, EPA assessment systems. We focus on the implications for how assessors and leaders can build credibility in themselves and in the practices of EPA assessments.

UI MeSH Term Description Entries
D007396 Internship and Residency Programs of EDUCATION, MEDICAL, GRADUATE training to meet the requirements established by accrediting authorities. House Staff,Internship, Dental,Residency, Dental,Residency, Medical,Dental Internship,Dental Internships,Dental Residencies,Dental Residency,Internship,Internship, Medical,Internships, Dental,Medical Residencies,Medical Residency,Residencies, Dental,Residencies, Medical,Residency,Residency and Internship,Internships, Medical,Medical Internship,Medical Internships,Residencies,Staff, House
D007600 Judgment The process of discovering or asserting an objective or intrinsic relation between two objects or concepts; a faculty or power that enables a person to make judgments; the process of bringing to light and asserting the implicit meaning of a concept; a critical evaluation of a person or situation. Judgement,Judgements,Judgments
D002983 Clinical Competence The capability to perform acceptably those duties directly related to patient care. Clinical Skills,Competence, Clinical,Clinical Competency,Clinical Skill,Competency, Clinical,Skill, Clinical,Skills, Clinical,Clinical Competencies,Competencies, Clinical
D003162 Competency-Based Education Educational programs designed to ensure that students attain prespecified levels of competence in a given field or training activity. Emphasis is on achievement or specified objectives. Education, Competency-Based,Competency Based Education,Competency-Based Educations,Education, Competency Based,Educations, Competency-Based
D005246 Feedback A mechanism of communication within a system in that the input signal generates an output response which returns to influence the continued activity or productivity of that system. Feedbacks
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man

Related Publications

Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
February 2020, Journal of cancer education : the official journal of the American Association for Cancer Education,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
November 2021, Pediatrics,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
September 2023, BMC medical education,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
January 2020, Journal of surgical education,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
January 2016, Education for primary care : an official publication of the Association of Course Organisers, National Association of GP Tutors, World Organisation of Family Doctors,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
August 2015, The clinical teacher,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
September 2023, Medical teacher,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
October 2019, Clinical orthopaedics and related research,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
January 2022, Global surgical education : journal of the Association for Surgical Education,
Natasha Sheikh, and Joshua Mehta, and Rupal Shah, and Ryan Brydges
May 2022, Journal of the American College of Surgeons,
Copied contents to your clipboard!