Evaluating training of screening, brief intervention, and referral to treatment (SBIRT) for substance use: Reliability of the MD3 SBIRT Coding Scale. 2015

Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
Department of Psychology.

Screening, brief intervention, and referral to treatment (SBIRT) has become an empirically supported and widely implemented approach in primary and specialty care for addressing substance misuse. Accordingly, training of providers in SBIRT has increased exponentially in recent years. However, the quality and fidelity of training programs and subsequent interventions are largely unknown because of the lack of SBIRT-specific evaluation tools. The purpose of this study was to create a coding scale to assess quality and fidelity of SBIRT interactions addressing alcohol, tobacco, illicit drugs, and prescription medication misuse. The scale was developed to evaluate performance in an SBIRT residency training program. Scale development was based on training protocol and competencies with consultation from Motivational Interviewing coding experts. Trained medical residents practiced SBIRT with standardized patients during 10- to 15-min videotaped interactions. This study included 25 tapes from the Family Medicine program coded by 3 unique coder pairs with varying levels of coding experience. Interrater reliability was assessed for overall scale components and individual items via intraclass correlation coefficients. Coder pair-specific reliability was also assessed. Interrater reliability was excellent overall for the scale components (>.85) and nearly all items. Reliability was higher for more experienced coders, though still adequate for the trained coder pair. Descriptive data demonstrated a broad range of adherence and skills. Subscale correlations supported concurrent and discriminant validity. Data provide evidence that the MD3 SBIRT Coding Scale is a psychometrically reliable coding system for evaluating SBIRT interactions and can be used to evaluate implementation skills for fidelity, training, assessment, and research. Recommendations for refinement and further testing of the measure are discussed. (PsycINFO Database Record

UI MeSH Term Description Entries
D007396 Internship and Residency Programs of EDUCATION, MEDICAL, GRADUATE training to meet the requirements established by accrediting authorities. House Staff,Internship, Dental,Residency, Dental,Residency, Medical,Dental Internship,Dental Internships,Dental Residencies,Dental Residency,Internship,Internship, Medical,Internships, Dental,Medical Residencies,Medical Residency,Residencies, Dental,Residencies, Medical,Residency,Residency and Internship,Internships, Medical,Medical Internship,Medical Internships,Residencies,Staff, House
D008297 Male Males
D008403 Mass Screening Organized periodic procedures performed on large groups of people for the purpose of detecting disease. Screening,Mass Screenings,Screening, Mass,Screenings,Screenings, Mass
D010349 Patient Compliance Voluntary cooperation of the patient in following a prescribed regimen. Client Adherence,Client Compliance,Non-Adherent Patient,Patient Adherence,Patient Cooperation,Patient Noncompliance,Patient Non-Adherence,Patient Non-Compliance,Patient Nonadherence,Therapeutic Compliance,Treatment Compliance,Adherence, Client,Adherence, Patient,Client Compliances,Compliance, Client,Compliance, Patient,Compliance, Therapeutic,Compliance, Treatment,Cooperation, Patient,Non Adherent Patient,Non-Adherence, Patient,Non-Adherent Patients,Non-Compliance, Patient,Nonadherence, Patient,Noncompliance, Patient,Patient Non Adherence,Patient Non Compliance,Patient, Non-Adherent,Therapeutic Compliances,Treatment Compliances
D010817 Physician-Patient Relations The interactions between physician and patient. Doctor-Patient Relations,Doctor Patient Relations,Physician Patient Relations,Physician Patient Relationship,Doctor Patient Relation,Doctor-Patient Relation,Physician Patient Relation,Physician Patient Relationships,Physician-Patient Relation,Relation, Doctor Patient,Relation, Doctor-Patient,Relation, Physician Patient,Relation, Physician-Patient,Relations, Doctor Patient,Relations, Doctor-Patient,Relations, Physician Patient,Relations, Physician-Patient,Relationship, Physician Patient,Relationships, Physician Patient
D011614 Psychotherapy, Brief Any form of psychotherapy designed to produce therapeutic change within a minimal amount of time, generally not more than 20 sessions. Short-Term Psychotherapy,Brief Psychotherapy,Psychotherapy, Short-Term,Solution-Focused Brief Therapy,Brief Psychotherapies,Brief Therapies, Solution-Focused,Brief Therapy, Solution-Focused,Psychotherapies, Brief,Psychotherapies, Short-Term,Psychotherapy, Short Term,Short Term Psychotherapy,Short-Term Psychotherapies,Solution Focused Brief Therapy,Solution-Focused Brief Therapies,Therapies, Solution-Focused Brief,Therapy, Solution-Focused Brief
D012017 Referral and Consultation The practice of sending a patient to another program or practitioner for services or advice which the referring source is not prepared to provide. Consultation,Gatekeepers, Health Service,Hospital Referral,Second Opinion,Consultation and Referral,Health Service Gatekeepers,Hospital Referrals,Referral,Referral, Hospital,Referrals, Hospital,Consultations,Gatekeeper, Health Service,Health Service Gatekeeper,Opinion, Second,Opinions, Second,Referrals,Second Opinions
D002983 Clinical Competence The capability to perform acceptably those duties directly related to patient care. Clinical Skills,Competence, Clinical,Clinical Competency,Clinical Skill,Competency, Clinical,Skill, Clinical,Skills, Clinical,Clinical Competencies,Competencies, Clinical
D003479 Curriculum A course of study offered by an educational institution. Curricula,Short-Term Courses,Course, Short-Term,Courses, Short-Term,Short Term Courses,Short-Term Course
D005194 Family Practice A medical specialty concerned with the provision of continuing, comprehensive primary health care for the entire family. Family Practices,Practice, Family,Practices, Family

Related Publications

Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
April 2020, Maternal and child health journal,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
July 2016, Pediatrics,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
July 2016, Pediatrics,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
January 2019, Advances in medical education and practice,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
September 2018, The Journal of adolescent health : official publication of the Society for Adolescent Medicine,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
January 2012, Substance abuse,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
November 2012, The American journal on addictions,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
September 2015, Nihon rinsho. Japanese journal of clinical medicine,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
November 2011, Pediatrics,
Carlo C DiClemente, and Taylor Berens Crouch, and Amber E Q Norwood, and Janine Delahanty, and Christopher Welsh
January 2015, Substance abuse,
Copied contents to your clipboard!