Biomaterial Database

Measuring integrity and fidelity of program implementation: Validating an instrument designed for school renewal. 2023

Xin Ma, and Jianping Shen, and Patricia Reeves

Department of Educational, School, and Counseling Psychology, University of Kentucky, USA. Electronic address: xin.ma@uky.edu.

In this study, we attempted to explore with instrumentation that could provide a good means to measure integrity and fidelity of program implementation. The instrument, High Integrity and Fidelity Implementation for School Renewal, was created using a comprehensive review of the literature to provide insights into the implementation integrity and fidelity when principals renew a school. Data from 1097 teachers were used to examine the instrument for construct validity by means of factorial validity and convergent validity. We used confirmatory factor analysis to compared five factorial structures of the instrument, resulting in the identification of a four-factor structure (coming from the comprehensive review of the literature) as the best fitting structure to the data. Strong convergent validity of the instrument was confirmed by correlating the instrument with a psychometrically established instrument measuring a similar construct. Finally, McDonald's Omega indicated strong internal consistency of the instrument in our reliability analysis.

UI	MeSH Term	Description	Entries
D011594	Psychometrics	Assessment of psychological variables by the application of mathematical procedures.	Psychometric
D011795	Surveys and Questionnaires	Collections of data obtained from voluntary subjects. The information usually takes the form of answers to questions, or suggestions.	Community Survey,Nonrespondent,Questionnaire,Questionnaires,Respondent,Survey,Survey Method,Survey Methods,Surveys,Baseline Survey,Community Surveys,Methodology, Survey,Nonrespondents,Questionnaire Design,Randomized Response Technique,Repeated Rounds of Survey,Respondents,Survey Methodology,Baseline Surveys,Design, Questionnaire,Designs, Questionnaire,Methods, Survey,Questionnaire Designs,Questionnaires and Surveys,Randomized Response Techniques,Response Technique, Randomized,Response Techniques, Randomized,Survey, Baseline,Survey, Community,Surveys, Baseline,Surveys, Community,Techniques, Randomized Response
D005163	Factor Analysis, Statistical	A set of statistical methods for analyzing the correlations among several variables in order to estimate the number of fundamental dimensions that underlie the observed data and to describe and measure those dimensions. It is used frequently in the development of scoring systems for rating scales and questionnaires.	Analysis, Factor,Analysis, Statistical Factor,Factor Analysis,Statistical Factor Analysis,Analyses, Factor,Analyses, Statistical Factor,Factor Analyses,Factor Analyses, Statistical,Statistical Factor Analyses
D006801	Humans	Members of the species Homo sapiens.	Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D015203	Reproducibility of Results	The statistical reproducibility of measurements (often in a clinical context), including the testing of instrumentation or techniques to obtain reproducible results. The concept includes reproducibility of physiological measurements, which may be used to develop rules to assess probability or prognosis, or response to a stimulus; reproducibility of occurrence of a condition; and reproducibility of experimental results.	Reliability and Validity,Reliability of Result,Reproducibility Of Result,Reproducibility of Finding,Validity of Result,Validity of Results,Face Validity,Reliability (Epidemiology),Reliability of Results,Reproducibility of Findings,Test-Retest Reliability,Validity (Epidemiology),Finding Reproducibilities,Finding Reproducibility,Of Result, Reproducibility,Of Results, Reproducibility,Reliabilities, Test-Retest,Reliability, Test-Retest,Result Reliabilities,Result Reliability,Result Validities,Result Validity,Result, Reproducibility Of,Results, Reproducibility Of,Test Retest Reliability,Validity and Reliability,Validity, Face
D015397	Program Evaluation	Studies designed to assess the efficacy of programs. They may include the evaluation of cost-effectiveness, the extent to which objectives are met, or impact.	Evaluation, Program,Family Planning Program Evaluation,Program Appropriateness,Program Effectiveness,Program Sustainability,Appropriateness, Program,Effectiveness, Program,Evaluations, Program,Program Evaluations,Program Sustainabilities,Sustainabilities, Program,Sustainability, Program