The Permutation Distancing Test for dependent single-case observational AB-phase design data: A Monte Carlo simulation study. 2024

Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
Department of Pediatric Rheumatology/Immunology, Wilhelmina Children's Hospital, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands.

The Permutation Distancing Test (PDT) is a nonparametric test for evaluating treatment effects in dependent single-case observational design (SCOD) AB-phase data without linear trends. Monte Carlo methods were used to estimate the PDT power and type I error rate, and to compare them to those of the Single-Case Randomization Test (SCRT) assuming a randomly determined intervention point and the traditional permutation test assuming full exchangeability. Data were simulated without linear trends for five treatment effect levels (- 2, - 1, 0, 1, 2), five autocorrelation levels (0, .15, .30, .45, .60), and four observation number levels (30, 60, 90, 120). The power was calculated multiple times for all combinations of factor levels each generating 1000 replications. With 30 observations, the PDT showed sufficient power (≥ 80%) to detect medium treatment effects up to autocorrelation ≤ .45. Using 60 observations, the PDT showed sufficient power to detect medium treatment effects regardless of autocorrelation. With ≥ 90 observations, the PDT could also detect small treatment effects up to autocorrelation ≤ .30. With 30 observations, the type I error rate was 5-7%. With 60 observations and more, the type I error rate was ≤ 5% with autocorrelation < .60. The PDT outperformed the SCRT regarding power, particularly with a small number of observations. The PDT outperformed the traditional permutation test regarding type I error rate control, especially when autocorrelation increased. In conclusion, the PDT is a useful and promising nonparametric test to evaluate treatment effects in dependent SCOD AB-phase data without linear trends.

UI MeSH Term Description Entries
D009010 Monte Carlo Method In statistics, a technique for numerically approximating the solution of a mathematical problem by studying the distribution of some random variable, often generated by a computer. The name alludes to the randomness characteristic of the games of chance played at the gambling casinos in Monte Carlo. (From Random House Unabridged Dictionary, 2d ed, 1993) Method, Monte Carlo
D003198 Computer Simulation Computer-based representation of physical systems and phenomena such as chemical processes. Computational Modeling,Computational Modelling,Computer Models,In silico Modeling,In silico Models,In silico Simulation,Models, Computer,Computerized Models,Computer Model,Computer Simulations,Computerized Model,In silico Model,Model, Computer,Model, Computerized,Model, In silico,Modeling, Computational,Modeling, In silico,Modelling, Computational,Simulation, Computer,Simulation, In silico,Simulations, Computer
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man

Related Publications

Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
April 2020, Behavior research methods,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
January 2013, PloS one,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
July 2023, Entropy (Basel, Switzerland),
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
September 2013, Multivariate behavioral research,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
July 2019, The Journal of chemical physics,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
January 2014, The Journal of chemical physics,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
January 2005, Radiation protection dosimetry,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
February 2001, Physical review. E, Statistical, nonlinear, and soft matter physics,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
May 2001, Computers & chemistry,
Anouk Vroegindeweij, and Linde N Nijhof, and Patrick Onghena, and Elise M van de Putte, and Sanne L Nijhof, and Jan Houtveen
January 1986, Medical physics,
Copied contents to your clipboard!