Accurate Models vs Accurate Estimates: A Simulation Study of Bayesian Single-Case Experimental Designs

Autor/inn/en	Batley, Prathiba Natesan; Hedges, Larry V.
Titel	Accurate Models vs Accurate Estimates: A Simulation Study of Bayesian Single-Case Experimental Designs
Quelle	(2021), (30 Seiten) PDF als Volltext (1); PDF als Volltext kostenfreie Datei (2) Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Bayesian Statistics; Models; Accuracy; Computation; Monte Carlo Methods; Research Design + Suchen Sie Ihr Suchwort? Analogiemodell; Monte-Carlo-Methode; Forschungsdesign
Abstract	Although statistical practices to evaluate intervention effects in SCEDs have gained prominence in the recent times, models are yet to incorporate and investigate all their analytic complexities. Most of these statistical models incorporate slopes and autocorrelations both of which contribute to trend in the data. The question that arises is whether in SCED data that show trend, there is indeterminacy between estimating slope and autocorrelation because both contribute to trend and the data have limited number of observations. Using Monte Carlo simulation, we compared the performance of four Bayesian change-point models: (a) intercepts only (IO), (b) slopes but no autocorrelations (SI), (c) autocorrelations but no slopes (NS), and (d) both autocorrelations and slopes (SA). Weakly informative priors were used to remain agnostic about the parameters. Coverage rates showed that for the SA model either the slope effect size or the autocorrelation credible interval almost always erroneously contained 0 and the Type II errors were prohibitively large. Considering the 0-coverage and coverage rates of slope effect size, intercept effect size, mean relative bias, and second phase intercept relative bias, the SI model outperformed all other models. Therefore, it is recommended that researchers favour the SI model over the other three models. Research studies that develop slope effect sizes for SCEDs should consider the performance of the statistic by taking into account coverage and 0-coverage rates. These helped uncover patterns that were not realized in other simulation studies. We underline the need for investigating the use of informative priors in SCEDs. [This paper was published in "Behavior Research Methods."] (As Provided).
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01