Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Tutorial

Fitting Bayesian Models for Single-Case Experimental Designs

A Tutorial

Published Online:December 16, 2019https://doi.org/10.1027/1614-2241/a000180

Abstract

Abstract. Single-case experimental designs (SCEDs) are interrupted time-series designs that have recently gained recognition as being able to provide a strong basis for establishing intervention effect. Typically, SCED data are short time series and autocorrelated, which renders maximum likelihood and parametric analyses inadequate for data analysis, respectively. Although Bayesian methods overcome these challenges, most practitioners do not use Bayesian estimation because of: (a) its steep learning curve, (b) lack of Bayesian training, and (c) lack of knowledge of Bayesian software solutions. This study demonstrates two Bayesian interrupted time-series models using freeware programs R and JAGS. Practitioners could modify these codes and run them for their own data by changing the values in the codes where indicated. Providing practitioners with such tools to facilitate their analysis is one way to improve methodological rigor in applied research.

References

  • American Speech-Language-Hearing Association. (2004). Evidence-based practice in communication disorders: An introduction. (Technical report). Retrieved from http://shar.es/11yOzJ or http://www.asha.org/policy/TR2004-00001/ First citation in articleGoogle Scholar

  • Ansari, F., Gray, K., Nathwani, D., Phillips, G., Ogston, S., Ramsay, C., & Davey, P. (2003). Outcomes of an intervention to improve hospital antibiotic prescribing: Interrupted time series with segmented regression analysis. Journal of Antimicrobial Chemotherapy, 52, 842–848. https://doi.org/10.1093/jac/dkg459 First citation in articleCrossref, Google Scholar

  • Ansari, A., & Jedidi, K. (2000). Bayesian factor analysis for multilevel binary observations. Psychometrika, 65, 475–497. https://doi.org/10.1007/BF02296339 First citation in articleCrossref, Google Scholar

  • Ansari, A., Jedidi, K., & Jagpal, S. (2000). A hierarchical Bayesian approach for modeling heterogeneity in structural equation models. Marketing Science, 19, 328–347. https://doi.org/10.1287/mksc.19.4.328.11789 First citation in articleCrossref, Google Scholar

  • Ballart, X., & Riba, C. (1995). Impact of legislation requiring moped and motorbike riders to wear helmets. Evaluation and Program Planning, 18, 311–320. First citation in articleCrossref, Google Scholar

  • Box, G., & Jenkins, G. (1970). Time series analysis: Forecasting and control. San Francisco, CA: Holden-Day. First citation in articleGoogle Scholar

  • Brooks, S., & Gelman, A. (1998). Some issues in monitoring convergence of iterative solutions. Journal of Computational and Graphical Statistics, 7, 434–455. First citation in articleGoogle Scholar

  • Campbell, D. T., & Ross, H. L. (1968). The Connecticut crackdown on speeding: Time-series data in quasiexperimental analysis. Law & Society Review, 3, 33–54. First citation in articleCrossref, Google Scholar

  • Cook, B. G., Buysse, V., Klingner, J., Landrum, T. J., McWilliam, R. A., Tankersley, M., & Test, D. W. (2014). CEC’s standards for classifying the evidence base of practices in special education. Remedial and Special Education, 39, 305–318. https://doi.org/10.1177/0741932514557271 First citation in articleGoogle Scholar

  • Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton Mifflin. First citation in articleGoogle Scholar

  • Denwood, M. J. (2016). runjags: An R package providing interface utilities, parallel computing methods and additional distributions for MCMC models in JAGS. Journal of Statistical Software, 71, 1–25. https://doi.org/10.18637/jss.v071.i09 First citation in articleCrossref, Google Scholar

  • Fox, J.-P. (2010). Bayesian item response modeling: Theory and applications. New York, NY: Springer. First citation in articleCrossref, Google Scholar

  • Franklin, S. (1997). Designing single case treatment studies for aphasic patients. Neuropsychological Rehabilitation, 7, 401–418. First citation in articleCrossref, Google Scholar

  • Gabler, N. B., Duan, N., Vohra, S., & Kravitz, R. L. (2011). N-of-1 trials in the medical literature: A systematic review. Medical Care, 49, 761–768. https://doi.org/10.1097/MLR.0b013e318215d90d First citation in articleCrossref, Google Scholar

  • Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013). Bayesian data analysis (3rd ed.). London, UK: Chapman & Hall. First citation in articleCrossref, Google Scholar

  • Gill, J. (2014). Bayesian methods: A social and behavioral sciences approach (3rd ed.). Boca Raton, FL: Chapman & Hall. First citation in articleGoogle Scholar

  • Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2012). A standardized mean difference effect size for single case designs. Research Synthesis Methods, 3, 224–239. https://doi.org/10.1002/jrsm.1052 First citation in articleCrossref, Google Scholar

  • Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2013). A standardized mean difference effect size for multiple baseline designs across studies. Research Synthesis Methods, 4, 324–341. https://doi.org/10.1002/jrsm.1086 First citation in articleCrossref, Google Scholar

  • Heidelberger, P., & Welch, P. D. (1983). Simulation run length control in the presence of an initial transient. Operations Research, 31, 1109–1144. https://doi.org/10.1287/opre.31.6.1109 First citation in articleCrossref, Google Scholar

  • Huitema, B. E. (1985). Autocorrelation in applied behavior analysis: A myth. Behavioral Assessment, 7, 107–118. First citation in articleGoogle Scholar

  • Huitema, B. E., & McKean, J. W. (1998). Irrelevant autocorrelation in least-squares intervention models. Psychological Methods, 3, 104–116. First citation in articleCrossref, Google Scholar

  • Huitema, B. E., & McKean, J. W. (2000). A simple and powerful test for autocorrelated errors in OLS intervention models. Psychological Reports, 87, 3–20. https://doi.org/10.2466/PR0.87.5.3-20 First citation in articleCrossref, Google Scholar

  • Kieftenbeld, V., & Natesan, P. (2012). Recovery of graded response model parameters: A comparison of marginal maximum likelihood and Markov chain Monte Carlo estimation. Applied Psychological Measurement, 36, 399–419. First citation in articleCrossref, Google Scholar

  • Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf First citation in articleGoogle Scholar

  • Kruschke, J. K. (2013). Bayesian estimation supersedes the t-test. Journal of Experimental Psychology: General, 142, 573–603. https://doi.org/10.1037/a0029146 First citation in articleCrossref, Google Scholar

  • Kruschke, J. K. (2015). Doing Bayesian data analysis: A tutorial with R, JAGS, and Stan. (2nd ed.). Burlington, MA: Academic Press/Elsevier. First citation in articleGoogle Scholar

  • Lambert, M. C., Cartledge, G., Heward, W. L., & Lo, Y. (2006). Effects of response cards on disruptive behavior and academic responding during math lessons by fourth-grade urban students. Journal of Positive Behavior Interventions, 8, 88–99. https://doi.org/10.1177/10983007060080020701 First citation in articleCrossref, Google Scholar

  • Lunn, D., Spiegelhalter, D., Thomas, A., & Best, N. (2009). The BUGS project: Evolution, critique, and future directions. Statistics in Medicine, 28, 3049–3067. https://doi.org/10.1002/sim.3680 First citation in articleCrossref, Google Scholar

  • Lynch, S. M. (2007). Introduction to applied Bayesian statistics and estimation for social scientists. New York, NY: Springer. First citation in articleCrossref, Google Scholar

  • Manolov, R., & Rochat, L. (2015). Further developments in summarising and meta-analysing single-case data: An illustration with neurobehavioural interventions in acquired brain injury. Neuropsychological Rehabilitation, 25, 637–662. https://doi.org/10.1080/09602011.2015.1064452 First citation in articleCrossref, Google Scholar

  • Moeyaert, M., Ugille, M., Ferron, J., Beretvas, S. N., & Van den Noortgate, W. (2014). Three-level analysis of single-case experimental data: Empirical validation. The Journal of Experimental Education, 82, 1–21. https://doi.org/10.1080/00220973.2012.745470 First citation in articleCrossref, Google Scholar

  • Mulford, H. A., Ledolter, J., & Fitzgerald, J. L. (1992). Alcohol availability and consumption: Iowa sales data revisited. Journal of Studies on Alcohol, 53, 487–494. https://doi.org/10.15288/jsa.1992.53.487 First citation in articleCrossref, Google Scholar

  • Natesan, P. (2015). Comparing interval estimates for small sample ordinal CFA models. Frontiers in Psychology: Quantitative Psychology and Measurement, 6, 1599. First citation in articleGoogle Scholar

  • Natesan, P. (2019). Conceptualizing statistical simulation studies as multiple methods inquiry: A primer. International Journal of Multiple Research Approaches, 11, 77–89. First citation in articleCrossref, Google Scholar

  • Natesan, P., Boedeker, P., & Onwuegbuzie, A. J. (2019 April). Adopting a meta-generative way of thinking in the field of education via the use of Bayesian methods. Paper presented at the Annual Meeting of the American Educational Research Association, Toronto, Canada. First citation in articleGoogle Scholar

  • Natesan, P., & Hedges, L. V. (2017). Bayesian unknown change-point models to investigate immediacy in single case designs. Psychological Methods, 22, 743–759. https://doi.org/10.1037/met0000134 First citation in articleCrossref, Google Scholar

  • Natesan, P., & Hedges, L. V. (2019 April). Accurate model vs. accurate estimates: A study of Bayesian single-case experimental designs. Paper presented at the Annual Meeting of the American Educational Research Association, Toronto, Canada. First citation in articleGoogle Scholar

  • Natesan, P., Nandakumar, R., Minka, T., & Rubright, J. (2016). Bayesian prior choice in IRT estimation using MCMC and Variational Bayes. Frontiers in Psychology, 7, 1–11. https://doi.org/10.3389/fpsyg.2016.01422 First citation in articleCrossref, Google Scholar

  • Plummer, M. (2003). JAGS: A program for analysis of bayesian graphical models using gibbs sampling. In K. HornikF. LeischA. ZeileisEds., Proceedings of the 3rd International Workshop on Distributed Statistical Computing. Vienna, Austria: Technical University. First citation in articleGoogle Scholar

  • R Core Team. (2014). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/ First citation in articleGoogle Scholar

  • Rindskopf, D. (2014). Nonlinear Bayesian analysis for single case designs. Journal of School Psychology, 52, 179–189. https://doi.org/10.1016/j.jsp.2013.12.003 First citation in articleCrossref, Google Scholar

  • Serumaga, B., Ross-Degnan, D., Avery, A. J., Elliott, R. A., Majumdar, S. R., Zhang, F., & Soumerai, S. B. (2011). Effect of pay for performance on the management and outcomes of hypertension in the United Kingdom: Interrupted time series study. British Medical Journal, 342, 108–114. https://doi.org/10.1136/bmj.d108 First citation in articleCrossref, Google Scholar

  • Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin. First citation in articleGoogle Scholar

  • Shadish, W. R., Hedges, L. V., Horner, R. H., & Odom, S. L. (2015). The role of between-case effect size in conducting, interpreting, and summarizing single-case research (NCER 2015-002). Washington, DC: National Center for Education Research, Institute of Education Sciences, US Department of Education. Retrieved from http://ies.ed.gov/ First citation in articleGoogle Scholar

  • Shadish, W. R., Rindskopf, D. M., Hegdes, L. V., & Sullivan, K. J. (2013). Bayesian estimates of autocorrelations in single-case designs. Behavior Research Methods, 45, 813–821. https://doi.org/10.3758/s13428-012-0282-1 First citation in articleCrossref, Google Scholar

  • Shadish, W. R., & Sullivan, K. J. (2011). Characteristics of single-case designs used to assess treatment effects in 2008. Behavior Research Methods, 43, 971–980. https://doi.org/10.3758/s13428-011-0111-y First citation in articleCrossref, Google Scholar

  • Shadish, W. R., Zuur, A. F., & Sullivan, K. J. (2014). Using generalized additive (mixed) models to analyze single case designs. Journal of School Psychology, 52, 149–178. https://doi.org/10.1016/j.jsp.2013.11.004 First citation in articleCrossref, Google Scholar

  • Shih, C.-H., Chang, M.-L., Wang, S.-H., & Tseng, C.-L. (2014). Assisting students with autism to actively perform collaborative walking activity with their peers using dance pads combined with preferred environmental stimulation. Research in Autism Spectrum Disorders, 8, 1591–1596. https://doi.org/10.1016/j.rasd.2014.08.011 First citation in articleCrossref, Google Scholar

  • Stan Development Team. (2011). Stan version 2.19. Retrieved from https://mc-stan.org/about/ First citation in articleGoogle Scholar

  • St. Claire, T., Cook, T. D., & Hallberg, K. (2014). Examining the internal validity and statistical precision of the comparative interrupted time series design by comparison with a randomized experiment. American Journal of Evaluation, 35, 311–327. First citation in articleCrossref, Google Scholar

  • Swaminathan, H., Rogers, H. J., & Horner, R. H. (2014). An effect size measure and Bayesian analysis of single-case designs. Journal of School Psychology, 52, 213–230. https://doi.org/10.1016/j.jsp.2013.12.002 First citation in articleCrossref, Google Scholar

  • Walley, A. Y., Xuan, Z., Hackman, H. H., Quinn, E., Doe-Simkins, M., Sorensen-Alawad, A., … Ozonoff, A. (2013). Opioid overdose rates and implementation of overdose education and nasal naloxone distribution in Massachusetts: Interrupted time series analysis. British Medical Journal, 346, 174–185. https://doi.org/10.1136/bmj.f174 First citation in articleCrossref, Google Scholar

  • Wong, M., Cook, T. D., & Steiner, P. M. (2015). Adding design elements to improve time series designs: No child left behind as an example of causal pattern-matching. Journal of Research on Educational Effectiveness, 8, 245–279. https://doi.org/10.1080/19345747.2013.878011 First citation in articleCrossref, Google Scholar