“Is the Hypothesis Correct” or “Is it Not”
Bayesian Evaluation of One Informative Hypothesis for ANOVA
Abstract
Researchers in the behavioral and social sciences often have one informative hypothesis with respect to the state of affairs in the population from which they sampled their data. The question they would like an answer to is “Is the Hypothesis Correct” or “Is it Not.” Classical statistics has not yet provided an approach with which this question can be answered. In this paper it will be shown that there is a Bayesian approach that does provide an answer to this question. Using two ANOVA examples the context of this paper will be sketched. Subsequently it will be shown how the Bayes factor can be used to quantify the support in the data for an informative hypothesis (“It is”) and its complement (“It is not”). Subsequently, the performance of the method proposed will be evaluated by means of error probabilities and evaluation of the robustness with respect to violations of the assumption of homogeneous within group variances. Finally, the methodology will be elaborated and it will be illustrated how the approach proposed can be implemented using WinBUGS.
References
(1972). Statistical inference under order restrictions. New York, NY: Wiley.
(1988). Statistical power analysis for the behavioral sciences. (2nd ed.). Hillsdale, NJ: Erlbaum.
(1994). The earth is round (p < .05). American Psychologist, 49, 997–1003.
(2005). Calibrating Bayes factor under prior predictive distributions. Statistica Sinica, 15, 359–380.
(2009). Cognitive mechanisms underlying recovered-memory experiences of childhood sexual abuse. Psychological Science, 20, 92–98.
(2008). Bayesian evaluation of informative hypotheses. New York, NY: Springer.
(1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795.
(1996). The selection of prior distributions by formal rules. Journal of the American Statistical Association, 91, 1343–1370.
(2007). The Bayes factor for inequality and about equality constrained models. Computational Statistics and Data Analysis, 51, 6367–6379.
(2005). Bayesian model selection using encompassing priors. Statistica Neerlandica, 59, 57–69.
(2005). Inequality constrained analysis of variance: A Bayesian approach. Psychological Methods, 10, 477–493.
(2010). Comparisons of means using exploratory and confirmatory approaches. Psychological Methods, 15, 69–86.
(2000). WinBUGS – A Bayesian One Informative Hypothesis 25 modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325–337.
(2010). Equality and inequality constrained multivariate linear models: Objective model selection using constrained posterior priors. Journal of Statistical Planning and Inference, 4, 887–906.
(2010). Bayesian model selection of informative hypotheses for repeated measurements. Journal of Mathematical Psychology, 53, 530–546.
(1993). Children’s peer relations: A meta-analytic review of popular, rejected, neglected, controversial, and average sociometric status. Psychological Bulletin, 113, 99–128.
(1988). Order restricted statistical inference. New York, NY: Wiley.
(1985). Contrast analysis: Focused comparisons in the analysis of variance? New York, NY: Cambridge University Press.
(2005). Constrained statistical inference order, inequality and shape constraints. Hoboken, NJ: Wiley.
(2007). Using multivariate statistics. Boston, MA: Pearson.
(1993). Multiple comparison procedures. Newbury Park, CA: Sage.
(2010). Testing inequality constrained hypotheses in SEM models. Structural Equation Modeling: A Multidisciplinary Journal, 17, 443–463.
(2011). Evaluating expectations about negative emotional states of aggressive boys using Bayesian model selection. Developmental Psychology, 47, 203–212.
(
in press ). Psychological functioning personality and support from family: An introduction Bayesian model selection. European Journal of Developmental Psychology.(2011). Moving beyond traditional null hypothesis testing: Evaluating expectations directly. Frontiers in Quantitative Psychology and Measurement, 2, 24.
(2010). Can at-risk young adolescents be popular and anti-social? Sociometric status groups, anti-social behaviour, gender and ethnic background. Journal of Adolescence, 1, 1–10.
(2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779–804.
