Off-campus UNL users: To download campus access dissertations, please use the following link to log into our proxy server with your NU ID and password. When you are done browsing please remember to return to this page and log out.
Non-UNL users: Please talk to your librarian about requesting this dissertation through interlibrary loan.
Using Bayesian Multilevel Models to Control for Multiplicity Among Means
Abstract
It is well known that the Type I error rate will exceed α when multiple hypothesis tests are conducted simultaneously. This is known as Type I error inflation. The probability of committing a Type I error grows monotonically as the number as the number of hypothesis being tested increases. A class of methods, known as multiple comparison procedures, has been developed to combat this issue. However, in turn for maintaining the Type I error rate below α, multiple comparison procedures sacrifice power to correctly reject false hypotheses. The loss of power is exacerbated when variance heterogeneity is present. In the case of making multiple comparisons among means, a possible alternative to multiple comparison procedures is to use Bayesian multilevel models to control for Type I error inflation. Bayesian multilevel models reduce the risk of committing a Type I error by shrinking all means towards the grand mean, in turn, making it more difficult to declare any mean significantly different from one another. To compare the performance of multiple comparison procedures and Bayesian multilevel models, a Monte Carlo simulation study, in which the number of hypotheses and variance heterogeneity was manipulated, was conducted. The results indicated that the Bayesian multilevel models maintain the Type I error rate at α and display greater power than the traditional methods when a large number of hypotheses are tested. When the number of hypotheses tested were small, the Bayesian models were not able to maintain strong control of the Type I error rate.
Subject Area
Quantitative psychology
Recommended Citation
Zweifel, Michael, "Using Bayesian Multilevel Models to Control for Multiplicity Among Means" (2018). ETD collection for University of Nebraska-Lincoln. AAI13419342.
https://digitalcommons.unl.edu/dissertations/AAI13419342