An Introduction to Bayesian Hierarchical Models with an Application in the Theory of Signal Detection

Overview

Journal Psychon Bull Rev

Specialty Psychology

Date 2006 Feb 2

PMID 16447374

Citations 108

Authors

Jeffrey N Rouder

Jun Lu

Affiliations

Soon will be listed here.

Abstract

Although many nonlinear models of cognition have been proposed in the past 50 years, there has been little consideration of corresponding statistical techniques for their analysis. In analyses with nonlinear models, unmodeled variability from the selection of items or participants may lead to asymptotically biased estimation. This asymptotic bias, in turn, renders inference problematic. We show, for example, that a signal detection analysis of recognition memory data leads to asymptotic underestimation of sensitivity. To eliminate asymptotic bias, we advocate hierarchical models in which participant variability, item variability, and measurement error are modeled simultaneously. By accounting for multiple sources of variability, hierarchical models yield consistent and accurate estimates of participant and item effects in recognition memory. This article is written in tutorial format; we provide an introduction to Bayesian statistics, hierarchical modeling, and Markov chain Monte Carlo computational techniques.

Citing Articles

Using Hierarchical Bayesian Modeling to Enhance Statistical Inference on Contrast Sensitivity.

Zhao Y, Lesmes L, Dorr M, Lu Z Transl Vis Sci Technol. 2024; 13(12):17.

PMID: 39666355 PMC: 11645744. DOI: 10.1167/tvst.13.12.17.

Susceptibility to online misinformation: A systematic meta-analysis of demographic and psychological factors.

Sultan M, Tump A, Ehmann N, Lorenz-Spreen P, Hertwig R, Gollwitzer A Proc Natl Acad Sci U S A. 2024; 121(47):e2409329121.

PMID: 39531500 PMC: 11588074. DOI: 10.1073/pnas.2409329121.

Effects of Statistical Practices for Longitudinal Group Comparison of the Penetration-Aspiration Scale on Power and Effect Size Estimation: A Monte Carlo Simulation Study.

Borders J, Grande A, Barbon C, Hutcheson K, Troche M Dysphagia. 2024; 40(2):388-398.

PMID: 39153045 DOI: 10.1007/s00455-024-10738-7.

Hierarchical Bayesian Augmented Hebbian Reweighting Model of Perceptual Learning.

Lu Z, Yang S, Dosher B bioRxiv. 2024; .

PMID: 39149245 PMC: 11326272. DOI: 10.1101/2024.08.08.606902.

A hierarchical signal detection model with unequal variance for binary responses.

Lages M Psychon Bull Rev. 2024; 31(6):2534-2557.

PMID: 38806791 PMC: 11680650. DOI: 10.3758/s13423-024-02504-5.

References

Pitt M, Myung I, Zhang S . Toward a method of selecting among computational models of cognition. Psychol Rev. 2002; 109(3):472-91. DOI: 10.1037/0033-295x.109.3.472. View

Riefer D, Rouder J . A multinomial modeling analysis of the mnemonic benefits of bizarre imagery. Mem Cognit. 1992; 20(6):601-11. DOI: 10.3758/bf03202710. View

Curran T, Hintzman D . Violations of the independence assumption in process dissociation. J Exp Psychol Learn Mem Cogn. 1995; 21(3):531-47. DOI: 10.1037//0278-7393.21.3.531. View

Baayen R, Tweedie F, Schreuder R . The subjects as a simple random effect fallacy: subject variability and morphological family effects in the mental lexicon. Brain Lang. 2002; 81(1-3):55-65. DOI: 10.1006/brln.2001.2506. View

Rouder J . Assessing the roles of change discrimination and luminance integration: evidence for a hybrid race model of perceptual decision making in luminance discrimination. J Exp Psychol Hum Percept Perform. 2000; 26(1):359-78. View

Heathcote A, Brown S, Mewhort D . The power law repealed: the case for an exponential law of practice. Psychon Bull Rev. 2000; 7(2):185-207. DOI: 10.3758/bf03212979. View

Rouder J, Lu J, Speckman P, Sun D, Jiang Y . A hierarchical model for estimating response time distributions. Psychon Bull Rev. 2005; 12(2):195-223. DOI: 10.3758/bf03257252. View

Geman S, Geman D . Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell. 2012; 6(6):721-41. DOI: 10.1109/tpami.1984.4767596. View

Gilmore G, Hersh H, Caramazza A, Griffin J . Multidimensional letter similarity derived from recognition errors. Percept Psychophys. 1979; 25(5):425-31. DOI: 10.3758/bf03199852. View

10.

HOHLE R . INFERRED COMPONENTS OF REACTION TIMES AS FUNCTIONS OF FOREPERIOD DURATION. J Exp Psychol. 1965; 69:382-6. DOI: 10.1037/h0021740. View

11.

Nosofsky R . Attention, similarity, and the identification-categorization relationship. J Exp Psychol Gen. 1986; 115(1):39-61. DOI: 10.1037//0096-3445.115.1.39. View

12.

Lee M, Wagenmakers E . Bayesian statistical inference in psychology: comment on Trafimow (2003). Psychol Rev. 2005; 112(3):662-668. DOI: 10.1037/0033-295X.112.3.662. View

13.

Estes W . The problem of inference from curves based on group data. Psychol Bull. 1956; 53(2):134-40. DOI: 10.1037/h0045156. View

14.

Ratcliff R, Sheu C, Gronlund S . Testing global memory models using ROC curves. Psychol Rev. 1992; 99(3):518-35. DOI: 10.1037/0033-295x.99.3.518. View

15.

Rozeboom W . The fallacy of the null-hypothesis significance test. Psychol Bull. 1960; 57:416-28. DOI: 10.1037/h0042040. View

16.

Glanzer M, Adams J, Iverson G, Kim K . The regularities of recognition memory. Psychol Rev. 1993; 100(3):546-67. DOI: 10.1037/0033-295x.100.3.546. View

17.

Oden G, Massaro D . Integration of featural information in speech perception. Psychol Rev. 1978; 85(3):172-91. View

18.

Einstein G, McDaniel M, Lackey S . Bizarre imagery, interference, and distinctiveness. J Exp Psychol Learn Mem Cogn. 1989; 15(1):137-46. DOI: 10.1037//0278-7393.15.1.137. View

19.

Haider H, Frensch P . Why aggregated learning follows the power law of practice when individual learning does not: comment on Rickard (1997, 1999), Delaney et al. (1998), and Palmeri (1999). J Exp Psychol Learn Mem Cogn. 2002; 28(2):392-406. DOI: 10.1037//0278-7393.28.2.392. View

20.

GREENWALD A, Draine S, Abrams R . Three cognitive markers of unconscious semantic activation. Science. 1996; 273(5282):1699-702. DOI: 10.1126/science.273.5282.1699. View