Demographic Variation in SF-12 Scores: True Differences or Differential Item Functioning?

Background: Demographic differences have been reported in summary measures of physical and mental health based on the SF-12 instrument.

Objectives: This study examines the extent to which differential item functioning (DIF) contributes to observed subgroup differences in health status. DIF refers to situations in which the psychometric properties of items are not invariant across different groups. The presence of DIF confounds interpretation of subgroup differences.

Subjects: A national sample of 11,626 adult respondents in the 2000 Medical Expenditure Panel Survey who completed a self-administered questionnaire.

Measures: In addition to the SF-12, we collected data on demographic characteristics (age, gender, education, and race/ethnicity) and whether the person had ever been diagnosed with six chronic medical conditions.

Results: Multiple-indicator multiple-cause latent variable models showed significant differences in physical health by gender, age, and education. Adjusting for DIF reduced but did not eliminate age and education differences. However, for mental health, adjusting for DIF resulted in Black-White differences becoming nonsignificant, and the effect for the oldest age group switched from positive to negative. Race/ethnicity was not associated with physical health status.

Conclusions: Age group comparisons of mental health may be particularly affected by DIF. Differences in education, as well as age and gender, need to be controlled when making group comparisons. Additional work is needed to understand factors that give rise to demographic differences in reported health status.