Skip to main content

NAEP Technical Documentation Development of Final Raking Dimensions for the 2011 Assessment

The raking procedure involved four dimensions. The variables used to define the dimensions are listed below along with the categories making up the initial raking cells for each dimension.

  1. Eligible for free or reduced-price lunch
  2. Otherwise
  • Race/Ethnicity
  1. White, not Hispanic
  2. Black, not Hispanic
  3. Hispanic
  4. Asian
  5. American Indian/Alaska Native
  6. Native Hawaiian/Pacific Islander
  7. Two or More Races
  1. SD, but not ELL
  2. ELL, but not SD
  3. SD and ELL
  4. Neither SD nor ELL
  • Gender
  1. Male
  2. Female

In states containing districts that participated in TUDA at grades 4 and 8, the initial cells were created separately for each TUDA district and the balance of the state. Similar to the procedure used for school and student nonresponse adjustments, limits were placed on the magnitude of the cell sizes and adjustment factors to prevent unstable raking adjustments that could have resulted in unacceptably large or small adjustment factors. Levels of a dimension were combined whenever there were fewer than 30 assessed or excluded students (20 for any of the replicates) in a category, if the smallest adjustment was less than 0.5, or if the largest adjustment was greater than 2 for the full sample or for any replicate.
 
If collapsing was necessary for the race/ethnicity dimension, the following groups were combined first: American Indian/Alaska Native with Two or More Races; Asian with the Pacific Islander; and Black, not Hispanic with Hispanic. If further collapsing was necessary, the five categories American Indian/Alaska Native; Two or More Races; Asian; Native Hawaiian/Pacific Islander; and White, not Hispanic were combined. In some instances, all seven categories had to be collapsed.

If collapsing was necessary for the SD/ELL dimension, the SD/not ELL and SD/ELL categories were combined first, followed by ELL/not SD if further collapsing was necessary. In some instances, all four categories had to be collapsed.


Last updated 07 August 2013 (PS)