Page Title:
Keywords:
Description:
Skip to main content
Sample Design → NAEP 2010 Sample Design → Selection of Primary Sampling Units (PSUs) for the 2010 Assessment → Primary Sampling Unit (PSU) Frame: Stratification for the 2010 Assessment

NAEP Technical DocumentationPrimary Sampling Unit (PSU) Frame: Stratification for the 2010 Assessment

      

Stepwise Regression Analysis Results for PSU Stratification

Final PSU Strata

horizontal line

The noncertainty primary sampling unit (PSU) strata were initially determined by census region and metropolitan status (metropolitan or non-metropolitan)—a total of eight primary strata. Measures of size were defined for each of these strata, determined by the relative share of the eventual PSU sample (the sample size is designed to be proportional to the number of youths). The PSU stratum measure of size then is the total number of youths in the stratum. The table below presents these counts for each of the eight primary strata. The relative share of the PSU sample size for each stratum is the number of youths in the stratum divided by the total number of youths, multiplied by 76 (the total noncertainty PSU sample size). The results of these calculations are given in the table below.

Noncertainty primary sampling unit (PSU) frame size statistics, by primary stratum: 2010
Primary stratum PSUs Counties Youths Target number of PSU strata Set number of PSU strata Youth per PSU stratum
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2010.
Total noncertainty PSUs 1,040 2,938 43,508,123 76.0 76 572,475
Northeast region metropolitan 46 83 4,588,413 8.0 8 573,552
Northeast region non-metropolitan 50 94 1,119,775 2.0 2 559,888
Midwest region metropolitan 100 246 7,469,915 13.0 12 622,493
Midwest region non-metropolitan 249 769 3,545,947 6.2 6 590,991
South region metropolitan 153 458 13,166,582 23.0 22 598,481
South region non-metropolitan 269 872 5,212,564 9.1 10 521,256
West region metropolitan 71 101 6,727,668 11.8 12 560,639
West region non-metropolitan 102 315 1,677,259 2.9 4 419,315

The division of the primary strata into the final strata was done on a stratum-by-stratum basis. The criteria for good PSU strata were (1) the strata should have as equal measures of size as possible (this reduces sampling variance), and (2) the strata should be as heterogeneous in measured achievement as possible (i.e., there should be strata with low mean achievement, strata with mid-level mean achievement, and strata with high mean achievement). This second criterion will also ultimately reduce the variance of the assessment estimates since the final PSU sample will be balanced in terms of assessment means.

PSU assessment means from the current year cannot be used, as assessments are only conducted after sampling is completed. Information is available about PSU sociodemographic characteristics in advance, however. An analysis was done within each primary stratum to find sociodemographic variables that were good predictors of the NAEP 2000 mathematics and science assessment results. Using these sociodemographic variables to define strata should increase the chance of having efficient strata definitions. The page Stepwise Regression Analysis Results for PSU Stratification describes this analysis for each primary stratum.

The final step in stratification was to define the desired number of strata using the selected stratifiers while constructing strata that were as close to equal size as possible (with size defined by number of youths). The objective was to establish strata that had a high between-stratum variance for the stratifiers (i.e., which "spread out" the stratifiers as much as possible). These strata are given on the page Final PSU Strata.

 


Last updated 25 April 2011 (EH)