NAEP Assessment Sample Design → NAEP 2009 Sample Design → Sample Design for the 2009 National Assessment → Hands-On Tasks (HOT) and Interactive Computer Tests (ICT) for the 2009 Science Assessment → Public School 2009 Science HOT and ICT Assessments → Substitute Public Schools for the Science HOT and ICT Assessments

NAEP Technical DocumentationSubstitute Public Schools for the 2009 Science HOT and ICT Assessments

Substitutes were preselected for the public school samples by sorting the school frame file according to the actual order used in the sampling process (the implicit stratification). For operational reasons, the original selection order was embedded within the sampled primary sampling unit (PSU) and state.  Each sampled school had each of its nearest neighbors within the same sampling stratum on the school frame file identified as a potential substitute. When grade enrollment was used as the last sort ordering variable, the nearest neighbors had grade enrollment values very close to that of the sampled school. This was done to facilitate the selection of about the same number of students within the substitute as would have been selected from the original sampled school.

Schools were disqualified as potential substitutes if they were already selected in any of the original public school samples or assigned as a substitute for another public school (earlier in the sort ordering). Schools assigned as substitutes for twelfth-grade schools were disqualified as potential substitutes for fourth- and eighth-grade schools, and schools assigned as substitutes for eighth-grade schools were disqualified as potential substitutes for fourth-grade schools.

If both nearest neighbors were still eligible to be substitutes, the one with a closer grade enrollment was chosen. If both nearest neighbors were equally distant from the sampled school in their grade enrollment (an uncommon occurrence), one of the two was randomly selected.

Of the approximately 890 originally sampled public schools for the hands-on tasks (HOT) and interactive computer tests (ICT) assessments, about 10 schools had a substitute activated, because the original school, although eligible, did not participate. Ultimately, fewer than five of the activated substitute public schools participated in the HOT and ICT assessments.

Printer-friendly Version