Skip to main content

Table of Contents  |  Search Technical Documentation  |  References

NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items in NAEP to Avoid Violations of Assumptions → Results of NAEP DIF Analyses → Results of NAEP DIF Analyses for the U.S. History National Main Assessment in 2001 (Accommodations Not Permitted [R2])

NAEP Technical DocumentationResults of NAEP DIF Analyses for the U.S. History National Main Assessment in 2001 (Accommodations Not Permitted [R2])

For dichotomously scored items, NAEP categorizes each item into one of three categories:

  • "A" (items exhibiting no DIF),

  • "B" (items exhibiting a week indication of DIF), or

  • "C" (items exhibiting a strong indication of DIF).

A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups; a minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA", "BB" or "CC" categories and the plus or minus sign has the same interpretation as dichotomously scored items. After reviewing "C" and "CC" items, subject-area specialists decided that no items were biased, so none were deleted from the scales for this reason.

Number of dichotomously scored items by grade and severity of differential item functioning, U.S. history national main assessment (accommodations not permitted [R2]): 2001
Grade DIF category Analysis
Male/female White/Black White/Hispanic
4 C- 0 0 0
B- 3 1 0
A 29 29 32
B+ 0 2 0
C+ 0 0 0
8 C- 1 0 0
B- 2 4 2
A 30 26 29
B+ 1 2 3
C+ 0 2 0
12 C- 2 1 0
B- 1 3 1
A 28 27 30
B+ 1 2 2
C+ 1 0 0
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 U.S. History Assessment.

Items identified as "C" items in at least one comparison, by block and item, U.S. history national main assessment (accommodations not permitted [R2]): 2001
Item Block Scale Grade Comparison Group favored
H060301 H4 Cultures 8 Male/female Male
H057901 H7 Cultures 8 White/Black Black
H060101 H4 Cultures 8 White/Black Black
H063201 H5 Technology 12 Male/Female Female
H063901 H11 World role 12 Male/female Male
H064301 H11 Technology 12 Male/female Male
H063901 H11 World role 12 White/Black White
NOTE: For each grade for which an item was administered, three comparisons were performed: Male/female, White/Black, and White/Hispanic. “C” means a strong indication of DIF for dichotomously scored items. No items were identified as being biased, so none were deleted from the NAEP scales.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 U.S. History Assessment.

Number of polytomously scored items by grade and severity of differential item functioning, U.S. history national main assessment (accommodations not permitted [R2]): 2001
Grade DIF category Analysis
Male/female White/Black White/Hispanic
4 CC- 0 0 0
BB- 0 0 1
AA 15 14 14
BB+ 0 1 0
CC+ 0 0 0
8 CC- 1 3 0
BB- 1 0 1
AA 9 8 12
BB+ 3 1 0
CC+ 0 2 1
12 CC- 0 1 0
BB- 1 1 1
AA 15 14 16
BB+ 2 2 1
CC+ 0 0 0
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 U.S. History Assessment.

 
Items identified as "CC" items in at least one comparison, by block and item, U.S. history national main assessment (accommodations not permitted [R2]): 2001
Item Block Scale Grade Comparison Group favored
H061801 H9 World role 8 Male/female Male
H057801 H7 Cultures 8 White/Black White
H058601 H7 Democracy 8 White/Black Black
H059801 H4 Cultures 8 White/Black White
H061501 H9 Democracy 8 White/Black Black
H061801 H9 World role 8 White/Black White
H058601 H7 Democracy 8 White/Hispanic Hispanic
H061801 H9 World role 12 White/Black White
NOTE: For each grade for which an item was administered, three comparisons were performed: Male/female, White/Black, and White/Hispanic. “CC” means a strong indication of DIF for polytomously scored items respectively. No items were identified as being biased, so none were deleted from the NAEP scales.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 U.S. History Assessment.

 

Last updated 14 July 2008 (DR)

Printer-friendly Version