Table of Contents  |  Search Technical Documentation  |  References

NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items in NAEP to Avoid Violations of Assumptions → Results of NAEP Differential Item Functioning (DIF) Analyses → Results of NAEP Differential Item Functioning Analyses for the Reading Assessment in 2002

NAEP Technical DocumentationResults of NAEP Differential Item Functioning Analyses for the Reading Assessment in 2002

For polytomously scored items, NAEP categorizes each item into one of three categories: "AA" (items exhibiting no DIF), "BB" (items exhibiting a weak indication of DIF), or "CC" (items exhibiting a strong indication of DIF). A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups. A minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. Items demonstrating a strong indication of DIF ("CC" items) are reviewed by specialists in the subject of interest to determine whether the item is biased for/against a certain group. In 2002, only one reading item showed an indication of DIF.  Subject area specialists determined that this item was not biased, so the item was not deleted from the scale.

Number of polytomously scored items, by grade and differential item functioning category, reading combined national and state main assessment: 2002

Grade	DIF category1	Female-male	Black-White	Hispanic-White
4	CC-	0	0	0
	BB-	0	0	0
	AA	5	5	5
	BB+	0	0	0
	CC+	0	0	0
8	CC-	0	0	0
	BB-	0	0	0
	AA	7	7	7
	BB+	0	0	0
	CC+	0	0	0
12	CC-	0	0	0
	BB-	0	0	0
	AA	6	5	5
	BB+	0	0	0
	CC+	0	0	1
1 Positive values of the index indicate items that are differentially easier for the focal group (e.g., female students) than for the reference group (e.g., male students). “AA” means no indication of DIF, “BB+” means a weak indication of DIF in favor of the focal group, “BB-” means a weak indication of DIF in favor of the reference group, and “CC+” or ""CC-” means a strong indication of DIF. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2002 Reading Assessment.

Item identified as a 'CC' item in at least one comparison, by item and block, reading combined national and state main assessment: 2002

Grade	Block	Item	Scale	Category	Comparison	Group favored
12	R11	R020201	Task	CC	Hispanic-White	Hispanic
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2002 Reading Assessment.

Printer-friendly Version