Table of Contents  |  Search Technical Documentation  |  References

NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items in NAEP to Avoid Violations of Assumptions → Results of NAEP Differential Item Functioning (DIF) Analyses → Results of NAEP Differential Item Functioning Analyses for the Mathematics Assessment in 2003

NAEP Technical DocumentationResults of NAEP Differential Item Functioning Analyses for the Mathematics Assessment in 2003

For dichotomously scored items, NAEP categorizes each item into one of three categories: "A" (items exhibiting no DIF), "B" (items exhibiting a week indication of DIF), or "C" (items exhibiting a strong indication of DIF). A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups; a minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA", "BB" or "CC" categories and the plus or minus sign has the same interpretation as dichotomously scored items. After reviewing "C" and "CC" items, subject area specialists decided that no items were biased, so none were deleted from the scales for this reason.

Number of dichotomously scored items by severity of differential item functioning, grade, and differential item functioning category, mathematics combined national and state main assessment: 2003

Grade	DIF category1	Female-male	Black-White	Hispanic-White
4	C-	0	1	2
	B-	3	3	3
	A	137	135	136
	B+	1	2	0
	C+	0	0	0
8	C-	0	1	2
	B-	8	5	2
	A	150	150	154
	B+	2	4	2
	C+	0	0	0
1 Positive values of the index indicate items that are differentially easier for the focal group (e.g., Black students) than for the reference groups (e.g., White students). “A” means no indication of DIF, “B+” means a weak indication of DIF in favor of the focal group, “B-” means a weak indication of DIF in favor of the reference group, and “C+” or “C-” means a strong indication of DIF. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment.

Number of polytomously scored items by severity of differential item functioning, grade, and differential item functioning category, mathematics combined national and state main assessment: 2003

Grade	DIF category1	Female-male	Black-White	Hispanic-White
4	CC-	0	0	0
	BB-	0	0	0
	AA	38	36	38
	BB+	0	2	0
	CC+	0	0	0
8	CC-	1	0	0
	BB-	0	0	0
	AA	35	35	34
	BB+	0	1	2
	CC+	0	0	0
1 Positive values of the index indicate items that are differentially easier for the focal group (e.g., Black students) than for the reference groups (e.g., White students). “AA” means no indication of DIF, “BB+” means a weak indication of DIF in favor of the focal group, “BB-” means a weak indication of DIF in favor of the reference group, and “CC+” or “CC-” means a strong indication of DIF. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment.

Items identified as 'C' or 'CC' items in at least one comparison, by grade and block, mathematics combined national and state main assessment: 2003

Grade	Block	Item	Scale	Category	Comparison	Group Favored
4	M6	M020301	Measurement	C	Black-White	White
	M9	M039501	Measurement	C	Hispanic-White	White
	M10	M042701	Measurement	C	Hispanic-White	White
8	M3	M075601	Measurement	CC	Black-White	White
	M6	M020301	Measurement	C	Black-White	White
	M8	M013331	Measurement	C	Hispanic-White	White
	M11	M106101	Number Sense	C	Hispanic-White	White
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment.

Printer-friendly Version