NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items to Avoid Violations of Assumptions → Results of NAEP Differential Item Functioning Analyses → Results of NAEP Differential Item Functioning (DIF) Analyses for the Mathematics Assessment in 2009

NAEP Technical DocumentationResults of NAEP Differential Item Functioning (DIF) Analyses for the Mathematics Assessment in 2009

For dichotomously scored items, NAEP categorizes each item into one of three categories: "A" (items exhibiting no DIF), "B" (items exhibiting a weak indication of DIF), or "C" (items exhibiting a strong indication of DIF). A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups; a minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA", "BB", or "CC" categories and the plus or minus sign has the same interpretation as it does for dichotomously scored items. After reviewing "C" and "CC" items, subject area specialists decided that no items were biased, so none were deleted from the scales for this reason.

Number of dichotomously scored items, mathematics combined national and state main assessment, by differential item functioning (DIF) category and grade: 2009

Grade	DIF category	Female-Male	Black-White	Hispanic-White
NOTE: Table includes all items in the assessment (the prescaling decisions). SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2009 Mathematics Assessment.
4	C-	2	2	4
	B-	4	1	0
	A	115	113	112
	B+	0	5	5
	C+	0	0	0
8	C-	0	0	0
	B-	6	3	1
	A	121	119	124
	B+	1	6	3
	C+	0	0	0
12	C-	4	4	2
	B-	16	13	10
	A	241	227	236
	B+	5	16	14
	C+	0	6	4

Number of polytomously scored items, mathematics combined national and state main assessment, by differential item functioning (DIF) category and grade: 2009

Grade	DIF category	Female-Male	Black-White	Hispanic-White
NOTE: Table includes all items in the assessment (the prescaling decisions). SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2009 Mathematics Assessment.
4	CC-	0	0	0
	BB-	0	0	0
	AA	36	38	38
	BB+	2	0	0
	CC+	0	0	0
8	CC-	0	0	0
	BB-	0	1	2
	AA	29	30	28
	BB+	2	0	1
	CC+	0	0	0
12	CC-	1	2	2
	BB-	2	6	4
	AA	71	68	69
	BB+	2	1	2
	CC+	2	1	1

Items identified as 'C'  items in at least one comparison, mathematics combined national and state assessment, by block and grade: 2009

Grade	Block	Item	Scale	Comparison	Group favored
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2009 Mathematics Assessment.
4	M4	M147801	Data analysis, statistics, and probability	Black-White	White
	M4	M147801	Data analysis, statistics, and probability	Hispanic-White	White
	M5	M019701	Algebra and functions	Female-Male	Male
	M6	M135601	Measurement	Black-White	White
	M6	M135601	Measurement	Hispanic-White	White
	M10	M137701	Measurement	Hispanic-White	White
	M12	M148201	Measurement	Hispanic-White	White
	M12	M148801	Algebra and functions	Female-Male	Male
12	M3	M197304	Measurement	Black-White	White
	M4	M190401	Algebra and functions	Black-White	White
	M7	M188301	Data analysis, statistics, and probability	Black-White	White
	M7	M198301	Data analysis, statistics, and probability	Hispanic-White	White
	M7	M195501	Geometry	Hispanic-White	Hispanic
	M9	M193601	Data analysis, statistics, and probability	Black-White	White
	M12	M199701	Number sense, properties, and operations	Female-Male	Male
	M15	M094401	Measurement	Black-White	Black
	M15	M094601	Data analysis, statistics, and probability	Female-Male	Male
	M15	M094001	Measurement	Hispanic-White	Hispanic
	M16	M056301	Algebra and functions	Black-White	Black
	M17	M130801	Algebra and functions	Black-White	Black
	M17	M134001	Data analysis, statistics, and probability	Hispanic-White	White
	M18	M012231	Number sense, properties, and operations	Black-White	Black
	M18	M073301	Measurement	Black-White	Black
	M20	M011531	Algebra and functions	Female-Male	Male
	M21	M127701	Algebra and functions	Hispanic-White	Hispanic
	M22	M127101	Algebra and functions	Black-White	Black
	M22	M127101	Algebra and functions	Hispanic-White	Hispanic
	M22	M132601	Geometry	Female-Male	Male

Items identified as 'CC' items in at least one comparison, mathematics combined national and state main assessment, by block and grade: 2009

Grade	Block	Item	Scale	Comparison	Group favored
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2009 Mathematics Assessment.
12	M6	M175601	Data analysis, statistics, and probability	Black-White	White
	M11	M1765CL	Algebra and functions	Hispanic-White	Hispanic
	M14	M071801	Data analysis, statistics, and probability	Female-Male	Female
	M15	M094701	Algebra and functions	Black-White	White
	M15	M094701	Algebra and functions	Hispanic-White	White
	M16	M132201	Data analysis, statistics, and probability	Female-Male	Female
	M16	M132201	Data analysis, statistics, and probability	Hispanic-White	White
	M17	M073801	Number sense, properties, and operations	Female-Male	Male
	M19	M0707CL	Algebra and functions	Black-White	Black

Printer-friendly Version