NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items to Avoid Violations of Assumptions → Results of NAEP Differential Item Functioning (DIF) Analyses → Results of NAEP Differential Item Functioning (DIF) Analysis for the Arts Main Assessment in 2008

NAEP Technical DocumentationResults of NAEP Differential Item Functioning (DIF) Analysis for the Arts Main Assessment in 2008

For dichotomously scored items, NAEP categorizes each item into one of three categories: "A" (items exhibiting no DIF), "B" (items exhibiting a weak indication of DIF), or "C" (items exhibiting a strong indication of DIF). A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups; a minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA," "BB," or "CC" categories, and the plus or minus sign has the same interpretation as that for dichotomously scored items. After reviewing "C" and "CC" items, subject area specialists decided that no items were biased, so none were deleted from the scales for this reason.

Number of dichotomously scored items, grade 8 arts national main assessment, by differential item functioning (DIF) category: 2008

Grade	DIF category	Female-Male	Black-White	Hispanic-White
NOTE: This includes all items in the assessment (the prescaling decisions). Only students in grade 8 participated in the 2008 arts assessment. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2008 Arts Assessment.
8	C-	0	0	0
	B-	2	3	1
	A	15	14	16
	B+	0	0	0
	C+	0	0	0

Number of polytomously scored items, grade 8 arts national main assessment, by differential item functioning (DIF) category: 2008

Grade	DIF category	Female-Male	Black-White	Hispanic-White
NOTE: This includes all items in the assessment (the prescaling decisions). Only students in grade 8 participated in the 2008 arts assessment. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2008 Arts Assessment.
8	CC-	0	1	0
	BB-	0	2	3
	AA	21	21	17
	BB+	3	1	4
	CC+	1	0	1

Items identified as 'C' or 'CC' items in at least one comparison, grade 8 arts national main assessment, by block: 2008

Grade	Block	Item	Scale1	Category	Comparison	Group favored
1 Single overall scale. NOTE: This includes all items in the assessment (the prescaling decisions). Only students in grade 8 participated in the 2008 arts assessment. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2008 Arts Assessment.
8	V6	1	Responding	CC	Black-White	White
	V6	6	Responding	CC	Hispanic-White	Hispanic
	V6	8	Responding	CC	Female-Male	Female

Printer-friendly Version