Page Title:
Keywords:
Description:
Skip to main content
NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items to Avoid Violations of Assumptions → Results of NAEP Differential Item Functioning Analyses → Number of Items by Severity of Differential Item Functioning, Reading Combined National and State Assessments, By DIF Category and Grade: 2011

NAEP Technical DocumentationNumber of Items by Severity of Differential Item Functioning, Reading Combined National and State Assessments, by DIF Category and Grade: 2011

For dichotomously scored items, NAEP categorizes each item into one of three categories: "A" (items exhibiting no DIF), "B" (items exhibiting a weak indication of DIF), or "C" (items exhibiting a strong indication of DIF). A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups; a minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA," "BB," or "CC" categories and the plus or minus sign has the same interpretation as dichotomously scored items. After reviewing "C" and "CC" items, subject area specialists decided that no items were biased, so none were deleted from the scales for this reason.

Number of dichotomously scored items, reading combined national and state assessments, by differential item functioning (DIF) category and grade: 2011
Grade DIF category Female/Male Black/White Hispanic/White
NOTE: This includes all items in the assessment (the prescaling decisions). In 2011, grade 12 was not assessed in reading.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2011 Reading Assessment.
4 C- 0 0 0
B- 4 1 2
A 86 89 88
B+ 0 0 0
C+ 0 0 0
8 C- 3 2 8
B- 6 7 10
A 108 106 99
B+ 4 5 4
C+ 0 1 0

Number of polytomously scored items, reading combined national and state assessments, by  differential item functioning (DIF) category and grade: 2011
Grade DIF category Male/female White/Black White/Hispanic
NOTE: This includes all items in the assessment (the prescaling decisions). In 2011, grade 12 was not assessed in reading.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2011 Reading Assessment.
4 CC- 0 0 0
BB- 0 0 1
AA 29 29 27
BB+ 1 1 2
CC+ 0 0 0
8 CC- 0 0 0
BB- 0 0 0
AA 41 40 41
BB+ 0 1 0
CC+ 0 0 0

Items identified as 'C' or 'CC' items in at least one comparison, reading combined national and state assessments, by block and grade: 2011
Grade Block Item Scale Comparison Group Favored
NOTE: The vocabulary items in the table are excluded from the analysis and reporting of the 2011 reading assessment. Due to the design, however, they were included with the regular 2011 reading items in the DIF analysis. In 2011, grade 12 was not assessed in reading.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2011 Reading Assessment.
8 R1 R059602 Literary Female-Male Male
R6 R058604 Literary Black-White Black
R6 R058609 Literary Female-Male Male
R12 R061008 Information Black-White White
R12 R061008 Information Hispanic-White White
R14 R0V0402 Vocabulary Hispanic-White White
R15 R0V0506 Vocabulary Hispanic-White White
R16 R0V0210 Vocabulary Black-White White
R16 R0V0206 Vocabulary Hispanic-White White
R16 R0V0208 Vocabulary Hispanic-White White
R16 R0V0210 Vocabulary Hispanic-White White
R16 R0V0210 Vocabulary Female-Male Male
R17 R0V0306 Vocabulary Hispanic-White White
R17 R0V0307 Vocabulary Hispanic-White White

Last updated 06 January 2016 (GF)