Table of Contents | Search Technical Documentation | References
For dichotomously scored items, NAEP categorizes each item into one of three categories:
"A" (items exhibiting no DIF),
"B" (items exhibiting a week indication of DIF), or
"C" (items exhibiting a strong indication of DIF).
A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups; a minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA", "BB" or "CC" categories and the plus or minus sign has the same interpretation as dichotomously scored items. After reviewing "C" and "CC" items, subject-area specialists decided that no items were biased, so none were deleted from the scales for this reason.
Grade | DIF category | Analysis | ||
---|---|---|---|---|
Male/female | White/Black | White/Hispanic | ||
4 | C- | 1 | 0 | 0 |
B- | 2 | 2 | 1 | |
A | 31 | 30 | 31 | |
B+ | 0 | 2 | 2 | |
C+ | 0 | 0 | 0 | |
8 | C- | 1 | 1 | 0 |
B- | 4 | 1 | 2 | |
A | 35 | 36 | 38 | |
B+ | 2 | 4 | 2 | |
C+ | 0 | 0 | 0 | |
12 | C- | 3 | 0 | 1 |
B- | 4 | 2 | 4 | |
A | 34 | 36 | 35 | |
B+ | 0 | 3 | 1 | |
C+ | 0 | 0 | 0 | |
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2000 Science Assessment. |
Grade | DIF category | Analysis | ||
---|---|---|---|---|
Male/female | White/Black | White/Hispanic | ||
4 | CC- | 0 | 1 | 0 |
BB- | 1 | 0 | 1 | |
AA | 9 | 8 | 9 | |
BB+ | 0 | 1 | 0 | |
CC+ | 0 | 0 | 0 | |
8 | CC- | 0 | 0 | 0 |
BB- | 2 | 0 | 0 | |
AA | 15 | 17 | 17 | |
BB+ | 1 | 0 | 0 | |
CC+ | 0 | 1 | 1 | |
12 | CC- | 0 | 0 | 1 |
BB- | 1 | 2 | 1 | |
AA | 16 | 16 | 15 | |
BB+ | 1 | 0 | 1 | |
CC+ | 0 | 0 | 0 | |
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2000 Science Assessment. |
Item | Block | Scale | Category | Grade | Comparison | Group favored |
---|---|---|---|---|---|---|
K104201 | S8 | Life | C | 4 | Male/female | Male |
K095301 | S10 | Physical | C | 8 | Male/female | Male |
K095601 | S20 | Physical | C | 8 | White/Black | White |
K091301 | S20 | Life | C | 12 | Male/female | Male |
K091801 | S10 | Earth | C | 12 | Male/female | Male |
K096401 | S20 | Physical | C | 12 | Male/female | Male |
K105801 | S7 | Earth | C | 12 | White/Hispanic | White |
K098301 | S11 | Physical | CC | 4 | White/Black | White |
K102301 | S7 | Earth | CC | 8 | White/Black | Black |
K102301 | S7 | Earth | CC | 8 | White/Hispanic | Hispanic |
K104501 | S7 | Life | CC | 12 | White/Hispanic | White |
NOTE: For each grade for which an item was administered, three comparisons were performed: Male/female, White/Black, and White/Hispanic. “C” or “CC” means a strong indication of DIF for dichotomously scored items and polytomously scored items respectively. No items were identified as being biased, so none were deleted from the NAEP scales. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2000 Science Assessment. |