Skip to main content
IES    
NCES
National Center for
Education Statistics
Menu
Contact
Tools
ED.gov
Newsflash
Search IES

Table of Contents  |  Search Technical Documentation  |  References

HomeTDWNAEP ScoringScoring MonitoringWithin-Year Interrater AgreementMathematics Interrater AgreementItem-by-Item Interrater Agreement, Mathematics Assessment, By Grade: 2003

NAEP Technical DocumentationItem-by-item interrater agreement, mathematics assessment, by grade: 2003
Grade Item Number of responses scored Score points Agreement
NOTE: Item = identifier for each NAEP question; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment.
4 12M3A_02 40,635 2 97
12M3A_02S 738 2 100
12M3A_03 40,618 3 97
12M3A_03S 738 3 97
12M3A_04 40,547 3 92
12M3A_04S 738 3 98
12M3A_05 40,534 3 88
12M3A_05S 738 3 91
12M3A_06 40,665 2 99
12M3A_06S 738 2 98
12M3A_11 40,634 3 98
12M3A_11S 738 3 97
12M3A_12 40,654 3 98
12M3A_12S 738 3 100
12M3A_14 40,646 4 98
12M3A_14S 738 4 95
12M3A_17 40,637 2 98
12M3A_17S 738 2 97
12M3A_18 40,619 5 93
12M3A_18S 746 5 94
12M4A_01 40,400 5 99
12M4A_01S 731 5 98
12M4A_05 40,438 5 98
12M4A_05S 726 5 97
12M4A_07 40,405 4 95
12M4A_07S 730 4 99
12M4A_08 40,402 5 99
12M4A_08S 725 5 99
12M4A_10 40,393 3 91
12M4A_10S 736 3 97
12M4A_11 40,411 3 98
12M4A_11S 732 3 97
12M4A_12 40,400 3 97
12M4A_12S 732 3 98
12M4A_13 40,396 3 98
12M4A_13S 726 3 95
12M4A_14 40,382 5 90
12M4A_14S 733 5 97
12M5A_03 40,365 3 93
12M5A_03S 755 3 93
12M5A_04 40,379 3 94
12M5A_04S 754 3 97
12M5A_06 40,378 5 91
12M5A_06S 754 5 99
12M5A_07 40,379 2 99
12M5A_07S 761 2 98
12M5A_08 40,383 2 99
12M5A_08S 760 2 99
12M5A_12 40,384 3 96
12M5A_12S 754 3 99
12M5A_14 40,378 3 96
12M5A_14S 758 3 93
12M5A_15 40,382 3 96
12M5A_15S 754 3 97
123M6A_06 40,895 2 95
123M6A_06EN 1,277 2 94
123M6A_06S 780 2 90
123M6A_06SP 1,277 2 91
123M6A_08 40,902 2 99
123M6A_08EN 1,277 2 99
123M6A_08S 769 2 97
123M6A_08SP 1,277 2 98
123M6A_16 40,918 2 97
123M6A_16EN 1,290 2 97
123M6A_16S 768 2 97
123M6A_16SP 1,277 2 98
123M6A_18 40,898 4 97
123M6A_18EN 1,277 4 98
123M6A_18S 768 4 97
123M6A_18SP 1,277 4 98
123M6A_21 40,923 3 94
123M6A_21EN 1,278 3 97
123M6A_21S 769 3 99
123M6A_21SP 1,284 3 97
1M7_05 40,696 3 99
1M7_05S 739 3 95
1M7_06 40,710 3 97
1M7_06S 738 3 89
1M7_15 40,718 3 91
1M7_15S 751 3 97
1M7_18 40,690 3 97
1M7_18S 744 3 100
1M7_19 40,702 4 86
1M7_19S 747 4 95
1M7_20 40,700 5 90
1M7_20S 738 5 99
1M8_05 40,491 3 97
1M8_05S 745 3 97
1M8_11 40,540 3 96
1M8_11S 745 3 97
1M8_13 40,483 3 97
1M8_13S 750 3 100
1M8_15 40,502 3 93
1M8_15S 745 3 99
1M8_17 40,504 3 93
1M8_17S 745 3 95
1M8_19 40,498 5 96
1M8_19S 753 5 99
1M9_03 41,428 2 97
1M9_03EN 1,287 2 94
1M9_03S 792 2 94
1M9_03SP 1,288 2 96
1M9_06 41,420 3 98
1M9_06EN 1,277 3 96
1M9_06S 773 3 95
1M9_06SP 1,278 3 95
1M9_09 41,428 3 94
1M9_09EN 1,277 3 97
1M9_09S 773 3 94
1M9_09SP 1,277 3 93
1M9_11 41,424 3 95
1M9_11EN 1,277 3 96
1M9_11S 773 3 91
1M9_11SP 1,289 3 94
1M9_13 41,436 4 96
1M9_13EN 1,277 4 98
1M9_13S 776 4 96
1M9_13SP 1,282 4 97
1M9_14 41,424 4 97
1M9_14EN 1,277 4 98
1M9_14S 780 4 96
1M9_14SP 1,284 4 98
1M9_15 41,430 3 97
1M9_15EN 1,277 3 98
1M9_15S 773 3 99
1M9_15SP 1,277 3 98
1M9_16 41,426 3 98
1M9_16EN 1,277 3 97
1M9_16S 773 3 99
1M9_16SP 1,277 3 98
1M9_18 41,419 2 93
1M9_18EN 1,277 2 95
1M9_18S 773 2 97
1M9_18SP 1,277 2 97
1M9_20 41,416 5 93
1M9_20EN 1,287 5 98
1M9_20S 779 5 99
1M9_20SP 1,288 5 98
1M10_05 40,654 3 97
1M10_05S 752 3 95
1M10_09 40,663 2 99
1M10_09S 752 2 100
1M10_10 40,656 3 94
1M10_10S 752 3 95
1M10_13 40,656 3 98
1M10_13S 752 3 98
1M10_17 40,658 5 85
1M10_17S 752 5 91
1M10_18 40,659 5 87
1M10_18S 752 5 98
1M11_04 40,657 2 95
1M11_04S 734 2 98
1M11_14 40,657 3 94
1M11_14S 734 3 98
1M11_16 40,643 3 99
1M11_16S 754 3 98
1M12_06 40,650 2 99
1M12_06S 747 2 99
1M12_09 40,639 2 99
1M12_09S 769 2 99
1M12_17 40,634 2 97
1M12_17S 747 2 100
1M12_18 40,641 3 97
1M12_18S 755 3 99
8 12M3B_02 32,656 3 92
12M3B_02S 693 3 94
12M3B_03S 32,655 3 95
12M3B_03S 694 3 99
12M3B_18 32,727 5 90
12M3B_18S 693 5 97
12M4B_20 32,709 5 97
12M4B_20S 693 5 98
12M3B_04 32,741 3 99
12M3B_04S 693 3 100
12M3B_06 32,747 4 98
12M3B_06S 693 4 99
12M4B_07 32,716 4 98
12M4B_07S 694 4 98
12M3B_09 32,750 2 99
12M3B_09S 693 2 99
12M4B_01 32,728 5 99
12M4B_01S 697 5 99
12M4B_05 32,733 5 99
12M4B_05S 690 5 99
12M4B_08 32,734 5 99
12M4B_08S 689 5 98
12M4B_10 32,698 3 93
12M4B_10S 689 3 96
12M4B_11 32,722 3 83
12M4B_11S 690 3 96
12M4B_12 32,721 3 98
12M4B_12S 690 3 92
12M4B_13 32,700 3 96
12M4B_13S 690 3 89
12M4B_14 32,729 3 90
12M4B_14S 689 3 94
12M4B_16 32,710 3 92
12M4B_16S 689 3 99
12M4B_17 32,712 3 98
12M4B_17S 689 3 99
12M4B_18 32,733 2 97
12M4B_18S 689 2 99
12M5B_01 32,989 3 96
12M5B_01S 701 3 89
12M5B_02 33,003 3 96
12M5B_02S 700 3 96
12M5B_06 33,017 2 99
12M5B_06S 707 2 98
12M5B_07 33,014 2 99
12M5B_07S 706 2 97
12M5B_11 33,004 3 92
12M5B_11S 701 3 94
12M5B_13 32,998 3 96
12M5B_13S 700 3 97
12M5B_14 33,014 3 97
12M5B_14S 700 3 91
12M5B_17 33,012 3 99
12M5B_17S 700 3 98
12M5B_18 33,007 5 89
12M5B_18S 700 5 99
123M6B_06 32,824 2 96
123M6B_06EN 540 2 95
123M6B_06S 710 2 93
123M6B_06SP 540 2 94
123M6B_08 32,829 2 99
123M6B_08EN 540 2 96
123M6B_08S 711 2 99
123M6B_08SP 541 2 99
123M6B_16 32,812 2 98
123M6B_16EN 541 2 98
123M6B_16S 710 2 98
123M6B_16SP 540 2 99
123M6B_18 32,816 4 99
123M6B_18EN 540 4 99
123M6B_18S 711 4 98
123M6B_18SP 541 4 99
123M6B_21 32,831 3 96
123M6B_21EN 541 3 99
123M6B_21S 711 3 98
123M6B_21SP 546 3 96
123M6B_25 32,813 6 96
123M6B_25EN 540 6 81
123M6B_25S 710 6 99
123M6B_25SP 540 6 96
123M6B_24 32,823 3 98
123M6B_24EN 541 3 98
123M6B_24S 710 3 98
123M6B_24SP 540 3 97
123M6B_29 32,809 5 90
123M6B_29EN 544 5 97
123M6B_29S 717 5 97
123M6B_29SP 549 5 95
23M7G08_04 33,127 2 99
23M7G08_04S 698 2 99
23M7G08_06 33,122 3 92
23M7G08_06S 698 3 99
23M7G08_13 33,137 4 99
23M7G08_13S 698 4 99
23M7G08_15 33,132 3 93
23M7G08_15S 698 3 96
23M7G08_19 33,131 5 84
23M7G08_19S 698 5 98
23M8G08_07 33,172 2 98
23M8G08_07EN 547 2 99
23M8G08_07S 675 2 98
23M8G08_07SP 540 2 99
23M8G08_09 33,179 2 92
23M8G08_09EN 540 2 87
23M8G08_09S 674 2 97
23M8G08_09SP 540 2 93
23M8G08_11 33,164 3 96
23M8G08_11EN 544 3 97
23M8G08_11S 674 3 93
23M8G08_11SP 540 3 92
23M8G08_13 33,173 3 96
23M8G08_13EN 540 3 99
23M8G08_13S 674 3 99
23M8G08_13SP 540 3 99
23M8G08_19 33,162 5 91
23M8G08_19EN 540 5 100
23M8G08_19S 674 5 99
23M8G08_19SP 540 5 96
23M9G08_03 32,961 2 98
23M9G08_03S 678 2 96
23M9G08_08 32,937 3 95
23M9G08_08S 678 3 94
23M9G08_09 32,952 2 91
23M9G08_09S 678 2 96
23M9G08_10 32,939 3 94
23M9G08_10S 707 3 97
23M9G08_11 32,964 3 92
23M9G08_11S 678 3 97
23M9G08_13 32,943 3 86
23M9G08_13S 678 3 100
23M9G08_18 32,943 5 94
23M9G08_18S 678 5 99
2M10_01 33,295 2 99
2M10_01S 689 2 99
2M10_02 33,300 2 98
2M10_02S 693 2 97
2M10_05 33,296 2 92
2M10_05S 689 2 98
2M10_06 33,300 2 95
2M10_06S 689 2 99
2M10_07 33,300 2 98
2M10_07S 689 2 99
2M10_13 33,296 3 95
2M10_13S 689 3 96
2M10_15 33,300 3 97
2M10_15S 689 3 97
2M10_16 33,283 5 91
2M10_16S 689 5 92
2M10_19 33,294 5 93
2M10_19S 695 5 98
2M11_07 32,673 2 99
2M11_07S 695 2 99
2M11_13 32,676 2 92
2M11_13S 695 2 100
2M11_18 32,680 2 99
2M11_18S 695 2 99
2M12_04 33,100 2 98
2M12_04S 702 2 97
2M12_07 33,093 3 94
2M12_07S 702 3 98
2M12_18 33,098 3 89
2M12_18S 702 3 99
Last updated 17 December 2008 (GF)

Printer-friendly Version


IES    
NCES
National Center for
Education Statistics
Explore the Institute of Education Sciences