NAEP Technical DocumentationItem-by-Item Interrater Agreement, Arts Assessment, by Grade: 2016

Item-by-item interrater agreement, grade 8 music assessment: 2016

​Grade	Item	Part	Number of responses scored	Score points	Agreement
​8​​	16T2MU3_01	†	2,148	3	95
	16T2MU3_02AB	Item 2A	2,148	2	95
	16T2MU3_02AB	Item 2B	2,148	2	97
	16T2MU3_03AB	Item 3A	2,148	3	90
	16T2MU3_03AB	Item 3B	2,148	3	87
	16T2MU3_04	†	2,148	2	100
	16T2MU3_06	†	2,148	3	88
	16T2MU3_10	†	2,148	4	86
	16T2MU3_12	†	2,148	2	98
	16T2MU3_14AB	Item 14A	2,148	3	91
	16T2MU3_14AB	Item 14B	2,148	3	88
	16T2MU3_15ABC	Item 15A	2,148	3	87
	16T2MU3_15ABC	Item 15B	2,148	3	90
	16T2MU3_15ABC	Item 15C	2,148	3	87
	16T2MU4_05AB	Item 5A	2,117	2	99
	16T2MU4_05AB	Item 5B	2,117	2	96
	16T2MU4_05CDE	Item 5C	2,117	2	85
	16T2MU4_05CDE	Item 5D	2,117	2	95
	16T2MU4_05CDE	Item 5E	2,117	3	87
	16T2MU4_06AB	Item 6A	2,117	3	91
	16T2MU4_06AB	Item 6B	2,117	3	82
	16T2MU4_06CDE	Item 6C	2,117	2	88
	16T2MU4_06CDE	Item 6D	2,117	3	94
	16T2MU4_06CDE	Item 6E	2,117	3	94
	16T2MU4_07	†	2,117	3	88
	16T2MU4_09	†	2,117	3	95
	16T2MU5A_04	†	2,267	4	95
	16T2MU5A_06AB	Item 6A	2,267	2	98
	16T2MU5A_06AB	Item 6B	2,267	2	98
	16T2MU5A_08AB	Item 8A	2,267	3	95
	16T2MU5A_08AB	Item 8B	2,267	3	94
	16T2MU5A_08C	†	2,267	2	97
	16T2MU5A_09ABC	Item 9A	2,267	3	86
	16T2MU5A_09ABC	Item 9B	2,267	3	81
	16T2MU5A_09ABC	Item 9C	2,267	3	88
	16T2MU5A_10	†	2,267	3	83
	16T2MU5A_11	†	2,267	3	90
	16T2MU5A_12	†	2,267	3	93
	16T2MU5A_15	†	2,267	3	85
	16T2MU5A_16	†	2,267	3	76
	16T2MU6A_01A1	†	2,164	3	90
	16T2MU6A_01A4	†	2,164	3	93
	16T2MU6A_01B1	†	2,164	3	89
	16T2MU6A_01B2	†	2,164	3	96
	16T2MU6A_01B3	†	2,164	3	92
	16T2MU6A_01B5	†	2,164	3	92
	16T2MU6A_02	†	2,164	3	96
	16T2MU6A_03	†	2,164	4	76
	16T2MU6A_05	†	2,164	5	89
	16T2MU6A_06_1ABC	Item 06_1A	2,164	3	95
	16T2MU6A_06_1ABC	Item 06_1B	2,164	4	88
	16T2MU6A_06_1ABC	Item 06_1C	2,164	3	86
	16T2MU6A_06_2ABC	Item 06_2A	2,164	3	96
	16T2MU6A_06_2ABC	Item 06_2B	2,164	4	85
	16T2MU6A_06_2ABC	Item 06_2C	2,164	3	82
	16T2MU6A_06_3ABC	Item 06_3A	2,164	3	94
	16T2MU6A_06_3ABC	Item 06_3B	2,164	4	84
	16T2MU6A_06_3ABC	Item 06_3C	2,164	3	78
	16T2MU6A_06_4ABC	Item 06_4A	2,164	3	96
	16T2MU6A_06_4ABC	Item 06_4B	2,164	4	86
	16T2MU6A_06_4ABC	Item 06_4C	2,164	3	85
† Not applicable. NOTE: Percentages of exact agreement are provided separately for each part of multi-part items. NAEP ID = identifier for each NAEP item; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. In 2016, grades 4 and 12 were not assessed SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2016 Arts Assessment.

Item-by-item interrater agreement, grade 8 visual arts national assessment: 2016

​Grade	Item	Part	Number of responses scored	Score points	Agreement
​8	16T2VA3_02	†	2,178	3	89
	16T2VA3_04AB	Item 4A	2,178	3	83
	16T2VA3_04AB	Item 4B	2,178	3	74
	16T2VA3_05	†	2,178	4	78
	16T2VA3_06AB07	Item 6A	2,178	2	97
	16T2VA3_06AB07	Item 6B	2,178	4	82
	16T2VA3_06AB07	Item 7	2,178	4	84
	16T2VA4_01	†	2,161	2	93
	16T2VA4_05AB	Item 5A	2,161	3	74
	16T2VA4_05AB	Item 5B	2,161	3	77
	16T2VA4_06AB	Item 6A	2,161	3	77
	16T2VA4_06AB	Item 6B	2,161	2	89
	16T2VA4_07	†	2,161	3	73
	16T2VA4_08	†	2,161	4	74
	16T2VA4_09	†	2,161	4	73
	16T2VA5_01	†	2,307	2	89
	16T2VA5_02	†	2,307	4	77
	16T2VA5_03	†	2,307	4	77
	16T2VA5_04	†	2,307	3	79
	16T2VA5_08	†	2,307	3	79
	16T2VA5_0910	Item 9	2,307	5	83
	16T2VA5_0910	Item 10	2,307	3	87
	16T2VA6_01	†	2,212	3	78
	16T2VA6_04	†	2,212	3	81
	16T2VA6_06ABC	Item 6A	2,212	4	79
	16T2VA6_06ABC	Item 6B	2,212	4	77
	16T2VA6_06ABC	Item 6C	2,212	4	71
	16T2VA6_07ABC	Item 7A	2,212	3	88
	16T2VA6_07ABC	Item 7B	2,212	2	84
	16T2VA6_07ABC	Item 7C	2,212	3	81
	16T2VA6_08	†	2,212	4	77
† Not applicable. NOTE: Percentages of exact agreement are provided separately for each part of multi-part items. NAEP ID = identifier for each NAEP item; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. In 2016, grades 4 and 12 were not assessed SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2016 Arts Assessment.

Printer-friendly Version