NAEP Technical Documentation Score Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Grade 4 Mathematics Combined National and State Assessment, by Block and Item: 2017

Score range and percentage of exact agreement for the constructed-response items used in scaling, grade 4 mathematics combined national and state assessment, by block and item: 2017

Block	Item	Score range	Sample size	Percentage of exact agreement
M1	M367801	1-2	1,400	100
	M369401	1-3	1,300	99
	M372901	1-3	1,200	99
	M372902	1-2	1,000	100
	M374400	1-3	1,400	97
	M374601	1-2	1,100	100
	M374602	1-2	1,000	98
M2	M369801	1-2	1,200	100
	M370001	1-3	1,200	96
	M370701	1-2	1,500	100
	M372601	1-3	1,400	99
	M373101	1-3	1,400	98
M3	M368901	1-2	1,400	100
	M368902	1-3	1,400	99
	M370401	1-2	1,600	100
	M371101	1-2	1,600	98
	M371102	1-2	1,600	98
	M371501	1-2	1,300	100
	M371502	1-3	1,300	98
M4	M342101	1-3	1,500	99
	M343001	1-2	1,500	100
	M343201	1-3	1,500	99
M5	M224301	1-3	1,400	100
	M225001	1-3	1,400	98
	M226801	1-2	1,300	97
	M338801	1-2	1,300	100
M6	M219501	1-3	1,400	94
	M220001	1-3	1,500	99
	M220701	1-3	1,400	91
	M221101	1-3	1,300	97
M7	M156101	1-3	1,400	99
	M231101	1-2	1,300	97
	M231102	1-2	1,300	99
	M231103	1-2	1,200	98
	M339401	1-3	1,300	98
M8	M375101	1-2	1,600	99
	M375401	1-2	1,600	99
	M376101	1-3	1,600	99
	M377701	1-2	1,600	100
	M378401	1-3	1,400	99
	M378601	1-3	1,300	100
	M378602	1-3	1,100	99
M9	M230301	1-2	1,500	100
	M346101	1-3	1,700	99
	M346801	1-2	1,600	100
	M346802	1-2	1,500	100
	M348301	1-2	1,400	99
M10	M227201	1-3	1,500	98
	M240601	1-2	1,500	100
	M240801	1-2	1,500	100
NOTE: Special codes assigned to student responses including omitted, off-task, and illegible were included in the calculation of the percentage of exact agreement measure. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2017 Mathematics Assessment.

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items used in scaling, grade 4 mathematics combined national and state assessment, by block and item: 2017

Block	Item	Score range	Sample size	Cohen’s Kappa	Intraclass correlation
M1	M367801	1-2	1,400	1.00	†
	M369401	1-3	1,300	.98	.99
	M372901	1-3	1,200	.90	.90
	M372902	1-2	1,000	1.00	†
	M374400	1-3	1,400	.96	.97
	M374601	1-2	1,100	.99	†
	M374602	1-2	1,000	.80	†
M2	M369801	1-2	1,200	.98	†
	M370001	1-3	1,200	.80	.89
	M370701	1-2	1,500	.99	†
	M372601	1-3	1,400	.98	.98
	M373101	1-3	1,400	.94	.94
M3	M368901	1-2	1,400	.99	†
	M368902	1-3	1,400	.83	.93
	M370401	1-2	1,600	1.00	†
	M371101	1-2	1,600	.97	†
	M371102	1-2	1,600	.96	†
	M371501	1-2	1,300	1.00	†
	M371502	1-3	1,300	.73	.79
M4	M342101	1-3	1,500	.98	.99
	M343001	1-2	1,400	1.00	†
	M343201	1-3	1,500	.98	.99
M5	M224301	1-3	1,400	.99	1.00
	M225001	1-3	1,400	.97	.98
	M226801	1-2	1,300	.94	†
	M338801	1-2	1,300	1.00	†
M6	M219501	1-3	1,400	.90	.96
	M220001	1-3	1,500	.98	.99
	M220701	1-3	1,400	.82	.87
	M221101	1-3	1,300	.96	.98
M7	M156101	1-3	1,400	.96	.96
	M231101	1-2	1,300	.93	†
	M231102	1-2	1,300	.98	†
	M231103	1-2	1,200	.96	†
	M339401	1-3	1,300	.97	.98
M8	M375101	1-2	1,600	.99	†
	M375401	1-2	1,600	.98	†
	M376101	1-3	1,600	.98	.98
	M377701	1-2	1,600	.99	†
	M378401	1-3	1,400	.97	.99
	M378601	1-3	1,300	.99	1.00
	M378602	1-3	1,100	.98	.99
M9	M230301	1-2	1,500	1.00	†
	M346101	1-3	1,700	.99	.99
	M346801	1-2	1,600	.99	†
	M346802	1-2	1,500	.99	†
	M348301	1-2	1,400	.97	†
M10	M227201	1-3	1,500	.97	.98
	M240601	1-2	1,500	1.00	†
	M240801	1-2	1,500	.99	†
† Not applicable. The intraclass correlation is not reported for dichotomously scored items. NOTE: The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including omitted, off-task, and illegible were not included in the calculation of Cohen's Kappa or intraclass correlation. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2017 Mathematics Assessment.

Printer-friendly Version