NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items From the Previous Year 2010, Rescored in 2014, Grade 8 U.S. History National Assessment, by Item and Block: 2014

Score range and percentage of exact agreement for the constructed-response items from the previous year 2010, rescored in 2014, grade 8 U.S. history national assessment, by item and block: 2014

Block	Item	Range of response codes	Sample size	Percentage of exact agreement
HC	H035801	1-3	800	88
HC	H035901	1-3	800	89
HC	H035902	1-3	800	86
HC	H036101	1-3	800	87
HC	H036402	1-4	800	78
HD	H059001	1-3	800	86
HD	H059201	1-3	800	80
HD	H059701	1-3	800	90
HD	H059801	1-3	800	86
HE	H038103	1-4	700	87
HE	H038301	1-3	800	93
HE	H038601	1-3	800	85
HE	H038702	1-3	800	84
HE	H039001	1-3	800	97
HF	H069001	1-3	800	73
HF	H069401	1-3	800	87
HF	H069601	1-3	800	90
HF	H069801	1-4	800	81
HF	H070001	1-2	800	94
HG	H084901	1-3	800	88
HG	H082301	1-3	800	83
HG	H090201	1-4	800	84
HG	H084301	1-4	800	84
HH	H097801	1-4	800	75
HH	H088401	1-4	800	78
HH	H082901	1-3	800	77
HH	H091101	1-4	800	85
HI	H084801	1-3	800	84
HI	H097901	1-3	800	98
HI	H082402	1-3	800	90
HI	H088301	1-3	800	89
HI	H087401	1-4	800	79
HJ	H042201	1-3	800	91
HJ	H042801	1-4	800	83
HJ	H042902	1-3	800	88
HJ	H043001	1-3	800	76
HJ	H043101	1-3	800	82
HK	H070401	1-3	800	86
HK	H070701	1-4	800	97
HK	H070801	1-3	800	91
HK	H071001	1-4	800	84
HK	H071601	1-3	800	83
HL	H071901	1-3	800	81
HL	H072601	1-3	800	85
HL	H072701	1-4	800	90
HL	H073001	1-3	800	84
HL	H073101	1-3	800	80
NOTE: Special codes assigned to student responses including blank, off-task, and not-scorable were included in the calculation of the Percentage of Exact Agreement measure. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 U.S. History Assessment.

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items from the previous year 2010, rescored in 2014, grade 8 U.S. history national assessment, by item and block: 2014

Block	Item	Range of response codes	Sample size	Cohen’s Kappa	Intraclass correlation
H3	H035801	1-3	800	.68	.79
H3	H035901	1-3	800	.83	.84
H3	H035902	1-3	800	.69	.81
H3	H036101	1-3	800	.76	.85
H3	H036402	1-4	800	.67	.85
H4	H059001	1-3	800	.78	.89
H4	H059201	1-3	800	.66	.79
H4	H059701	1-3	800	.78	.89
H4	H059801	1-3	800	.76	.86
H5	H038103	1-4	700	.55	.70
H5	H038301	1-3	800	.88	.94
H5	H038601	1-3	800	.61	.68
H5	H038702	1-3	800	.64	.69
H5	H039001	1-3	800	.92	.96
H6	H069001	1-3	800	.54	.71
H6	H069401	1-3	800	.74	.84
H6	H069601	1-3	800	.81	.84
H6	H069801	1-4	800	.70	.84
H6	H070001	1-2	800	.86	†
H7	H084901	1-3	800	.79	.89
H7	H082301	1-3	800	.72	.84
H7	H090201	1-4	800	.69	.90
H7	H084301	1-4	800	.73	.85
H8	H097801	1-4	800	.61	.84
H8	H088401	1-4	800	.67	.84
H8	H082901	1-3	800	.61	.74
H8	H091101	1-4	800	.77	.92
H9	H084801	1-3	800	.64	.71
H9	H097901	1-3	800	.97	.98
H9	H082402	1-3	800	.78	.87
H9	H088301	1-3	800	.73	.79
H9	H087401	1-4	800	.61	.73
H10	H042201	1-3	800	.73	.78
H10	H042801	1-4	800	.68	.80
H10	H042902	1-3	800	.80	.89
H10	H043001	1-3	800	.52	.64
H10	H043101	1-3	800	.67	.75
H11	H070401	1-3	800	.75	.83
H11	H070701	1-4	800	.92	.98
H11	H070801	1-3	800	.82	.86
H11	H071001	1-4	800	.69	.78
H11	H071601	1-3	800	.68	.79
H12	H071901	1-3	800	.69	.82
H12	H072601	1-3	800	.54	.57
H12	H072701	1-4	800	.84	.92
H12	H073001	1-3	800	.73	.84
H12	H073101	1-3	800	.67	.81
† The Intraclass correlation is not reported for dichotomously scored items. NOTE: The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including blank, off-task, and not-scorable were not included in the calculation of Cohen's Kappa or intraclass correlation. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 U.S. History Assessment.

Printer-friendly Version