Score Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Grade 8 U.S. History National Assessment, by Item and Block: 2014

Table of Contents | Search Technical Documentation | References

NAEP Analysis and Scaling → Initial Activities → Constructed-Response Interrater Reliability → Score Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Grade 8 U.S. History National Assessment, by Item and Block: 2014

NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Grade 8 U.S. History National Assessment, by Item and Block: 2014
Score range and percentage of exact agreement for the constructed-response items used in scaling, grade 8 U.S. history national assessment, by item and block: 2014
Block	Item	Range of response codes	Sample size	Percentage of exact agreement
NOTE: Special codes assigned to student responses including blank, off-task, and not-scorable were included in the calculation of the Percentage of Exact Agreement measure. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 U.S. History Assessment.
H3	H035801	1-3	600	90
H3	H035901	1-3	600	93
H3	H035902	1-3	600	84
H3	H036101	1-3	600	89
H3	H036402	1-4	600	80
H4	H059001	1-3	600	88
H4	H059201	1-3	600	81
H4	H059701	1-3	600	91
H4	H059801	1-3	600	91
H4	H060201	1-3	600	89
H5	H038103	1-4	600	92
H5	H038301	1-3	600	95
H5	H038601	1-3	600	86
H5	H038702	1-3	600	89
H5	H039001	1-3	600	98
H6	H069001	1-3	600	69
H6	H069401	1-3	600	87
H6	H069601	1-3	600	91
H6	H069801	1-4	600	79
H6	H070001	1-2	600	96
H7	H082301	1-3	600	87
H7	H084301	1-4	600	84
H7	H084901	1-3	600	91
H7	H090201	1-4	600	88
H8	H082901	1-3	600	80
H8	H088401	1-4	600	81
H8	H091101	1-4	600	87
H8	H097801	1-4	600	71
H9	H082402	1-3	600	93
H9	H084801	1-3	600	84
H9	H087401	1-4	600	83
H9	H088301	1-3	600	91
H9	H097901	1-3	600	99
H10	H042201	1-3	600	93
H10	H042801	1-4	600	83
H10	H042902	1-3	600	86
H10	H043001	1-3	600	73
H10	H043101	1-3	600	86
H11	H070401	1-3	600	86
H11	H070701	1-4	600	97
H11	H070801	1-3	600	89
H11	H071001	1-4	600	81
H11	H071601	1-3	600	82
H12	H071901	1-3	600	84
H12	H072601	1-3	600	84
H12	H072701	1-4	600	92
H12	H073001	1-3	600	86
H12	H073101	1-3	600	78

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items used in scaling, grade 8 U.S. history national assessment, by item and block: 2014
Block	Item	Range of response codes	Sample size	Cohen’s Kappa	Intraclass correlation
† The intraclass correlation is not reported for dichotomously scored items. NOTE: The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including blank, off-task, and not-scorable were not included in the calculation of Cohen's Kappa or intraclass correlation. In 2014, grade 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 U.S. History Assessment.
H3	H035801	1-3	500	.70	.83
H3	H035901	1-3	600	.89	.88
H3	H035902	1-3	500	.67	.80
H3	H036101	1-3	500	.78	.87
H3	H036402	1-4	500	.67	.84
H4	H059001	1-3	600	.81	.91
H4	H059201	1-3	500	.70	.83
H4	H059701	1-3	500	.83	.92
H4	H059801	1-3	500	.84	.93
H4	H060201	1-3	500	.82	.87
H5	H038103	1-4	500	.73	.89
H5	H038301	1-3	500	.91	.94
H5	H038601	1-3	500	.68	.73
H5	H038702	1-3	500	.76	.82
H5	H039001	1-3	500	.95	.97
H6	H069001	1-3	500	.48	.66
H6	H069401	1-3	500	.76	.86
H6	H069601	1-3	500	.83	.83
H6	H069801	1-4	500	.66	.83
H6	H070001	1-2	500	.93	†
H7	H082301	1-3	500	.77	.88
H7	H084301	1-4	500	.73	.87
H7	H084901	1-3	600	.84	.91
H7	H090201	1-4	500	.74	.89
H8	H082901	1-3	400	.60	.75
H8	H088401	1-4	500	.72	.88
H8	H091101	1-4	400	.77	.92
H8	H097801	1-4	600	.55	.79
H9	H082402	1-3	500	.82	.86
H9	H084801	1-3	500	.61	.68
H9	H087401	1-4	500	.71	.81
H9	H088301	1-3	500	.75	.83
H9	H097901	1-3	500	.98	.99
H10	H042201	1-3	500	.79	.85
H10	H042801	1-4	500	.67	.76
H10	H042902	1-3	500	.77	.87
H10	H043001	1-3	500	.46	.57
H10	H043101	1-3	500	.74	.81
H11	H070401	1-3	500	.75	.85
H11	H070701	1-4	400	.91	.98
H11	H070801	1-3	500	.79	.86
H11	H071001	1-4	600	.59	.73
H11	H071601	1-3	500	.67	.80
H12	H071901	1-3	500	.71	.83
H12	H072601	1-3	500	.55	.58
H12	H072701	1-4	500	.87	.95
H12	H073001	1-3	500	.77	.87
H12	H073101	1-3	500	.59	.74

Last updated 30 August 2021 (ML)

Printer-friendly Version

NAEP Technical DocumentationScore Range and Percentage of Exact Agreement for the Constructed-Response Items Used in Scaling, Grade 8 U.S. History National Assessment, by Item and Block: 2014