NAEP Technical Documentation

Score range and percentage of exact agreement for the constructed-response items used in scaling, grade 8 geography national assessment, by item and block: 2014

Block	Item	Range of response codes	Sample size	Percentage of exact agreement
NOTE: Special codes assigned to student responses including blank, off-task, and not-scorable were included in the calculation of the Percentage of Exact Agreement measure. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 Geography Assessment.
G3	G013402	1-3	600	92
G3	G014001	1-3	600	98
G3	G014201	1-4	600	86
G3	G014301	1-3	600	80
G3	G014401	1-3	600	92
G4	G032901	1-3	600	86
G4	G033301	1-3	600	84
G4	G033501	1-4	600	73
G4	G033801	1-3	600	89
G4	G034101	1-3	600	79
G5	G046701	1-3	600	79
G5	G048702	1-2	600	88
G5	G050001	1-4	600	97
G5	G050301	1-4	600	82
G5	G050801	1-3	600	80
G6	G034801	1-4	600	94
G6	G035001	1-4	600	79
G6	G035301	1-4	600	86
G6	G035501	1-4	600	86
G7	G051601	1-4	600	99
G7	G052501	1-3	600	97
G7	G052901	1-3	600	92
G7	G053601	1-3	600	93
G8	G046301	1-4	600	95
G8	G048101	1-3	600	85
G8	G049001	1-3	600	93
G8	G049401	1-3	600	90
G8	G049701	1-3	600	80
G9	G019002	1-3	600	97
G9	G019003	1-3	600	90
G9	G019102	1-3	600	93
G9	G019202	1-3	600	88
G9	G019302	1-3	600	95
G9	G019402	1-3	600	91
G9	G019901	1-4	600	91
G9	G020001	1-3	600	97
G9	G020201	1-3	600	93
G9	G020302	1-3	600	92

 

Score range, Cohen's Kappa, and intraclass correlation for the constructed-response items used in scaling, grade 8 geography national assessment, by item and block: 2014

Block	Item	Range of response codes	Sample size	Cohen’s Kappa	Intraclass correlation
† The intraclass correlation is not reported for dichotomously scored items. NOTE: The intraclass correlation is most appropriate for items with more than two categories. Cohen's Kappa is a measure of reliability that is appropriate for both dichotomously and polytomously scored items. Special codes assigned to student responses including blank, off-task, and not-scorable were not included in the calculation of Cohen's Kappa or intraclass correlation. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 Geography Assessment.
G3	G013402	1-3	500	.80	.84
G3	G014001	1-3	500	.95	.97
G3	G014201	1-4	600	.79	.90
G3	G014301	1-3	500	.64	.79
G3	G014401	1-3	500	.85	.86
G4	G032901	1-3	600	.75	.80
G4	G033301	1-3	600	.72	.83
G4	G033501	1-4	600	.60	.77
G4	G033801	1-3	600	.77	.87
G4	G034101	1-3	500	.56	.63
G5	G046701	1-3	600	.62	.73
G5	G048702	1-2	600	.76	†
G5	G050001	1-4	400	.94	.98
G5	G050301	1-4	500	.68	.80
G5	G050801	1-3	500	.66	.81
G6	G034801	1-4	600	.91	.97
G6	G035001	1-4	500	.63	.80
G6	G035301	1-4	500	.79	.92
G6	G035501	1-4	400	.67	.81
G7	G051601	1-4	600	.99	1.00
G7	G052501	1-3	500	.89	.95
G7	G052901	1-3	600	.87	.93
G7	G053601	1-3	300	.77	.86
G8	G046301	1-4	500	.92	.97
G8	G048101	1-3	500	.71	.81
G8	G049001	1-3	600	.85	.90
G8	G049401	1-3	500	.83	.91
G8	G049701	1-3	500	.58	.78
G9	G019002	1-3	500	.98	.98
G9	G019003	1-3	500	.82	.87
G9	G019102	1-3	500	.84	.91
G9	G019202	1-3	500	.78	.83
G9	G019302	1-3	500	.92	.95
G9	G019402	1-3	500	.86	.92
G9	G019901	1-4	500	.85	.90
G9	G020001	1-3	500	.89	.91
G9	G020201	1-3	500	.87	.90
G9	G020302	1-3	500	.84	.92

Printer-friendly Version