NAEP Scoring → Scoring Monitoring → Within-Year Interrater Agreement → Science Interrater Agreement → Item-by-Item Interrater Agreement, Science Assessment, by Grade: 2009

NAEP Technical DocumentationItem-by-item interrater agreement, science assessment, by grade: 2009

Grade	Item	Part	Number of responses scored	Score points	Agreement
† Not applicable. NOTE: Separate statistics are provided for each part of multi-part items. Item = identifier for each NAEP question; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. Items with "EN" (English) and "SP" (Spanish) at the end of the identifier were in bilingual booklets in which the student has the option of answering in whichever language he/she prefers. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2009 Science Assessment.
4	09F1S10_03	Part A	34,688	3	95
	09F1S10_03	Part B	34,688	3	94
	09F1S10_03	Part C	34,688	3	95
	09F1S10_05	†	34,688	3	93
	09F1S10_10	†	34,688	3	86
	09F1S10_14	†	34,688	3	90
	09F1S10_15	†	34,688	4	91
	09F1S11_04	†	34,164	2	95
	09F1S11_08	†	34,164	5	84
	09F1S11_09	†	34,164	3	92
	09F1S11_11	†	34,164	3	93
	09F1S11_14	†	34,164	3	95
	09F1S21_01	†	2,151	5	98
	09F1S21_02	Part A	2,151	4	78
	09F1S21_02	Part B	2,151	4	78
	09F1S21_03	Part A	2,151	4	85
	09F1S21_03	Part B	2,151	4	82
	09F1S21_04	†	2,151	3	84
	09F1S21_05	†	2,151	4	92
	09F1S22_01	†	2,151	3	95
	09F1S22_02	†	2,151	3	93
	09F1S22_03	†	2,151	4	93
	09F1S22_04	Part A	2,151	2	100
	09F1S22_04	Part B	2,151	2	99
	09F1S22_04	Part C	2,151	2	99
	09F1S22_05	†	2,151	4	92
	09F1S22_06	†	2,151	3	87
	09F1S22_07	Part A	2,151	3	98
	09F1S22_07	Part B	2,151	3	98
	09F1S22_08	†	2,151	3	97
	09F1S25EXT_05	†	1,906	4	80
	09F1S25EXT_07	†	1,898	4	88
	09F1S25EXT_08	†	1,898	4	89
	09F1S25EXT_09	†	1,868	3	89
	09F1S25EXT_11	†	1,831	3	82
	09F1S26_01	†	2,002	2	100
	09F1S26_02	†	2,002	3	99
	09F1S26_03	†	2,002	2	99
	09F1S26_04	†	2,002	3	94
	09F1S26_05	†	2,002	4	87
	09F1S26_06	†	2,000	4	87
	09F1S26_07	†	2,000	4	89
	09F1S26_08	Part A	2,000	3	94
	09F1S26_08	Part B	2,000	3	90
	09F1S26_08	Part C	2,000	3	92
	09F1S27_01	Part A	1,999	3	99
	09F1S27_01	Part B	1,999	3	99
	09F1S27_02	Part A	1,999	3	98
	09F1S27_02	Part B	1,999	3	99
	09F1S27_05	†	1,999	3	90
	09F1S27_06	†	1,999	4	88
	09F1S27_07	†	1,996	4	94
	09F1S3_03	†	36,238	4	88
	09F1S3_03EN	†	460	4	97
	09F1S3_03SP	†	460	4	85
	09F1S3_07	†	36,238	3	90
	09F1S3_07EN	†	460	3	97
	09F1S3_07SP	†	460	3	89
	09F1S3_10	†	36,238	3	87
	09F1S3_10EN	†	460	3	97
	09F1S3_10SP	†	460	3	91
	09F1S3_13	†	36,238	4	91
	09F1S3_13EN	†	460	4	97
	09F1S3_13SP	†	460	4	91
09F1S3_15	†	36,238	3	87
09F1S3_15EN	†	460	3	97
09F1S3_15SP	†	460	3	90
09F1S4_04	†	34,609	3	96
09F1S4_04EN	†	460	3	99
09F1S4_04SP	†	460	3	97
09F1S4_05	†	34,609	2	93
09F1S4_05EN	†	460	2	98
09F1S4_05SP	†	460	2	86
09F1S4_06	†	34,609	2	94
09F1S4_06EN	†	460	2	99
09F1S4_06SP	†	460	2	85
09F1S4_08	†	34,609	3	89
09F1S4_08EN	†	460	3	96
09F1S4_08SP	†	460	3	91
09F1S4_10	†	34,609	4	90
09F1S4_10EN	†	460	4	100
09F1S4_10SP	†	460	4	92
09F1S5_03	†	34,494	3	94
09F1S5_03EN	†	462	3	98
09F1S5_03SP	†	462	3	96
09F1S5_04	†	34,494	3	90
09F1S5_04EN	†	462	3	93
09F1S5_04SP	†	462	3	82
09F1S5_05	†	34,494	3	89
09F1S5_05EN	†	462	3	98
09F1S5_05SP	†	462	3	82
09F1S5_14	†	34,494	3	91
09F1S5_14EN	†	462	3	97
09F1S5_14SP	†	462	3	90
09F1S5_16	†	34,494	3	94
09F1S5_16EN	†	462	3	99
09F1S5_16SP	†	462	3	97
09F1S6_06	†	34,514	3	89
09F1S6_06EN	†	462	3	99
09F1S6_06SP	†	462	3	94
09F1S6_08	Part A	34,514	2	99
09F1S6_08	Part B	34,514	2	100
09F1S6_08	Part C	34,514	2	100
09F1S6_08	Part D	34,514	2	100
09F1S6_08EN	Part A	462	2	100
09F1S6_08EN	Part B	462	2	100
09F1S6_08EN	Part C	462	2	100
09F1S6_08EN	Part D	462	2	100
09F1S6_08SP	Part A	462	2	97
09F1S6_08SP	Part B	462	2	97
09F1S6_08SP	Part C	462	2	96
09F1S6_08SP	Part D	462	2	97
09F1S6_10	†	34,514	3	90
09F1S6_10EN	†	462	3	98
09F1S6_10SP	†	462	3	82
09F1S6_11	†	34,514	4	85
09F1S6_11EN	†	462	4	98
09F1S6_11SP	†	462	4	94
09F1S6_13	†	34,514	3	81
09F1S6_13EN	†	462	3	100
09F1S6_13SP	†	462	3	91
09F1S7_05	†	34,437	3	90
09F1S7_07	†	34,437	4	94
09F1S7_08	†	34,437	3	92
09F1S7_10	†	34,437	3	93
09F1S7_11	†	34,437	3	94
09F1S7_13	†	34,437	3	91
09F1S8_03	†	34,492	3	88
09F1S8_06	†	34,492	3	94
09F1S8_09	†	34,492	4	88
09F1S8_13	Part A	34,492	3	90
09F1S8_13	Part B	34,492	3	92
09F1S8_13	Part C	34,492	3	90
09F1S8_15	†	34,492	3	95
09F1S9_06	†	34,550	3	96
09F1S9_07	†	34,550	5	80
09F1S9_11	†	34,550	3	98
09F1S9_14	Part A	34,550	3	89
09F1S9_14	Part B	34,550	3	94
8	09F2S10_06	Part A	30,228	2	99
	09F2S10_06	Part B	30,228	2	100
	09F2S10_06	Part C	30,228	2	100
	09F2S10_07	Part A	30,228	3	92
	09F2S10_07	Part B	30,228	3	97
	09F2S10_09	†	30,228	3	91
	09F2S10_10	†	30,228	5	82
	09F2S10_12	†	30,228	3	89
	09F2S10_14	†	30,228	4	86
	09F2S10_16	Part A	30,228	3	85
	09F2S10_16	Part B	30,228	3	87
	09F2S10_16	Part C	30,228	3	87
	09F2S11_05	†	30,171	5	91
	09F2S11_06	†	30,171	3	92
	09F2S11_07	†	30,171	3	90
	09F2S11_08	†	30,171	3	94
	09F2S11_10	†	30,171	4	97
	09F2S11_11	Part A	30,171	2	93
	09F2S11_11	Part B	30,171	3	93
	09F2S11_14	†	30,171	4	91
	09F2S12_06	†	30,230	3	84
	09F2S12_07	†	30,230	3	92
	09F2S12_08	†	30,230	3	84
	09F2S12_09	†	30,230	3	92
	09F2S12_11	†	30,230	4	86
	09F2S12_12	†	30,230	5	90
	09F2S21_01	Part A	2,335	4	80
	09F2S21_01	Part B	2,335	4	78
	09F2S21_01	Part C	2,335	4	79
	09F2S21_01	Part D	2,335	4	88
	09F2S21_02	Part A	2,335	4	84
	09F2S21_02	Part B	2,335	4	74
	09F2S21_02	Part C	2,335	4	78
	09F2S21_02	Part D	2,335	4	94
	09F2S21_02	Part E	2,335	5	84
	09F2S21_03	Part A	2,335	5	92
	09F2S21_03	Part B	2,335	3	94
	09F2S21_04	Part A	2,335	3	98
	09F2S21_04	Part B	2,335	3	86
	09F2S21_04	Part C	2,335	3	85
	09F2S21_05	Part A	2,335	3	99
	09F2S21_05	Part B	2,335	3	89
	09F2S22_01	Part A	2,335	4	94
	09F2S22_01	Part B	2,335	4	86
	09F2S22_01	Part C	2,335	4	87
	09F2S22_01	Part D	2,335	4	92
	09F2S22_02	Part A	2,335	3	95
	09F2S22_02	Part B	2,335	3	98
	09F2S22_02	Part C	2,335	3	96
	09F2S22_03	†	2,335	4	95
	09F2S22_04	Part A	2,335	4	98
	09F2S22_04	Part B	2,335	4	92
	09F2S22_04	Part C	2,335	4	93
	09F2S22_04	Part D	2,335	4	97
	09F2S22_04	Part E	2,335	4	97
	09F2S25EXT_05	†	2,079	3	87
	09F2S25EXT_06	†	2,079	3	86
	09F2S25EXT_07	†	2,074	3	88
	09F2S25EXT_08	†	2,049	4	91
	09F2S25EXT_0910	Item 09	1,921	3	92
	09F2S25EXT_0910	Item 10	1,921	3	87
	09F2S25EXT_11	†	1,633	3	92
	09F2S26_01	†	2,133	3	85
	09F2S26_02	†	2,132	3	83
09F2S26_03	Part A	2,132	2	100
09F2S26_03	Part B	2,132	2	98
09F2S26_03	Part C	2,132	2	99
09F2S26_03	Part D	2,132	2	98
09F2S26_05	†	2,132	3	86
09F2S27_02	†	2,131	4	89
09F2S27_03	†	2,131	4	77
09F2S27_04	†	2,131	4	87
09F2S27_05	†	2,130	4	93
09F2S27_06	†	2,130	4	86
09F2S3_03	†	30,427	3	89
09F2S3_03EN	†	125	3	100
09F2S3_03SP	†	125	3	97
09F2S3_06	†	30,427	5	86
09F2S3_06EN	†	125	5	97
09F2S3_06SP	†	125	5	91
09F2S3_07	†	30,427	4	92
09F2S3_07EN	†	125	4	97
09F2S3_07SP	†	125	4	97
09F2S3_14	†	30,427	5	80
09F2S3_14EN	†	125	5	100
09F2S3_14SP	†	125	5	100
09F2S3_15	†	30,427	4	96
09F2S3_15EN	†	125	4	100
09F2S3_15SP	†	125	4	100
09F2S4_02	†	30,386	5	89
09F2S4_02EN	†	125	5	100
09F2S4_02SP	†	125	5	91
09F2S4_11	†	30,386	4	84
09F2S4_11EN	†	125	4	97
09F2S4_11SP	†	125	4	94
09F2S4_13	†	30,386	3	92
09F2S4_13EN	†	125	3	97
09F2S4_13SP	†	125	3	91
09F2S4_15	†	30,386	3	87
09F2S4_15EN	†	125	3	97
09F2S4_15SP	†	125	3	97
09F2S4_16	†	30,386	5	85
09F2S4_16EN	†	125	5	97
09F2S4_16SP	†	125	5	81
09F2S5_05	†	30,287	4	95
09F2S5_05EN	†	102	4	96
09F2S5_05SP	†	102	4	100
09F2S5_08	†	30,287	3	89
09F2S5_08EN	†	102	3	96
09F2S5_08SP	†	102	3	96
09F2S5_09	†	30,287	4	92
09F2S5_09EN	†	102	4	100
09F2S5_09SP	†	102	4	100
09F2S5_10	†	30,287	3	87
09F2S5_10EN	†	102	3	100
09F2S5_10SP	†	102	3	85
09F2S5_15	†	30,287	5	88
09F2S5_15EN	†	102	5	96
09F2S5_15SP	†	102	5	92
09F2S6_04	†	30,292	4	90
09F2S6_04EN	†	103	4	100
09F2S6_04SP	†	103	4	96
09F2S6_05	†	30,292	3	90
09F2S6_05EN	†	103	3	96
09F2S6_05SP	†	103	3	92
09F2S6_07	†	30,292	5	79
09F2S6_07EN	†	103	5	88
09F2S6_07SP	†	103	5	81
09F2S6_10	†	30,292	3	90
09F2S6_10EN	†	103	3	96
09F2S6_10SP	†	103	3	100
09F2S6_14	†	30,292	3	89
09F2S6_14EN	†	103	3	100
09F2S6_14SP	†	103	3	96
09F2S6_15	†	30,292	3	85
09F2S6_15EN	†	103	3	92
09F2S6_15SP	†	103	3	96
09F2S7_04	Part A	30,278	3	91
09F2S7_04	Part B	30,278	3	91
09F2S7_04	Part C	30,278	3	93
09F2S7_09	†	30,278	5	80
09F2S7_10	†	30,278	4	95
09F2S7_12	†	30,278	3	91
09F2S7_13	†	30,278	5	92
09F2S7_14	Part A	30,278	3	86
09F2S7_14	Part B	30,278	3	90
09F2S8_06	†	30,352	4	96
09F2S8_09	†	30,352	5	86
09F2S8_11	†	30,352	2	92
09F2S8_12	†	30,352	3	81
09F2S8_13	†	30,352	4	84
09F2S9_03	†	30,189	4	86
09F2S9_06	†	30,189	4	95
09F2S9_08	†	30,189	3	91
09F2S9_09	†	30,189	4	89
09F2S9_12	†	30,189	4	96
12	09F3S10_03	†	2,016	5	97
	09F3S10_05	Part A	2,016	3	87
	09F3S10_05	Part B	2,016	3	91
	09F3S10_06	†	2,016	3	92
	09F3S10_09	Part A	2,016	3	91
	09F3S10_09	Part B	2,016	3	86
	09F3S10_09	Part C	2,016	3	93
	09F3S10_12	†	2,016	4	95
	09F3S11_05	†	2,066	4	85
	09F3S11_09	†	2,066	3	90
	09F3S11_10	†	2,066	3	98
	09F3S11_12	†	2,066	3	85
	09F3S11_13	†	2,066	4	96
	09F3S12_04	†	2,014	3	95
	09F3S12_05	†	2,014	5	67
	09F3S12_07	†	2,014	3	88
	09F3S12_10	†	2,014	4	92
	09F3S12_11	†	2,014	4	92
	09F3S13_04	†	2,056	5	81
	09F3S13_05	†	2,056	3	89
	09F3S13_06	Part A	2,056	3	98
	09F3S13_06	Part B	2,056	3	95
	09F3S13_07	†	2,056	3	86
	09F3S13_10	†	2,056	4	98
	09F3S21_01	†	2,059	3	86
	09F3S21_02	Part A	2,059	4	96
	09F3S21_02	Part B	2,059	4	96
	09F3S21_03	Part A	2,059	3	96
	09F3S21_03	Part B	2,059	3	93
	09F3S21_04	Part A	2,059	3	93
	09F3S21_04	Part B	2,059	3	94
	09F3S21_04	Part C	2,059	3	96
	09F3S21_04	Part D	2,059	3	96
	09F3S21_04	Part E	2,059	3	96
	09F3S21_05	†	2,059	3	90
	09F3S21_06	†	2,059	3	96
	09F3S22_01	†	2,059	3	86
	09F3S22_02	Part A	2,059	4	77
	09F3S22_02	Part B	2,059	4	88
	09F3S22_03	Part A	2,059	4	91
	09F3S22_03	Part B	2,059	4	95
	09F3S22_03	Part C	2,059	4	97
	09F3S22_04	Part A	2,059	3	88
	09F3S22_04	Part B	2,059	3	89
	09F3S22_04	Part C	2,059	3	91
	09F3S22_05	†	2,059	3	90
	09F3S22_06	Part A	2,059	3	89
	09F3S22_06	Part B	2,059	3	85
	09F3S22_07	†	2,059	3	93
	09F3S25EXT_03	†	1,988	3	85
	09F3S25EXT_04	†	1,988	3	91
	09F3S25EXT_0507	Item 5	1,984	4	88
	09F3S25EXT_0507	Item 7	1,984	3	85
	09F3S25EXT_06	†	1,957	4	86
	09F3S25EXT_10	†	1,860	3	92
	09F3S25EXT_11	†	1,821	3	95
	09F3S25EXT_12	Part A	1,676	4	99
	09F3S25EXT_12	Part B	1,676	3	95
	09F3S25EXT_13	Part A	1,575	4	97
	09F3S25EXT_13	Part B	1,575	3	96
	09F3S25EXT_14	†	1,511	3	96
	09F3S25EXT_15	†	1,435	3	86
	09F3S26_01	†	2,037	4	86
	09F3S26_03	†	2,037	4	88
09F3S26_04	†	2,037	4	77
09F3S26_05	†	2,037	4	85
09F3S26_06	†	2,037	4	86
09F3S27_01	Part A	2,035	3	98
09F3S27_01	Part B	2,035	3	81
09F3S27_01	Part C	2,035	4	84
09F3S27_04	†	2,035	3	93
09F3S27_05	†	2,035	3	98
09F3S27_06	†	2,035	4	93
09F3S3_04	†	2,080	5	93
09F3S3_05	Part A	2,080	3	87
09F3S3_05	Part B	2,080	3	92
09F3S3_07	†	2,080	3	85
09F3S3_11	†	2,080	5	90
09F3S3_12	†	2,080	3	92
09F3S3_14	†	2,080	3	96
09F3S4_03	†	2,010	5	82
09F3S4_06	†	2,010	4	86
09F3S4_07	†	2,010	4	90
09F3S4_12	†	2,010	3	95
09F3S4_15	†	2,010	4	90
09F3S5_02	†	2,014	3	90
09F3S5_06	†	2,014	3	95
09F3S5_07	†	2,014	4	91
09F3S5_10	†	2,014	3	89
09F3S5_15	†	2,014	4	95
09F3S6_02	†	2,083	4	93
09F3S6_04	Part A	2,083	3	88
09F3S6_04	Part B	2,083	3	95
09F3S6_04	Part C	2,083	3	92
09F3S6_04	Part D	2,083	3	96
09F3S6_06	†	2,083	3	87
09F3S6_10	†	2,083	3	95
09F3S6_15	†	2,083	3	85
09F3S7_04	†	2,079	4	94
09F3S7_05	†	2,079	3	91
09F3S7_06	†	2,079	4	94
09F3S7_08	†	2,079	3	95
09F3S7_12	†	2,079	3	92
09F3S7_14	†	2,079	3	89
09F3S8_03	†	2,092	5	85
09F3S8_05	†	2,092	4	93
09F3S8_07	†	2,092	3	95
09F3S8_09	†	2,092	3	93
09F3S8_11	Part A	2,092	3	91
09F3S8_11	Part B	2,092	3	94
09F3S8_12	†	2,092	5	97
09F3S9_04	†	2,100	5	82
09F3S9_07	†	2,100	3	91
09F3S9_10	†	2,100	3	92
09F3S9_12	†	2,100	3	95
09F3S9_14	†	2,100	4	99
09F3S9_15	†	2,100	4	92

Printer-friendly Version