NAEP Technical DocumentationItem-by-item interrater agreement, grade 8 technology and engineering literacy (TEL) national assessment: 2014

NAEP ID	Number of responses scored	Score points	Agreement
14K2TDM02_02	2,729	3	87
14K2TDM09_06	2,729	2	86
14K2TDM12_02	2,901	2	96
14K2TDM12_03	2,789	2	99
14K2TDM12_05	2,692	2	91
14K2TDM13_04	2,681	3	86
14K2TDM16_04	2,547	2	92
14K2TDM16_05	2,342	2	91
14K2TDM17_02	2,712	2	91
14K2TDM17_04	2,579	3	98
14K2TDM20_02	2,728	2	86
14K2TDM20_07	2,507	2	97
14K2TDM21_07	2,661	3	96
14K2TDM24_02	2,902	3	81
14K2TDM25_03	2,694	2	93
14K2TDM25_04	2,599	2	90
14K2TDM25_05	2,396	2	92
14K2TDM28_02	2,737	2	91
14K2TDM32_03	2,780	2	94
14K2TDM32_04	2,678	2	94
14K2TDM32_05	2,586	2	92
14K2TDM32_08	2,601	2	86
14K2TDM33_06	2,406	2	89
14K2TDM33_07	2,852	2	91
14K2TDM33_08	2,652	2	91
14K2TDM33_09	2,549	2	90
14K2TDM33_11	2,465	2	90
14K2TDM35_04	2,628	3	88
14K2TDM35_05	2,818	2	91
14K2TDM35_06	2,715	2	90
14K2TDM35_07	2,602	2	93
14K2TDM35_08	2,433	2	91
14K2TDM35_09	2,401	3	91
14K2TDM35_10	2,707	2	97
14K2TDM35_11	2,533	2	94
14K2TTM01_06	2,811	2	94
14K2TTM01_07	2,796	2	93
14K2TTM01_08	2,763	3	93
14K2TTM03_05	2,768	2	93
14K2TTM04_03	2,928	2	89
14K2TTM04_07	2,921	3	85
14K2TTM04_09	2,881	3	89
14K2TTM04_10	2,834	2	89
14K2TTM04_11	2,752	3	94
14K2TTM05_02	2,842	3	89
14K2TTM05_04	2,840	3	94
14K2TTM05_05	2,840	2	91
14K2TTM05_06	2,836	3	79
14K2TTM05_07	2,809	3	95
14K2TTM05_08	2,768	2	92
14K2TTM05_10	2,667	2	95
14K2TTM06_01	2,786	2	96
14K2TTM06_02	2,786	2	93
14K2TTM06_03	2,786	2	90
14K2TTM06_04	2,786	2	92
14K2TTM06_05	2,786	3	88
14K2TTM06_06	2,786	2	96
14K2TTM06_07	2,786	2	96
14K2TTM06_08	2,786	2	89
14K2TTM06_10	2,786	2	94
14K2TTM06_11	2,786	3	82
14K2TTM07_01	2,860	3	90
14K2TTM07_02	2,860	2	98
14K2TTM07_03	2,863	3	88
14K2TTM07_04	2,856	4	82
14K2TTM07_05	2,849	2	90
14K2TTM07_07	2,763	3	97
14K2TTM08_01	2,814	2	96
14K2TTM08_03	2,814	2	99
14K2TTM08_04	2,812	4	83
14K2TTM08_06	2,740	2	88
14K2TTM08_07	2,660	3	84
14K2TTM10_03	2,787	2	95
14K2TTM10_04	2,736	3	87
14K2TTM11_01	2,867	4	84
14K2TTM11_02	2,853	3	92
14K2TTM14_06	3,288	3	90
14K2TTM15_07	2,751	4	85
14K2TTM18_02	2,845	3	92
14K2TTM18_03	2,835	2	92
14K2TTM18_04	2,815	2	95
14K2TTM19_03	2,800	2	91
14K2TTM19_05	2,794	2	92
14K2TTM22_04	2,689	4	88
14K2TTM22_05	2,689	4	86
14K2TTM23_03	2,894	3	81
14K2TTM23_04	2,874	3	92
14K2TTM23_05	2,822	3	93
14K2TTM23_06	2,548	3	87
14K2TTM26_02	2,870	3	93
14K2TTM26_03	2,870	2	91
14K2TTM26_04	2,866	2	97
14K2TTM26_05	2,836	3	93
14K2TTM26_06	2,755	3	85
14K2TTM27_03	2,834	3	86
14K2TTM30_02	2,824	3	84
14K2TTM30_05	2,713	3	88
14K2TTM34_06	3,274	2	99
NOTE: NAEP ID = identifier for each NAEP question; Score points = number of score levels for an item; Agreement = percent exact agreement between first and second scores. In 2014, the first national assessment of Technology and Engineering Literacy (TEL) was administered to eighth-graders on computer. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 TEL Assessment.

Printer-friendly Version