NAEP TECHNICAL DOCUMENTATION2015 Summary Comparison Tables

The tables below summarize the percentage differences across item-response categories for the 2015 NAEP assessments. For each subject's instrument, the presented statistics include the difference in item response-category percentages across all the items in a group. In some circumstances, an item may have more than one response option or prompt. The percentages presented include the minimum, maximum, average, and median difference, all of which are expressed based upon the absolute value of the difference at the item-response level.

Summary of quality control error analysis for data processing of cognitive blocks in student booklets, by grade and assessment: 2015

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response-category level
					Minimum	Maximum	Average	Median
Reading	4	118	23,559	719	#	0.29	0.05	0.04
	8	164	17,757	566	#	0.30	0.05	0.04
	12	154	2,486	26	#	1.23	0.20	0.13
Mathematics	4	159	27,971	231	#	0.17	0.03	0.02
	8	163	27,433	265	#	0.18	0.04	0.03
	12	215	1,880	26	#	1.43	0.24	0.18
Science	4	180	25,601	57	#	0.18	0.03	0.02
	8	193	22,058	28	#	0.14	0.03	0.03
	12	215	2,002	22	#	1.10	0.17	0.12
# Rounds to zero. NOTE: Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2015 Assessment.

Summary of quality control error analysis for data processing of student survey questionnaires, by grade and assessment: 2015

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response-category level
					Minimum	Maximum	Average	Median
Core (reading, mathematics, and science)	4	27	402,641	444	#	0.06	0.01	0.01
	8	29	211,580	322	#	0.13	0.04	0.04
	12	43	19,622	335	#	0.64	0.22	0.20
Reading	4	20	139,554	186	#	0.05	0.02	0.02
	8	33	136,097	121	#	0.09	0.03	0.03
	12	38	17,218	210	#	0.87	0.21	0.21
Mathematics	4	19	133,228	149	#	0.06	0.02	0.01
	8	34	129,284	198	#	0.06	0.02	0.01
	12	59	10,535	207	#	1.78	0.36	0.27
Science	4	32	107,287	127	#	0.06	0.01	0.01
	8	47	102,855	10	#	0.05	0.02	0.02
	12	64	7,490	119	#	1.09	0.30	0.26
# Rounds to zero. NOTE: Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2015 Assessment.

Summary of quality control error analysis for data processing of school questionnaires, by grade and assessment: 2015

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response-category level
					Minimum	Maximum	Average	Median
Reading, mathematics, and science	4	188	6,785	0	#	#	#	#
Reading, mathematics, and science	8	196	6,036	0	#	#	#	#
Reading, mathematics, and science	12	253	1,660	0	#	#	#	#
# Rounds to zero. NOTE: Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2015 Assessment.

Summary of quality control error analysis for data processing of teacher questionnaires, by grade and assessment: 2015 

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response-category level
					Minimum	Maximum	Average	Median
Core (reading, mathematics, and science)	4	291	20,974	4,320	#	10.74	0.68	0.28
Core (reading, mathematics, and science)	8	129	16,700	3,711	#	8.38	1.06	0.55
Reading	8	47	15,959	5,393	#	10.99	1.52	1.04
Mathematics	8	35	15,992	4,408	#	11.88	1.59	1.06
Science	8	83	11,814	2,577	#	10.36	0.64	0.36
# Rounds to zero. NOTE: Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2015 Assessment.

Printer-friendly Version