NAEP Technical Documentation2014 Summary Comparison Tables

The tables below summarize the percentage differences across item-response categories for the 2014 NAEP assessments. For each subject's instrument, the presented statistics include the difference in item response-category percentages across all the items in a group (e.g., civics, cognitive questions). In some circumstances, a question may have more than one response component. This is particularly true in TEL, where several response components form some of the scored-question responses and inflate the "item" count for TEL in the first table. The percentages presented include the minimum, maximum, average, and median difference, all of which are expressed based upon the absolute value of the difference at the item-response level.

Summary of quality control error analysis for data processing of cognitive blocks in NAEP student booklets or digital test forms, by assessment and grade: 2014

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response-category level
					Minimum	Maximum	Average	Median
# Rounds to zero. NOTE: Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 Assessment.
Civics	8	152	2,274	18	#	1.00	0.13	0.10
Geography	8	125	2,245	14	#	0.45	0.10	0.06
U.S. history	8	168	2,244	22	#	0.92	0.15	0.11
Technology and engineering literacy	8	515	2,051	158	#	1.00	0.01	#

Summary of quality control error analysis for data processing of NAEP student survey questionnaires, by assessment and grade: 2014

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response-category level
					Minimum	Maximum	Average	Median
# Rounds to zero. NOTE: The civics, geography, and U.S. history student survey questionnaire consisted of two parts: the core questions and subject-specific questions. The TEL student survey questionnaire included both core and subject-specific questions. Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 Assessment.
Core (Civics, geography, and U.S. history)	8	29	29,342	292	0.06	0.36	0.14	0.15
Civics	8	40	9,113	63	#	0.44	0.13	0.11
Geography	8	38	8,982	51	#	0.38	0.08	0.08
U.S. history	8	33	11,247	178	#	0.73	0.19	0.15
Technology and engineering literacy	8	81	21,524	55	#	0.10	#	#

Summary of quality control error analysis for data processing of NAEP school questionnaires, by assessment and grade: 2014

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response category level
					Minimum	Maximum	Average	Median
# Rounds to zero. NOTE: Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 Assessment.
Civics, geography, and U.S. history	8	97	271	8	#	2.34	0.24	0.16
Technology and engineering literacy	8	148	729	2	#	0.25	#	#

Summary of quality control error analysis for data processing of NAEP teacher questionnaires, by assessment and grade: 2014

Assessment	Grade	Number of response options/prompts	Average number of respondents in Contractor 2 database	Average difference in number of respondents between Contractor 2 database and Contractor 1 scored data	Difference in percentage at the response-category level
					Minimum	Maximum	Average	Median
# Rounds to zero. NOTE: Average difference in number of respondents is the average, across all response options, of the difference in the number of respondents for each response option in Contractor 1's file and the number in Contractor 2's file. In 2014, grades 4 and 12 were not assessed. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2014 Civics, Geography, and U.S. History Assessments.
Civics, geography, and U.S. history	8	121	700	168	#	9.33	1.02	0.52

Printer-friendly Version