NAEP Technical DocumentationLong-Term Trend School and Student Response History

The NCES statistical standards state that weighted school response rates below 85 percent require a nonresponse bias analysis. This was done for NAEP 2004 long-term trend (NAEP Nonresponse Bias Analysis long-term trend report 2004, 202Kb). The unweighted and weighted school response rates are given for the Age 9 study in the two tables below. In some cases, substitute cases that were selected as matched pairs during the sampling process, were used to supplement the sample of schools.

Unweighted school response rates, age 9 long-term trend assessment: By school type and NAEP region, 2004
Student group	Eligible school sample	Nonresponding originally sampled schools	Responding originally sampled schools	Unweighted response rate	Recruited cooperating substitutes
Total school sample	670	130	540	80.6	40
Total public	410	50	360	88.0	20
NAEP region NE	80	10	70	93.5	#
NAEP region SE	90	#	90	97.8	0
NAEP region C	110	20	90	81.8	10
NAEP region W	130	20	110	83.2	10
Total private	270	80	190	69.3	30
Roman Catholic	110	20	100	85.6	10
Lutheran	20	#	20	80.0	#
ConservativeChristian	40	20	30	61.4	10
Other private	90	50	50	51.1	10
# Rounds to zero. NOTE: Sample sizes are rounded to nearest 10. Response rates calculated using unrounded numbers.Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

Weighted school response rates, age 9 long-term trend assessment: By school type and NAEP region, 2004
Student group	Eligible school sample	Nonresponding originally sampled schools	Responding originally sampled schools	Weighted response rate	Recruited cooperating substitutes
Total school sample	69,500	13,600	55,900	80.5	3,700
Total public	50,400	6,800	43,600	86.5	1,900
NAEP region NE	9,700	570	9,100	94.1	340
NAEP region SE	10,800	250	10,500	97.7	0
NAEP region C	13,900	2,800	11,000	79.6	720
NAEP region W	16,200	3,200	13,000	80.3	790
Total private	19,000	6,800	12,300	64.6	1,900
Roman Catholic	6,000	850	5,200	85.9	480
Lutheran	1,600	370	1,200	76.7	130
Conservative Christian	3,000	1,200	1,800	60.7	520
Other private	8,400	4,300	4,000	48.3	740
NOTE: Sample sizes are rounded to nearest ten or hundred. Response rates calculated using unrounded numbers. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

The unweighted and weighted response rates for the Age 13 study are given in the tables below.

Unweighted school response rates, age 13 long-term trend assessment: By school type and NAEP region, 2004
Student group	Eligible school sample	Nonresponding originally sampled schools	Responding originally sampled schools	Unweighted response rate	Recruited cooperating substitutes
Total school sample	590	140	460	77.2	40
Total public	330	60	270	83.1	10
NAEP region NE	60	10	50	86.4	#
NAEP region SE	80	#	80	97.4	0
NAEP region C	70	20	50	74.7	#
NAEP region W	120	30	90	77.1	10
Total private	270	80	190	70.2	20
Roman Catholic	120	20	100	84.8	10
Lutheran	20	#	20	89.5	#
Conservative Christian	40	10	30	73.2	#
Other private	90	50	40	45.6	10
# Rounds to zero. NOTE: Sample sizes are rounded to nearest ten. Response rates calculated using unrounded numbers. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

Weighted school response rates, age 13 long-term trend assessment: By school type and NAEP region, 2004
Student group	Eligible school sample	Non-responding originally sampled schools	Responding originally sampled schools	Weighted response rate	Recruited cooperating substitutes
Total school sample	52,700	13,000	39,800	75.4	2,800
Total public	35,200	7,500	27,700	78.8	1,300
NAEP region NE	6,800	560	6,200	91.7	240
NAEP region SE	6,900	180	6,700	97.4	0
NAEP region C	8,900	2,700	6,300	70.4	680
NAEP region W	12,600	4,100	8,500	67.6	380
Total private	17,600	5,500	12,100	68.7	1,500
Roman Catholic	5,800	800	5,000	86.1	460
Lutheran	1,200	100	1,100	92.3	100
Conservative Christian	3,200	590	2,700	82.0	100
Other private	7,300	4,000	3,300	45.1	810
NOTE: Sample sizes are rounded to nearest ten or hundred. Response rates calculated using unrounded numbers. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

The unweighted and weighted school response rates for the Age 17 study are given in the tables below.

Unweighted school response rates, age 17 long-term trend assessment: By school type and NAEP region, 2004
Student group	Eligible school sample	Nonresponding originally sampled schools	Responding originally sampled schools	Unweighted response rate	Recruited cooperating substitutes
Total school sample	560	170	390	69.6	30
Total public	390	80	310	78.5	20
NAEP region NE	70	10	50	79.1	#
NAEP region SE	80	#	80	97.6	0
NAEP region C	100	20	80	76.5	10
NAEP region W	140	50	100	68.5	10
Total private	170	90	90	49.7	10
Roman Catholic	50	20	30	62.0	#
Lutheran	#	#	#	75.0	0
Conservative Christian	40	20	30	63.4	#
Unknown	#	#	0	0.0	0
Other private	80	50	30	34.2	10
# Rounds to zero. NOTE: Sample sizes are rounded to nearest 10. Response rates calculated using unrounded numbers. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

Weighted school response rates, age 17 long-term trend assessment: By school type and NAEP region, 2004
Student group	Eligible school sample	Nonresponding originally sampled schools	Responding originally sampled schools	Unweighted response rate	Recruited cooperating substitutes
Total school sample	26,700	7,400	19,300	72.2	960
Total public	20,200	4,200	16,100	79.4	750
NAEP region NE	3,300	700	2,600	79.3	160
NAEP region SE	3,700	80	3,600	97.8	0
NAEP region C	5,400	1,300	4,100	75.5	330
NAEP region W	7,800	2,100	5,700	73.2	260
Total private	6,400	#	3,200	49.7	210
Roman Catholic	1,100	410	680	62.5	20
Lutheran	110	30	80	73.6	0
Conservative Christian	2,200	660	1,500	69.9	30
Unknown	380	380	0.00	0	0
Other private	2,700	1,800	910.00	34.1	160
# Rounds to zero. NOTE: Sample sizes are rounded to nearest ten or hundred. Response rates calculated using unrounded numbers. Detail may not sum to totals because of rounding. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

In every NAEP survey, some of the sampled students are not assessed:

withdrawn students,
SD excluded students,
LEP excluded students, or
students absent from both the original session and the make-up session (not excluded but not assessed).

Withdrawn students are those who have left the school before the original assessment. Excluded students are those who cannot be assessed even with an accommodation because they are disabled (SD) or have limited English proficiency (LEP). Other students who were absent for the initial session are assessed in the makeup session. The last category includes students who were not excluded, but were not assessed, either due to absence from both sessions or because of a refusal to participate. Assessed students are also classified as assessed without an accommodation or assessed with an accommodation. The latter group can be divided into SD students assessed with an accommodation, LEP students assessed with an accommodation, or students who are both SD and LEP and accommodated (students neither SD nor LEP can only be assessed without an accommodation). Note that some SD and LEP students are assessed without accommodations.

The weighted response rates utilize the student base weights, and indicate the weighted percentage of assessed students as a percentage of all students to be assessed. The exclusion rates, in contrast, provide the weighted percentage of excluded SD or LEP students as a percentage of all absent, assessed, and excluded students.

Weighted student response and exclusion rates, by school and session type, age 9 long-term trend study: 2004
School type	Session	Weighted eligible student response rate¹	Weighted percent of all students who are SD and excluded²	Weighted percent of all students who are LEP and excluded²
All	Reading Operational	94.3	3.7	2.0
	Mathematics Operational	93.9	2.2	1.0
	Reading Bridge	94.5	6.6	2.3
	Mathematics Bridge	94.3	5.6	2.2
Public	Reading Operational	94.4	4.0	2.2
	Mathematics Operational	93.9	2.4	1.1
	Reading Bridge	94.5	7.1	2.5
	Mathematics Bridge	94.2	6.2	2.5
Private	Reading Operational	93.5	0.4	0.1
	Mathematics Operational	93.3	0.6	0.2
	Reading Bridge	95.4	2.8	0.0
	Mathematics Bridge	95.4	0.4	0.2
¹ Denominator is the total eligible sample less excluded cases. ² Denominator is the total eligible sample. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

Weighted student response and exclusion rates, by school and session type, age 13 long-term trend study: 2004
School type	Session	Weighted eligible student response rate¹	Weighted percent of all students who are SD and excluded²	Weighted percent of all students who are LEP and excluded²
All	Reading Operational	92.4	4.4	1.0
	Mathematics Operational	91.8	2.7	0.8
	Reading Bridge	92.4	7.5	1.8
	Mathematics Bridge	92.1	7.2	1.5
Public	Reading Operational	92.2	4.9	1.0
	Mathematics Operational	91.6	2.9	0.9
	Reading Bridge	92.4	8.1	1.9
	Mathematics Bridge	92.0	7.8	1.7
Private	Reading Operational	94.1	0.6	0.1
	Mathematics Operational	93.6	0.5	0.2
	Reading Bridge	93.7	0.6	0.2
	Mathematics Bridge	93.9	0.4	0.0
¹ Denominator is the total eligible sample less excluded cases. ² Denominator is the total eligible sample. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

Weighted student response and exclusion rates, by school and session type, age 17 long-term trend study: 2004
School type	Session	Weighted eligible student response rate¹	Weighted percent of all students who are SD and excluded²	Weighted percent of all students who are LEP and excluded²
All	Reading Operational	76.0	3.1	1.1
	Mathematics Operational	75.4	2.8	0.7
	Reading Bridge	75.5	6.1	1.0
	Mathematics Bridge	76.4	6.2	1.6
Public	Reading Operational	75.5	3.4	1.2
	Mathematics Operational	74.9	3.0	0.8
	Reading Bridge	75.2	6.6	1.0
	Mathematics Bridge	76.1	6.7	1.7
Private	Reading Operational	84.5	0.5	0.4
	Mathematics Operational	84.7	0.5	0.0
	Reading Bridge	80.0	0.8	0.2
	Mathematics Bridge	81.9	1.5	0.6
¹ Denominator is the total eligible sample less excluded cases. ² Denominator is the total eligible sample. SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2004 Long-Term Trend Assessment.

Last updated 30 July 2009 (EH)

Printer-friendly Version