NAEP Technical DocumentationDevelopment of the Science Cognitive Items and Instruments

Student Booklets: 2015 Student Booklets: 2011 Student Booklets: 2009 Student Booklets: 2005 Student Booklets: 2000  Number of items: 2015 Number of items: 2011 Number of items: 2009 Number of items: 2005 Number of items: 2000  Common blocks: 2015 Common blocks: 2011 Common blocks: 2005 Common blocks: 2000

The instruments used in the NAEP science assessment are usually composed of blocks of cognitive items from the previous NAEP assessments, as well as blocks that are newly developed for the current year's assessment. Administering the same blocks of items across years allows for the reporting of trends in science performance.

Developing new sets of items makes it possible to release some items to the public. In an assessment year, one or more blocks at each grade are released to the public and can be accessed via the NAEP Questions Tool.     

The NAEP science framework and specifications documents guide the item development efforts. In 2009, a new science framework was introduced, and most of the items used were newly developed; there were no common blocks between the 2009 assessment and those used in previous years. This same framework guided the development of the 2011, 2013, and 2015 assessments.

Items are written by NAEP test development staff, with input from members of the NAEP Science Standing Committee as well as from elementary, secondary, and postsecondary teachers around the United States. All assessment materials are reviewed by specialists in science education, measurement, assessment development, accessibility, accommodations, and bias. Scenario-based tasks (SBTs), which include Interactive Computer Tasks (ICTs) and Hands-on Hybrid Tasks (HHOTs), undergo reviews for functionality via tryouts and cognitive labs in addition to these content reviews. Plus, HHOTS undergo kit reviews to determine accuracy of equipment and investigation procedures. The cognitive items are then assembled into 25-minute blocks.

Each science cognitive block contains a range of questions covering three science content areas:

• Physical Science;
  
• Life Science; and
• Earth and Space Sciences.
  

Following approval from the National Center for Education Statistics (NCES), the cognitive blocks are assembled into booklets and distributed to schools for the administration of the assessment.

Click here for more information about what the NAEP science assessment measures.

Printer-friendly Version