New Hampshire Assessment Letter

June 27, 2006

The Honorable Lyonel Tracy
Commissioner of Education
New Hampshire Department of Education
101 Pleasant Street
Concord, New Hampshire 03301

Dear Commissioner Tracy:

Thank you for your participation in the U.S. Department of Education’s (Department) standards and assessment peer review process under Title I of the Elementary and Secondary Education Act of 1965 (ESEA), as amended by the No Child Left Behind Act of 2001 (NCLB). I appreciate the efforts required to prepare for the peer review. As you know, with the implementation of NCLB’s accountability provisions, each school, district, and State is held accountable for making adequate yearly progress (AYP) towards having all students proficient by 2013-14. An assessment system that produces valid and reliable results is fundamental to a State’s accountability system.

I am writing to follow up on the peer review of New Hampshire’s standards and assessment system, which occurred May 8-10, 2006. The results of this peer review process indicate that additional evidence was necessary for New Hampshire to meet the statutory and regulatory requirements of Section 1111(b)(1) and (3) of the ESEA.

As you will recall, the Department laid out new approval categories in a letter to the Chief State School Officers on April 24, 2006. These categories better reflect where States collectively are in the process of meeting the statutory standards and assessment requirements and where each State individually stands. Based on these new categories, the current status of the New Hampshire standards and assessment system is Approval Pending. This status indicates that New Hampshire’s standards and assessment system administered in the 2005-06 school year has one fundamental components that is missing or that do not meet the statutory and regulatory requirements, in addition to other outstanding issues that can be addressed more immediately. These deficiencies must be resolved in a timely manner so that the standards and assessment system administered next year meets all requirements. The Department believes that New Hampshire can address the outstanding issues by the next administration of its assessment system, that is, by the end of the 2006-07 school year.

New Hampshire’s system has one fundamental component that warrants the designation of Approval Pending. Specifically, the Department cannot approve New Hampshire’s standards and assessment system due to outstanding concerns with the New Hampshire Alternate Assessment’s link to grade-level content standards. Please refer to the enclosure for a detailed list of the evidence New Hampshire must submit to meet the requirements for an approved standards and assessment system.

Accordingly, New Hampshire is placed under Mandatory Oversight, pursuant to 34 C.F.R. §80.12. Under this status, there will be specific conditions placed on New Hampshire’s fiscal year 2006 Title I, Part A grant award. New Hampshire must provide, not later than 25 business days from receipt of this letter, a plan and detailed timeline for how it will meet the remaining requirements to come into full compliance by the end of the 2006-07 school year. Beginning in September 2006, New Hampshire must also provide bi-monthly reports on its progress implementing the plan. If, at any time, New Hampshire does not meet the timeline set forth in its plan, the Department will initiate proceedings, pursuant to Section 1111(g)(2) of the ESEA, to withhold 10 percent of New Hampshire’s fiscal year 2006 Title I, Part A administrative funds, which will then revert to local educational agencies in New Hampshire.

I know you are anxious to receive full approval of your standards and assessment system and we are committed to helping you get there. Toward that end, let me reiterate my earlier offer of technical assistance. We remain available to assist you however necessary to ensure you administer a fully approved standards and assessment system. We will schedule an additional peer review when you have evidence available to further evaluate your system. If you have any questions or would like to request reconsideration of the conditions, please do not hesitate to contact Abigail Potts (Abigail.Potts@ed.gov) or Valeria Ford (Valeria.Ford@ed.gov) of my staff.

Sincerely,

Henry L. Johnson

Enclosure

cc: Governor John Lynch
Deborah Wiswell
Tim Kurtz

Summary of Additional Evidence that New Hampshire Must Submit to Meet ESEA Requirements for the New Hampshire Assessment System

1.0 – ACADEMIC CONTENT STANDARDS

1. Formal approval of academic content standards in science.

2.0 – ACADEMIC ACHIEVEMENT STANDARDS

1. Science academic achievement descriptors.

2. Descriptions of grade-specific competencies associated with each achievement level and provide documentation of formal adoption for all assessments (i.e., NECAP and alternate assessments based on alternate achievement standards).

3. Verification that sufficiently diverse stakeholders are involved in the development of academic achievement standards for all assessments.

4.0 – TECHNICAL QUALITY

1. A completed technical manual for the NECAP that includes:
   1. An investigation of the relationship of the domains and sub-categories.
   2. Studies of the relationship of the NECAP with external measures.
   3. Interpretation of the reliability information for the total test, sub scores, and classification consistency at the cut scores.
   4. Test development process, bias and sensitivity review, test form construction as well as the expertise of the panelists involved in these processes (e.g., race/ethnicity, special populations, region, and student SES populations).
   5. Detailed plan for equating tests from year to year, including the number of horizontal linking items used between years and the methodology for equating the items and tests.
   6. A quality control process for monitoring test administrations including: administration irregularities and accommodation usage.
2. Appropriateness of the accommodations allowed and what impact those accommodations have on the test scores.

5.0 – ALIGNMENT

1. The State must provide a clear description of how the test development process for NECAP supports the alignment of the test and academic standards including:
   1. Item specifications in final form.
   2. Finalized test specifications and designs.
   3. Examples of cognitive level coding of items.
   4. Test design tables used for constructing each test.
   5. Test maps.
   6. The process for assessing the degree of match between the test maps and the test design.
   7. Test development process establishes and maintains alignment to the GLEs.

2. The state must conduct an independent alignment study or provide results from another appropriate procedure for assessments to confirm that the final test forms are aligned with the State’s standards.

3. Document that alternate achievement standards are linked to reading and mathematics GLEs.

6.0 – INCLUSION

1. Verification that all students enrolled during the testing window are tested, accounting for "NT Approved", "NT Other", and not tested for "other reasons."

2. 2. Policies adopted by the state regarding the participation of every limited English proficient (LEP) student in the assessment system, including policies regarding LEP students "new to the country", and participation of migrant and other mobile students.

7.0 – REPORTING

1. Sample student report for the 2005-06 alternate assessments.

Return to state-by-state listing