Assessment Design Toolkit

 

About the Assessment Design Toolkit

Welcome to the Reform Support Network (RSN) Assessment Design Toolkit (Toolkit). The Toolkit includes videos and supplemental materials to help teachers write and select well-designed assessments. Though the primary audience is teachers and principals, district and State leaders can use the Toolkit to design professional development opportunities. The Center on Standards & Assessment Implementation (CSAI) also hosts a version of the Assessment Design Toolkit here. In addition to Toolkit resources, the CSAI page will highlight and support States (and interested Districts) that customize the Toolkit. Please visit the CSAI Assessment Design Toolkit page to learn more about how States and Districts adapt and use the Toolkit.

Scope of the Toolkit

The Toolkit includes 13 “modules” divided into four parts: (1) key concepts, (2) five elements of assessment design, (3) writing and selecting assessments and (4) reflecting on assessment design. The modules address how to plan, write and select well-designed assessments. The modules do not cover how to use assessments to measure student growth.

Why the RSN Developed the Toolkit

The RSN developed the Assessment Design Toolkit to respond to State requests for help to improve assessment literacy among the teacher corps. Assessment literacy is important for all teachers, especially for those teachers of non-tested grades and subjects who do not have State assessments to help them measure student growth.

/.col-sm-3–

/.well–

Return to top

/.well–

Conclusion

Now that you’ve finished the module and met the objectives, let’s move on to others.

/#mod1–

Introduction

Now that you’ve had a chance to view the introductory module and learn or get a refresher on some important terms, let’s discuss the multiple purposes of assessment.

By the end of this module, you should be able to identify the different purposes of assessment and understand how to use the assessment blueprint to document the primary purpose of an assessment.

Supplemental Materials:

Worksheet Note-Taking Template Narrator’s Script PowerPoint Deck List of Sources

/.well–

Return to top

/.well–

Conclusion

We’ve finished our discussion of assessment items. Now that we’ve reviewed or built our understanding of the purposes of assessment and the types of assessment items, we’re ready to apply that knowledge to the five elements of assessment design that we discussed in the first module.

/#mod3–

Part 2: Five Elements of Assessment Design

Introduction to Part II: Five Elements of Assessment Design

In the introductory module, we introduced the concept of five elements of assessment design alignment, rigor, precision, bias and scoring, and suggested that if the assessments you write or find elsewhere address these five elements effectively, those assessments stand a great chance of having an appropriate level of validity and reliability for use in your classroom. In this and the next four modules, you will learn how to recognize the effective use of these five elements and be well on your way to writing or selecting well-designed assessments for your students.

Introduction

The focus of this module is the first element of assessment design—alignment.

By the end of this module, you should be able to define alignment for the purpose of the modules and explain why it is important. You should also be able to explain how to “unpack” a standard to understand its content and use the assessment blueprint to document the skills embedded within it.

Supplemental Materials:

Worksheet Note-Taking Template Narrator’s Script PowerPoint Deck List of Sources

/.well–

Return to top

/.well–

Conclusion

Now that you have a good understanding of two elements of assessment design—alignment and rigor—let’s move on to the third of the five elements: precision.

/#mod5–

Introduction

You’ve now learned about alignment and rigor, the first two of five elements of assessment design, and you are well on your way toward writing or selecting well-designed assessments for your students.

The focus of this module is the third element of assessment design—precision.

By the end of this module, you should be able to describe what precision means for the purpose of these modules and make an imprecise item more precise. The video in this module is shorter than many other modules. We do, however, provide additional examples of how to design precise selected- and constructed-response items in Part III of this Toolkit.

Supplemental Materials:

Worksheet Note-Taking Template Narrator’s Script PowerPoint Deck List of Sources

/.well–

Return to top

/.well–

Conclusion

You have completed this module on bias, which all assessment designers should avoid when they write or select assessments. In the next module, we take up the fifth element of assessment design—scoring.

/#mod7–

Introduction

Grading papers and quizzes, assigning grades and scores to projects and performance tasks. Teachers do these things every single day. And so the fifth component of assessment design—scoring—will likely be the most familiar to you. This module, we hope, will help make you an even more effective scorer of your students’ work and demonstrate for you how the more effective your scoring practices are, the more likely your assessment results will be reliable.

By the end of this module, you should be able to define what scoring means for the purpose of these modules and explain how and why you should use well-designed tools, such as answer keys, scoring guides and rubrics, to score many assessments. You should also be able to explain what distinguishes one tool from another.

Mastering how to write a well-designed rubric is beyond the scope of this module. We recommend the following resources and examples of well-designed rubrics to help you continue your learning about rubrics. (Available June 2015)

Partnership for Assessment of Readiness of College and CareersPerformance Level Descriptors: Mathematics These rubric describe four levels of student performance for all math Common Core standards grades 3-12.

Kansas State Department of Education. “Assessment Literacy Project.” This resource includes a video and supplemental to help educators learn about the different types of rubrics, how to recognize a well-designed rubric and how to design and score rubrics.

New York State Education Department. “Teaching Is the Core Assessment Literacy Webinar Series – Part 5: Rubrics and Other Scoring Methods.” This resource includes a video and associated PowerPoint presentation to help educators learn to write and select rubrics that match intended learning outcomes and to check for consistency among scorers.

Smarter Balanced Assessment Consortium. “General Scoring Rubrics Mathematics.” This holistic scoring rubric describes levels of student performance on 4-, 3-, 2-, and 1-point mathematics assessments items.

Student Achievement Partners. “Scoring Rubric for Text-Based Writing Prompts.” This rubric describes four levels of student performance for text-based writing prompts. It is primarily for writing about a text, but you could use a subset for another writing task.

Partnership for Assessment of Readiness for Colleges and Careers. 2014. “Grades 6-11 Condensed Scoring Rubric for Prose Constructed Response Items Research Simulation Task and Literary Analysis Task.” These rubrics describe five levels of performance for PARCC’s research simulation, literary analysis, and narrative tasks.

Elk Grove Unified School District (EGUSD). “K-12 Rubrics.” This resource includes writing rubrics for every grade level aligned with college- and career-ready standards, including informational, opinion, narrative writing rubrics and research rubrics. (Note that rubrics are the same within K-2, 3-5, and 6-12 with the exception of the standards).

Supplemental Materials:

Worksheet Note-Taking Template Narrator’s Script PowerPoint Deck List of Sources

/.well–

Return to top

/.well–

Conclusion

When you’re ready, let’s move on to the next module. It focuses on constructed-response items.

/#mod9–

Introduction

In the last module, you learned about selected-response assessment items and, in particular, multiple-choice items. The module explored how to write selected-response items, when to use them, and what their strengths and weaknesses are for classroom assessment. You learned about how to write effective multiple-choice questions, right down to the level of how to create meaningful distractors.

The focus of this module is a different type of item—the constructed-response item. Again, you have probably written many constructed-response items. Our hope is that this module will help you take what you know and can do to the next level and that the completion of this module will be one more step you take on your journey to becoming a master assessment designer for your classroom.

Supplemental Materials:

Worksheet Note-Taking Template Narrator’s Script PowerPoint Deck List of Sources

/.well–

Return to top

/.well–

Conclusion

You now have completed modules on the three types of assessment items. We hope you will use what you’ve learned when you write or select your next assessment. Don’t hesitate to return to the modules or associated materials if you need to brush up on an item type. Now, let’s move on to the next module on portfolio assessments.

/#mod11–

Introduction

You have finished watching videos about three different types of assessment items. Next we will discuss portfolio assessments. Portfolios are not a particular type of assessment item; they are full-bodied assessments, capable of housing a collection of other assessments that come together as a powerful display of student learning. Portfolios should be part of every masterful classroom assessment designer’s toolkit.

By the end of this module, you should be able to define a portfolio assessment, distinguish between its two types, identify the benefits and challenges of using portfolio assessments, and know that there is a “what-who-how” framework that you can use to design them.

Supplemental Materials:

Worksheet Note-Taking Template Narrator’s Script PowerPoint Deck List of Sources

/.well–

Return to top

/.well–

Conclusion

Congratulations are in order! You have officially completed all 13 modules in the Assessment Design Toolkit and mastered most, if not all, of its content. Your hard work has paid off, and you should feel even better prepared than ever to write and select assessments that measure the knowledge and skills you want them to measure. Your students will benefit greatly from your hard work and assessment expertise. Good luck as you continue your career as a teacher. Among the many complex skills you will demonstrate in every unit of instruction, count among them the capacity to write and select well-designed assessments.

/#mod13–

How Can Educators Use the Toolkit?

The Toolkit is designed so that educators can repurpose its module(s). For example, the modules can be part of a robust professional development plan. State and district leaders can post the modules to online learning platforms for teachers to access independently to fit their schedules. Teams of teachers, Professional Learning Communities and school departments can use the modules to improve assessment literacy together in groups.

Read Vignettes of How to Use the Toolkit

State, district, and school-level educators will use the modules in different ways. To learn about how the Toolkit might bolster professional development at each of these levels, you can read three vignettes that describe how a State, district and school leader might use the modules. You can also read a list of ideas for how to use the Toolkit developed by State, district and school leaders who attended a convening about assessment design in May 2015.

Vignette of a State Leader Vignette of a District leader Vignette of a School Leader List of Ideas for How to Use the Toolkit

How Can Educators Repurpose the Toolkit?

Repost Hyperlinks and Videos

We encourage educators to repost the link to the Toolkit and any links within the Toolkit to public forums, websites, or online communities. For example, a district leader leading an in-person professional development session on assessments might include a link the Toolkit in his or her training resources so that educators can follow up with independent study.

Educators can also embed any one individual video or a subset of videos on a different Web page. To embed a video on a blog or webpage:

  1. Hover over the video you wish to embed
  2. Right click (for PCs) or CTRL + click (for Macs)
  3. Select “Get embed code”
  4. Copy the code
  5. Paste the code into the new Web page

Download the Supplemental Materials for Later or Offline Use

Select the links below for zipped files that contain editable Microsoft Word & PowerPoint documents or zipped files that contain PDF 508 Compliant documents.

Part I: Key Concepts

/.col-md-3–

Part III: Writing & Selecting Assessments

/.col-md-3–

<!–>/.row–


An earlier version of this document was developed under the auspices of the Reform Support Network, with funding from the U.S. Department of Education under contract #GS-23F-8182H. This publication features information from public and private organizations and links to additional information created by those organizations. Inclusion of this information does not constitute an endorsement by the U.S. Department of Education of any products or services offered or views expressed, nor does the Department of Education control its accuracy, relevance, timeliness or completeness.