The Challenge: Districts Are Swimming in Student Assessment Data 

A principal sits down with her leadership team to review the school’s latest interim assessment results. The data are now 3 weeks old, and half the teachers haven’t looked at them yet. Those who have aren’t sure what the data mean or if they should make any instructional changes. Meanwhile, the district is rolling out a new screener next month. 

This scenario reflects common practices and challenges in schools. Data are everywhere, but practices and processes for meaningfully using data remain uneven. Too often, data are used in ways that feel like something done to educators and students rather than something valuable they do together. Compliance requirements, accountability pressures, and misaligned data systems can unintentionally reduce data use to a checklist exercise rather than a tool for learning and improvement. 

Educators are swimming in a sea of assessment results from screener, diagnostic, interim, summative, and classroom assessments. The problem is that accumulating a larger amount of data hasn’t necessarily resulted in more clarity. Without a clear sense of which data should inform which decisions, assessments pile up and opportunities to improve teaching and learning are lost. This also means that investments of time, resources, and finances may yield little return. The good news is that these challenges can be addressed by improving assessment systems. 

Start by Remembering the Purpose of Assessment 

Assessment is an information-gathering process; each assessment should serve an intentionally designed purpose and inform specific decisions. At the Center for Standards, Assessment, and Accountability (CSAA), we assert that a coherent and effective assessment system must use the right assessment tools and practices to provide meaningful information and that assessment use should be guided by a shared vision for teaching and learning. The good news? By improving assessment systems, education leaders can improve local capacity for analyzing and interpreting assessment data to inform and improve student outcomes. 

All too often, well-meaning leaders seek out new assessment tools as a solution to the disconnect between assessment data and instruction. But system coherence and effectiveness usually aren’t achieved by adding more assessments; in fact, many assessment systems become more coherent and effective through careful and considerate streamlining, which may involve removing some assessments altogether. When districts add assessments year after year without clarifying why they matter, who they are meant to serve, or how they connect to instruction, they fall into the assessment by magic trap—the assumption that more data alone will produce better outcomes. Without a clear rationale, districts default to layering one assessment on top of another, crossing their fingers and hoping something sticks. This may also leave districts vulnerable to being sold on the next shiny data dashboard or assessment product that comes along making big promises but falling short of expectations. By contrast, clarifying why educators assess and how assessment connects to instructional goals gives the information needed to strengthen education systems. 

Get Better at Analyzing and Interpreting Assessment Data 

Assessment tools receive a lot of attention within assessment systems, but data literacy—the knowledge and skills needed for using the assessment data they produce—also deserves leaders’ attention. Data literacy is the ability to effectively collect, analyze, and interpret data to inform decision-making. For evidence to be meaningful, assessment systems must attend to several factors that should be in alignment: 

• purpose (why data are collected) 
• decision level (classroom, school, district, or state) 
• capacity (what types of training and support are needed) 
• time frame (immediate instructional decisions versus long-term monitoring) 
• roles (who needs the information and how it will be used) 

Without coherence across these dimensions and without the effective implementation necessary for success, even high-quality assessments tend to fall short. Data may be accurate but misapplied, plentiful but unhelpful. Data become instruments for learning when all partners have the knowledge and tools to analyze and use data to develop action steps.  

Three Key Insights for School and District Leaders About Assessment Systems 

The CSAA’s experts recommend that school and district leaders consider the following key insights when reflecting on their assessment systems. 

Different Decisions Require Different Data

Day-to-day instructional decisions require timely, classroom-level data. By contrast, school- and district-level decisions rely on aggregated patterns over time. Confusion arises when data designed for one purpose get applied to another. Leaders need to ensure that everyone has access to the right data for each purpose.  

Coherence Comes From Alignment, Not Accumulation

Coherence is not achieved by adding tools. Instead, it is achieved by aligning assessments with purpose, use, and decision-making across the system. 

Collaborative Sense-Making Strengthens Use

All users across the system need professional learning to increase their knowledge and build assessment literacy. When educators and their partners (leaders, students, families) have well-supported opportunities to interpret evidence together, data are more likely to inform and improve teaching and learning. 

Ready to take action to make your assessment system more coherent and effective? First, reflect on the current practices within the system. Next, evaluate your assessment system to determine what needs to be improved. Finally, check out resources available from the CSAA and contact us for support. 

Action Step 1: Reflect on Current Assessment and Data-Use Practices 

Use the following questions to surface alignment (or misalignment) between assessments, decisions, and use. 

Leaders should ask: 

• What decisions are we trying to make at the classroom, school, and district levels? 
• Which assessments are intentionally designed to inform these decisions at each level, and which assessments are not relevant to those decision-making processes? 
• Where do we observe multiple assessments serving the same purpose, and are there instances when this redundancy fails to provide additional value for teaching and learning?
• How clear and consistent is our communication to educators about the purpose of each assessment, the reason it is administered, and the intended use of its evidence?
• Where and when do educators have structured opportunities to collaboratively review, interpret, and act on assessment evidence to improve student outcomes? 

Teachers should ask: 

• What decisions am I trying to make in my classroom? What decisions are leaders making at the school and district levels that impact my teaching and my students?
• Which assessments in my classroom are designed to inform my instructional decisions, and which ones are not?
• Where do I notice multiple assessments being used for the same purpose but without providing any additional benefit to my teaching or my students’ learning? 
• How clear am I—and how clear are my colleagues—about the reasons for administering specific assessments and about the way we are expected to use the resulting data? 
• When and where do I, along with other educators, have structured opportunities to work together in analyzing assessment data to improve instruction and support students? 

Action Step 2: Evaluate Your Local Assessment System 

Reflection can inform a comprehensive evaluation that reviews assessment practices in a comprehensive way. What are the assessments given at the district, school, and classroom levels? How do all these assessments work together (or not)? Assessment system evaluations provide opportunities to think deeply about testing practices and collect detailed data for analyzing whether your system is working coherently.  

Conduct an assessment inventory evaluation by identifying the following for each assessment: 

• what decision it is intended to inform 
• who uses the information 
• when the information is needed 
• how it is expected to influence action 

If an assessment cannot be clearly linked to a decision, or if multiple assessments claim to inform the same decision, pause before adding new tools. Use this process to reevaluate system components, reduce redundancy, and identify places where assessment and data capacities can be strengthened. 

Action Step 3: Gather Support and Tools to Strengthen Your Assessment System 

The CSAA offers research-based assistance and resources to support districts and states in designing coherent, effective assessment systems. Our guidance and tools can help education leaders 

• clarify the key purposes of various types of assessments that are created at the classroom, school/district, and state levels; 
• understand the key characteristics of a coherent and effective local assessment system; and 
• make important shifts toward strengthening assessment data–use practices. 

Coherent and effective assessment systems are not built by collecting more data but by intentionally aligning evidence with purpose, decisions, and use. When assessment literacy is understood as a shared responsibility, data shift from being a source of fatigue to being a catalyst for learning and improvement. 

In the next post, we will turn our focus to classroom-level decisions and explore how the formative assessment process and classroom assessments work together to inform instruction and support student learning.