Close this search box.

What We Measure Matters

Understanding the 鈥渨hat鈥 and 鈥渨hy鈥 of student data

Stories from the Field
April 14, 2022

By: Jillian Kuhlmann

Silver Anderson is pursuing a degree in architecture and environmental engineering because she believes 鈥渢here is a delicate balance between human needs and environmental concerns, and it is our responsibility to manage the complexity of our lives within the potentiality of our environment.鈥

She explained this in her senior capstone, a project that serves not only as a place to assert her goal but also to highlight her skills, illustrating the ways she has met by reflecting on how her experiences both in and outside of school demonstrate accountability, communication, adaptability, a learner鈥檚 mindset and leadership.

鈥淲e鈥檙e really looking at the body of experiences a kid has, and how we can pull those together,鈥 said Tom Klapp, director of personalized learning with Northern Cass. 鈥淐ontent is important, but we really want to get kids thinking about the skills we want them to have first: What can I do to work on that skill, to grow in that skill and eventually be able to show it? Our kids are growing up in a world where information is readily available and our job as educators is to teach them about what we do with that information, how we apply it.鈥

The Portrait of a Learner, sometimes called a Portrait of a Graduate, is a tool increasingly used by K-12 school districts to identify those skills, knowledges and dispositions their graduates will need to succeed in an uncertain future. From there, districts can identify meaningful measures of success, because what we measure matters 鈥 but so does the how and why behind those measures.

In Finding Your Path: A Navigation Tool for Scaling Personalized, Competency-Based Learning, we identify 12 conditions necessary for learning communities to navigate systemic change. A big part of quantifying this work is through observing and capturing the spread of student-centered practices within a given school district or building. Connected to the 12 conditions are eight student impact areas:

  • Student Agency
  • Supportive Relationships
  • Positive and Equitable Learning Environments
  • Shift to Competency-Based System
  • Deeper Learning
  • Equity of Learning
  • Career Readiness Skills
  • Post-Secondary Outcomes

鈥淲e鈥檙e helping schools and districts prepare each student for their future. That calls for a mix of robust measures of learning that are student-centered and equitable to indicate progress in classrooms and systems,鈥 explains Rebecca Wolfe, vice president of impact and improvement at 澳门天天好彩. 鈥淲e can鈥檛 ask schools and students to transform learning but then measure progress with outdated, limited and biased methods.鈥

Future-focused measures like the skills, knowledges and dispositions outlined in a Portrait of a Learner 鈥 and how those are being realized in Megan Margerum鈥檚 third grade classroom.

鈥淢y passion is making sure that we are incorporating the Portrait of a Learner concepts at a young age,鈥 said Margerum, a third-grade teacher with Northern Cass. 鈥淗ow can we incorporate these words into their day-to-day work 鈥 accountability, communication, adaptability, a learner鈥檚 mindset and leadership 鈥 and help them learn how they can show evidence? Kids as young as preschool can do that. It鈥檚 just so important because these are the things that they鈥檙e going to have to do, and be, and be able to show. It encompasses everything we need to be as a citizen in this community.鈥

In addition to projects that incorporate the Portrait of a Learner, Margerum鈥檚 students discuss how people and characters demonstrate the Portrait of a Learner words and engage in historical studies of individuals who have shown themselves to have these qualities. Margerum works to point out to her students when they are conferencing with her, for example, how they are utilizing their communications or accountability skills, among others. She also models what it looks like when she hasn鈥檛 used certain skills well.

Margerum's "Portrait of a Learner" includes accountability, communication, adaptability, a learner鈥檚 mindset and leadership.

Print out with text, "Accountability: able to show responsibility for all choices and following thorugh with commitments" with a large A over a snowflake below it. Below the A is a note with text, "12-2-21 Kasyn held himself accountable by finishing his 30 book challenge."

鈥淲hat I want to instill in my kids is that if you ever feel you鈥檙e at a point where you鈥檙e done learning, you aren鈥檛 there. We鈥檙e always learning,鈥 Margerum said. 鈥淢y kids know that this is a safe space where they can make mistakes, where they can see me make mistakes.鈥

While Margerum is working to ensure her students have a clear understanding of what each of the words identified in the Portrait of a Learner mean and how they can show they鈥檙e practicing the skills those words describe, the district continues to grow in the ways they are centralizing these skills.

鈥淧eople, by and large, agree that the world is a different place; it鈥檚 changing exponentially,鈥 said Klapp. 鈥淲e don鈥檛 know what graduates are going to be asked to do four years from now or eight years from now. But what we do know is that there鈥檚 a set of skills that it takes to succeed. Those skills have been true for the last 100, 200 years: to be a self-autonomous learner, to be able to communicate, collaborate, to be self-driven. When school hasn鈥檛 changed at all to adapt to a changing world, it鈥檚 time for us to make that change.鈥

When school hasn鈥檛 changed at all to adapt to a changing world, it鈥檚 time for us to make that change.

Tom Klapp, Director of Personalized Learning
Northern Cass School District, North Dakota

Why student agency and ownership of learning matters

Northern Cass students and educators are among those contributing to data in 澳门天天好彩 research into student impact areas 鈥 and we鈥檙e taking a similarly long view. While survey data, interviews, focus groups and observations provide insights on each of the student impact areas, they are organized by time horizons, as well, to demonstrate when learning communities can anticipate having measurable progress 鈥 and how that progress aligns to something like a state or district鈥檚 Portrait of a Graduate. Student agency, for example, is one of the first areas where a learning community may see measurable improvement. Students feeling a sense of ownership over their learning 鈥 that what they do matters and is relevant to the futures they hope to pursue 鈥 is critical for the culture shift that must take place to support a personalized, competency-based learning environment.

鈥淲e鈥檙e asking questions that get at the structures that need to be embedded within a system to build student agency,鈥 said Drake Bryan, director of continuous improvement at 澳门天天好彩, stressing that showing growth is the goal. 鈥淔or example, we ask students how often they work with their teachers to determine when they鈥檙e ready to take a test. In 2020, a third of the students who responded to our survey in North Dakota said that they could do this. In 2021, we saw a 7-percentage point increase. That鈥檚 a big leap.鈥

Deciding when they鈥檙e ready to take a test is an example of student agency, and this kind of agency can only be achieved if school structures allow for it. Until structures like learning pathways 鈥 which provide learners the flexibility to move at pace, co-design learning experiences and assess when ready 鈥 are built, there鈥檚 only so much student ownership and personalization of learning.

We already have two years of quantitative data and three years of qualitative data in North Dakota and are actively collecting data in Arizona and South Carolina, as well. We will be sharing our findings with the states to help learning communities better identify where they want to focus their efforts and how we can support them in achieving their outcomes.

Virgel Hammonds, chief learning officer with 澳门天天好彩, is candid about the different ways we鈥檙e helping districts build their capacity and use data to engage in continuous improvement.

鈥淎s a result of the work that鈥檚 happening in North Dakota, we are accelerating and creating greater impact. For example, we鈥檝e worked with states on the identification of a statewide Profile of a Graduate to create a visual representation of shared goals,鈥 said Hammonds. 鈥淚t鈥檚 not strictly on high school educators to make learning growth and success a reality. It鈥檚 for all of us, preschool through high school. We start to think about what structures or processes we need in place, how our roles might change, how do we support it with data if we鈥檝e all been a part of identifying what we want for graduates. It inspires greater partnerships.鈥

Changing the conversation about transcripts and college admission

While we continue to work with learning communities and states on supplemental measures for showing growth, organizations like are partnering with districts and higher education institutions to ensure things like the Portrait of a Graduate are paired with a transcript that goes beyond standard measurements to truly illustrate what a student knows and knows how to do. According to the MTC website, a 鈥渄igital high school transcript that opens up opportunity for each and every student 鈥 from all backgrounds, locations, and types of schools 鈥 to have their unique strengths, abilities, interests, and histories fostered, understood and celebrated.鈥

Every college or university that receives a mastery transcript is sent information about how to access and interpret it and invited to a one-on-one conversation with MTC. The goal, however, according to MTC鈥檚 Chief Education Officer Patricia Russell, is to pivot the conversation away from college admissions staff just dealing with transcripts one at a time.

鈥淢any college admission folks have expressed strong support for the Mastery Transcript even as they ask how they will pivot from an admission system built around some age-old and fracturing assumptions around course titles, grades and standardized test scores,鈥 said Russell. 鈥淎s use of the Mastery Transcript expands, colleges may need to redefine their admission criteria to focus on a list of clearly defined competencies needed to be successful in the college program. An admission reader can then readily determine if an applicant is qualified based on the competencies (with supporting evidence) on the Mastery Transcript.鈥

For Hammonds, tools like the Mastery Transcript are essential to changing the conversation about success and how we evaluate and report, especially as more states review and adapt their accountability measures.

鈥淲hen a state has something like a statewide Profile of a Graduate, we have schools asking, 鈥楬ow do we make this a reality?鈥 It means we may have to change a lot of our infrastructure, our reporting process, our transcript process,鈥 said Hammonds. 鈥淭his is an opportunity to think about how we connect and partner and answer these questions for our learning communities. They鈥檙e transforming not just for K-12, but for a lifetime.鈥

COVID-19 provided states the opportunity to accelerate their progress in rethinking state assessment systems to ensure they support the individual learning of all students. Learn more about how 14 states are continuing to make progress in rethinking system accountability and K-12 assessment systems.
Read now >>

A small but growing number of schools and districts that MTC partners with utilize the Mastery Transcript, though many others use the organization鈥檚 resources to track growth toward competencies, capstone projects, student-led conferences and exhibitions of progress, among others. For these tools and for the transcript, students curate and submit evidence, and teachers review.

鈥淵ou want to be able to highlight those experiences and skills mastered that go deeper than others 鈥 maybe give the student an opportunity to do something they wouldn鈥檛 have been able to do in a traditional environment,鈥 said Susan Bell, senior director of member school engagement with MTC. 鈥淵ou want to give them the opportunity to create that story that shows who they truly are.鈥

Hammonds likens the process to crafting a resume, a cover letter or building a portfolio as a job seeker.

鈥淵ou want to be able to give your best evidence. Kids can do that, too,鈥 said Hammonds. 鈥淭raditional transcripts don鈥檛 provide any of that evidence.鈥

Scaling personalized, competency-based learning requires alignment between states and learning communities.

For Bryan, helping states and districts align what they collect and why is critical. It鈥檚 what moves us from having small pockets of success to transformation on a larger scale. It鈥檚 great if one community is doing better, but if the neighboring district isn鈥檛 seeing those same successes, we鈥檙e creating larger inequities rather than opportunities.

鈥淲e can collect as much data as we want at the district level, but until states have prioritized the collection of more meaningful, personalized learning data that aligns to their goals, it鈥檚 hard to capitalize on and spread isolated success,鈥 said Bryan. 鈥淚t鈥檚 important that states have a better understanding of what they want and how to measure that, how to know if they鈥檝e achieved it or haven鈥檛, if they鈥檙e making progress.鈥

And that statewide progress begins in schools, in classrooms, with learners.

Margerum wants to help make the growth she鈥檚 seeing and experiencing a reality for her peers in a way that helps shape how each student is connecting to the district鈥檚 Profile of a Learner.

鈥淚 try as a teacher leader to excite others about this work, to look together at all the big things that we do throughout the year that our learners are going to remember, whatever it is, and think about how it鈥檚 relevant, and how it鈥檚 connecting to the Portrait of a Learner,鈥 said Margerum. 鈥淭hose are our foundations for our graduates. Let鈥檚 make them a foundation in their elementary years, too.鈥

Designing competencies that align with a state Portrait of a Graduate is a big undertaking with even bigger impact. Learn how Utah educators approached this work.


Jillian Kuhlmann
Senior Manager of Communications

Related Resources

Transformation doesn鈥檛 happen overnight. Learn how North Dakota supports and sustains personalized, competency-based learning practices through networks.

Jillian Kuhlmann
Senior Manager of Communications

A Portrait of a Graduate defined and some examples from learning communities

Jillian Kuhlmann
Senior Manager of Communications

Advancing the shift towards authentic learning with collaboration and what it takes to lead these efforts effectively

Simone Daley
Senior Manager of Network Engagement