Introducing the SES

Introducing the Student Experience Survey

 

Over the last twenty years teachers have been tasked with collecting, analyzing and using endless amounts of testing data in their classrooms. While this data can help us identify where students are struggling and understand patterns of progress, it has not translated into more equitable outcomes for students (Barshay, 2022).

 

How can we expand our thinking about student data to go beyond creating academic interventions? Can a holistic approach to measurement provide more meaningful insights and greater impact?

Centering students and families is a critical part of Throughline Learning's liberatory data approach. We are committed to reappropriating the power of data to focus on the student learning experience as a key measure of instructional success and efficacy.

During the 2020-2021 school year, our Research & Impact team developed the Student Experience Survey (SES) to quantify and analyze the learning experiences reported by different student groups (across grades 3-12). We know there is a strong evidence base connecting academic success and concepts such as belonging, academic mindset, cognitive skills, and engagement. Our team wanted to understand how student perspectives in these areas might differ based on socioeconomic status, race, ethnicity, grade level, gender identity, or status as multilingual learners or special education students.

Initial survey administration at Throughline Learning partner schools yielded fascinating results:

  • At a rural middle school, students receiving free lunch had significantly lower confidence in themselves as learners and a lower sense of belonging than their peers.
  • At an urban ring elementary school, special education students and students performing below grade level had lower self-perceptions and less positive learning experiences than their peers.
  • At an urban middle school, the academic mindset of multilingual learners and special education students was significantly lower than their peers.

Understanding student perceptions has provided new awareness about potential root causes of student underperformance and misbehavior. It has also framed important faculty conversations about compliance versus engagement; trust and belonging; and high expectations. One school leader shared this anecdote:

"When I was doing my daily rounds of classroom visits one morning, I witnessed an exchange between a student and a teacher. The student already understood the concept being taught, and asked the teacher for more challenging work. The teacher's response was that all students had to stay together on the same lesson. Frustrated, the student responded by disrespecting the teacher. Previously, that exchange would have prompted me to remove the student from class, call his parents, assign detention, and lecture him on his behavior. My new understanding enabled me to focus on the 'why'. Out in the hallway, I learned that feelings of boredom were a frequent occurrence for this student in the classroom."

Across our partner schools, survey results have mobilized teachers to understand the stories behind student perceptions, design intentional responses, and triangulate results with academic data. This process has improved the learning experience for students while supporting higher academic achievement. Consider the following use case:

At one partner school, students with IEPs had much lower rates of progress and achievement on interim MAP assessments than their peers. Student experience survey results also showed that students with IEPs felt significantly less comfortable than their peers sharing their thoughts and opinions. The Design Team (inclusive school improvement team) shared the survey data with the student council. Additional student reflections supported a targeted search for research-based strategies to elevate student voice. The Design Team piloted "dialogue journals" as a key strategy to help all students feel more heard and valued, which increased student confidence, improved relationships with teachers, and increased engagement. On spring MAP assessments, students with IEPs making exceptional growth rose 18 percentage points in ELA and 13 percentage points in Math.

Excited by the outcomes of our first year of survey administration, we convened partners to support us in validating the tool. Through the generous support of a 2022 award from Assessment for Good, and the help of a talented Research Advisory Committee, we designed initial process steps. Based on the results of stakeholder focus groups and statistical analyses, we addressed survey usability and accessibility. Revisions have made the second version shorter, clearer, and more user-friendly. An overview of survey domains and rationale can be found in our SES research base resource linked here.

The next steps for our Research & Impact team include:

  1. Piloting the updated survey with over 1,000 students during the fall of 2022. Subsequent statistical analyses will continue to support the process of survey validation and test new reporting structures to make results easier to understand and act upon.
  2. Improving our companion tool to the Student Experience Survey. Used as an entry point to 1:1 coaching engagements, the Social Emotional Learning Self-Assessment (SELSA) asks teachers to respond to the Student Experience Survey as a student in their class, and then compares these scores to class averages and disaggregated student response patterns. This exercise celebrates areas of strength and creates a collaborative, supportive approach for responding to red flags.
  3. Building a Family Engagement Survey to understand the perspectives of parents and caregivers around awareness, belonging, and engagement at their child's school. This data will help schools understand the strength of current family engagement activities, and support the study of correlations between family engagement, student engagement, and student success.

We believe that human-centered tools can redefine the power of surveys to measure the student experience, instructional efficacy, and inclusivity. When connecting experience data with data on academic performance, teachers can develop a more holistic understanding of their students as learners, and better understand and address root causes of existing inequities.

We are always looking for new partners! If your school is interested in designing improvement efforts that are anchored by student perspectives and learning experiences, please get in touch to administer the SES in your school or district.