Beth Schueler, Author at Education Next http://live-ed-next.pantheonsite.io/author/bschueler/ A Journal of Opinion and Research About Education Policy Tue, 02 Jul 2024 13:06:21 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.5 https://i0.wp.com/www.educationnext.org/wp-content/uploads/2019/12/e-logo.png?fit=32%2C32&ssl=1 Beth Schueler, Author at Education Next http://live-ed-next.pantheonsite.io/author/bschueler/ 32 32 181792879 Resolved: Debate Programs Boost Literacy and College Enrollment https://www.educationnext.org/resolved-debate-programs-boost-literacy-and-college-enrollment/ Tue, 11 Jun 2024 09:00:48 +0000 https://www.educationnext.org/?p=49718197 How debaters become better students

The post Resolved: Debate Programs Boost Literacy and College Enrollment appeared first on Education Next.

]]>
Shahed Ananzeh and Gustavo Dos Santos, students at the Boston International Newcomers Academy, work together to prepare for an upcoming speech during a Boston Debate League tournament at Suffolk University Law School in February.
Shahed Ananzeh and Gustavo Dos Santos, students at the Boston International Newcomers Academy, work together to prepare for an upcoming speech during a Boston Debate League tournament at Suffolk University Law School in February. Ananzeh and Dos Santos are among the novice level of policy debaters.

In a stereotypical image of a high-school debate tournament, straight-A students compete to see which renowned prep school team comes out on top. Increasingly, this is no longer the case: in recent decades, nonprofit organizations have been working to expand access to debate in public school systems that serve large concentrations of low-income students and students of color. More than 10,000 students from 20 cities participated in debate tournaments last year, according to the National Association for Urban Debate Leagues.

That includes the Boston Debate League, which was founded in 2005 to “develop critical thinkers ready for college, career, and engagement with the world around them.” The league supports teachers to launch and coach debate teams and runs monthly after-school debates for middle- and high-school students, among other initiatives (see “Making the Case for Student Debate Leagues,” features). While the immediate virtues of debate are easy to spot—teenagers research real-world topics, practice public speaking, and use evidence in support of their arguments—we wanted to know whether that translates into better academic achievement and attainment. Does participation in formal debate programs improve student outcomes?

First, we look at individual debaters’ reading and math test scores over time and compare students to themselves in years when they do and do not participate in debate. When students are on a debate team, their reading scores improve by 13 percent of a standard deviation, or about two-thirds of a typical year of learning. We find the biggest gains are for students with the lowest elementary-school test scores and reflect improvements in literacy skills related to critical thinking and reading comprehension. The impacts on math scores are minimal.

We also examine how debate affects high-school graduation and postsecondary enrollment by comparing debaters to similar peers who attended schools that did not offer debate. We find positive impacts on graduation and postsecondary enrollment, mainly driven by increased enrollment in four-year colleges. Debaters are 17 percent more likely to graduate high school within five years and 29 percent more likely to enroll in a postsecondary institution.

While many reading interventions target younger students, our results reveal a high-impact strategy to boost literacy skills and post-secondary outcomes for teenagers—particularly those whose low test scores and socioeconomic status typically pose high barriers to college success. Our results provide policymakers with a rare promising strategy for reducing inequality in reading achievement, analytical thinking skills, and educational attainment during students’ high-school years.

Potential Benefits of Policy Debate

Policy debate is an interscholastic, competitive, extracurricular activity for which teams of students engage in structured argumentation about public policy issues. Participants focus on a single topic for an entire academic year, such as arms sales, criminal-justice reform, or immigration policy, and work in two-person teams to research and develop policy proposals and arguments that support them. In tournaments, teams take on affirmative or negative positions, present their proposals, and cross-examine one another in a fast-moving sequence lasting 75 to 90 minutes. Policy debate students rely on their knowledge, effective use of evidence, ability to speak persuasively, and how well they can think on their feet.

Why might we expect all of this to pay off academically? First, successful debaters construct and deliver compelling arguments that are well-supported by both reasoning and evidence. In addition, the research aspect of policy debate includes reading and interpreting advanced non-fiction texts and social science research, while competitive debating includes quickly reading, analyzing, and refuting unfamiliar texts that opponents submit as evidence. Debaters are trained to consider both the content and relative credibility and objectivity of source materials. These skills are assessed on state reading tests and support advanced coursework in high school, including writing papers and participating in class discussions.

Debate also may provide a mechanism for motivating academic engagement. Rather than passively listening to an adult deliver a lecture, debaters are at the front of the room, creatively engaging with content they have mastered. The topics are directly related to high-interest current events and invite students to pair academic work with questioning authority, by recommending what the government should and should not do. And because timed tournament play moves quickly, is designed to engage the audience, and involves competition with other schools, debate teams and leagues can energize a school population as a whole, much like interscholastic sports. These events call on an array of softer skills, such as time management, independent organization, and teamwork. Competition also exposes students to a college-going culture, as tournaments are often held on college campuses and judged by current or former college-level debaters.

Trophies are ready for distribution at the awards ceremony for the Boston Debate League’s qualifying championship tournament. Apart from the hardware, student debaters are found to gain substantial benefits in reading achievement, graduation, and college enrollment.
Trophies are ready for distribution at the awards ceremony for the Boston Debate League’s qualifying championship tournament. Apart from the hardware, student debaters are found to gain substantial benefits in reading achievement, graduation, and college enrollment.

Assessing Impacts in Boston

Our study focuses on the Boston Debate League, which supports 40 school-based teams in public middle and high schools in Boston, Chelsea, and Somerville, MA. We look at 10 years of individual students’ league participation data, from 2007–08 to 2016–17, and match that with demographic and academic-achievement data from the Boston Public Schools. We also use data from the National Student Clearinghouse, which shows students’ high school graduation status, postsecondary enrollment status, and whether they enrolled in a two-year, four-year, public, or private institution.

Our sample includes 3,515 students who ever participated in a debate team. These students attend schools that serve disproportionate shares of low-income families and where students’ average elementary-school reading and math scores are more than one-quarter of a standard deviation lower than schools not in the league. Some 82 percent of students at debate schools qualify for free or reduced-price school lunch and 36 percent are English language learners compared to 68 percent and 26 percent of students, respectively, at non-debate schools. The group of debaters we study is 42 percent Black, 39 percent Hispanic, 9 percent white, and 8 percent Asian. The typical debater began in the ninth grade, and a large majority only participated for a single academic year. Twenty eight percent participated in middle school.

Debaters are a self-selected group—the team is a voluntary, after-school activity, and tournaments are held offsite on evenings and weekends. We examine baseline characteristics of debaters and students at debate schools who never join a team and find notable differences. Debaters have higher elementary-school reading scores, better attendance rates, and are less likely to receive special-education services than their classmates who choose not to join the team. They also are more likely to be female, Black, and economically disadvantaged.

Because of these non-trivial contrasts and the opt-in nature of the teams, it is likely that debaters and their non-debating classmates differ from one another in ways unrelated to debate. Therefore, for part of our analysis, we look to another group of students to serve as a comparison group: students attending schools that were not in the league and therefore could not choose whether to join a team. These students are more similar to debaters in terms of baseline test scores and are likely non-debaters because the program was not available to them.

Figure 1: Debate Participation Boosts Reading Achievement

Effects on Academic Performance

First, to assess the impact of debate on academics, we compare debaters to themselves over time. Our analysis looks at individual students’ test scores, attendance, and suspension records to test whether performance is different in years when students did and did not participate in debate.

Debaters earn higher scores on reading tests in the years when they participate in debate, and those benefits increase the longer students spend on the debate team (see Figure 1). Among all students who ever debated in school—who spend an average of 1.4 years on the team—reading scores increase by 13 percent of a standard deviation in the years they participate. Scores for students who spend just one year on the team increase by 10 percent of a standard deviation compared to 14 percent for students who spend four years on the team. Among the very small group of students who start in middle school and debate for five years, reading scores are 36 percent of a standard deviation higher.

In math, we do not find strong evidence that debate has a positive impact, although we see no evidence of harm. However, the math results do provide another insight: the much smaller math impacts relative to reading gives us confidence that our reading impact estimates are not simply an artifact of selection.

We also investigate which literacy skill gains drive the increase in debaters’ reading scores by looking at which test items exhibit the biggest differences in student performance. We compare performance on “language” items, which test grammar, vocabulary, and punctuation knowledge, with performance on “reading” tasks, which focus on comprehension and analysis, such as identifying the main idea of a passage or supporting evidence for a claim. The positive impacts for debaters are nearly twice as large in more sophisticated reading tasks, at 10 percent of a standard deviation, than in language, at 6 percent of a standard deviation.

Interestingly, although debaters are generally higher performing than students in the same schools who never join debate, our analysis shows that the largest gains from debate are among students who had the lowest reading scores at the start of sixth grade (see Figure 2). When they participate on a debate team, students who were in the bottom quartile in elementary-school reading experience gains of 24 percent of a standard deviation compared to 10 percent of a standard deviation for students with the best elementary-school performance.

Figure 2: Bigger Benefits for Struggling Students

Finally, we also assess the impacts of debate participation on student attendance and behavior, as measured by how many days students are suspended from school. Overall, students have slightly better attendance in years they participate in debate, with an increase of 1.7 percent in days present. The impact on suspensions is minimal. However, in looking at the small group of students who start in middle school and spend five years on a debate team, we find the number of days present grows by 4 percent and the number of days suspended falls by about one-fifth.

Most likely, these comparisons produce conservative estimates of the impacts of debate because every student in our sample has participated at least once. Even after a student leaves a debate team, they may carry those experiences and learning gains with them for some unknown length of time. Therefore, our comparison between participating and non-participating years may understate the true impact of debate participation on academic achievement, since our non-participant group includes students who have already benefitted from debate.

On the other hand, these estimates may camouflage other factors contributing to the impacts of debate, such as students choosing a high school in order to join the debate team. Therefore, we also analyze our data by excluding students who debate for multiple years and by excluding students who started debate in grade 9. We do not see meaningful changes to our results, indicating that our preferred estimates capture the impact of debate participation itself.

Figure 3: Debaters are More Likely to Graduate High School and Enroll in College

Effects on Graduation and College Enrollment

To study the impacts of policy debate on students’ postsecondary outcomes, we use a different comparison group: demographically similar students at schools that do not offer debate. We find that debate has substantial effects on both high-school graduation and college enrollment (see Figure 3). Some 80 percent of debaters graduate high school in five years compared to 68 percent of non-debaters, an increase of 17 percent. In addition, 53 percent of debaters enroll in a postsecondary institution within two years of their expected high-school graduation date compared to 41 percent of non-debaters, an increase of 29 percent. As with the impacts on academic outcomes, we find large differences when comparing debaters by their baseline reading performance at the start of middle school. Debaters with low elementary-school reading scores experience the greatest gains in post-secondary outcomes: they are 25 percent more likely to graduate high school in five years and 55 percent more likely to enroll in a postsecondary institution, based on gains of 16.4 and 20.5 percentage points, respectively.

We also find big increases in the share of students enrolling in four-year institutions after graduating high school, with the largest gains for students with the lowest elementary-school reading scores (see Figure 4). Overall, debaters are 38 percent more likely to enroll in a four-year school and 28 percent more likely to enroll in a two-year school, based on gains of 12 and 4 percentage points, respectively. Students in the lowest quartile are 16 percentage points more likely to enroll in a four-year college after graduation compared to 9 percentage points for students with the highest baselines scores.

Figure 4: Greater Gains in Enrollment at Four-Year Schools

Policy Implications for Policy Debate

Most reading interventions are focused on the early elementary years, and third grade reading proficiency is viewed as a bellwether for success in adulthood. But what about the nine years of school that follow? We find substantial positive impacts for teenage students, the majority of whom are low-income students of color, when they participate in a competitive high-school policy debate team. Debaters make outsized progress in mastering sophisticated literacy skills and are more likely to graduate high school and enroll in college—and the biggest gains are among the students the farthest behind at the end of fifth grade. It’s never too late to accelerate student progress.

The average improvement in debaters’ reading scores is comparable to two-thirds of a year of learning and about 20 percent of the gap in 8th-grade reading between students who do and do not qualify for subsidized school lunch. Prior research has uncovered few interventions that generate literacy impacts of this magnitude for secondary school students.

Further, the positive impacts on reading scores from participating in debate are twice as large for students with the lowest baseline levels of proficiency than for students with average scores, and we find a similar pattern of results for postsecondary outcomes. Debate programs therefore have the potential to reduce educational inequality by accelerating improvement most dramatically for the students who struggle most.

These programs also are inexpensive relative to other interventions. For example, the current per-pupil cost of the Boston Debate League is about $1,360 compared to about $2,800­ for high-dosage tutoring, such as the well-regarded Match Education program. Prior research has found that students’ reading performance improves by 15­ percent to 25 percent of a standard deviation after tutoring. Therefore, policy debate programs appear to generate up to double the impact on reading test scores per dollar compared to state-of-the-art high-dosage tutoring.

Our study is not without limitations. Only a small subset of Boston students, all of them volunteers, participate in debate, and we can’t speak to what would happen if students were required to join. We also can’t fully rule out the possibility that some or all of the estimated effects on postsecondary outcomes are driven by selection bias, particularly because the postsecondary impact estimates are quite large.

However, our finding that the gains in reading scores are concentrated on analytical thinking competencies rather than foundational language rules and conventions strengthens our confidence that our results reflect the impact of debate participation, not some other unobserved factor. This finding also suggests that policy debate develops students’ critical thinking skills, another goal for which evidence-based strategies are in short supply. Future research should probe this finding further with better measures of critical thinking, argumentation skills, and other competencies needed for academic and civic participation such as social perspective taking, media literacy, the ability to distinguish fact from opinion, and engagement with the policy process.

Beyond highlighting the value of formal debate programs, we believe these findings also have implications for classroom instruction. A handful of organizations, including the Boston Debate League, have developed and implemented professional development programs to help teachers infuse debate pedagogy into regular classrooms. Often called “debate-centered instruction,” the goal is to give more students the opportunity to benefit from debate-like learning opportunities, not just those who can choose to take part in an intensive out-of-school program. The potential for such instruction to accelerate reading development, particularly for students far behind grade level, is an important subject for future research. While our study demonstrates exciting results for extracurricular debate participants, there may be even greater dividends to incorporating some of these practices into regular classroom-based instruction, to reach all students.

Beth E. Schueler is an assistant professor at the University of Virginia. Katherine E. Larned is a doctoral candidate at the Harvard Graduate School of Education.

This article appeared in the Summer 2024 issue of Education Next. Suggested citation format:

Schueler, B.E., and Larned, K.E. (2024). Resolved: Debate Programs Boost Literacy and College Enrollment: How debaters become better students. Education Next, 24(3), 52-59.

The post Resolved: Debate Programs Boost Literacy and College Enrollment appeared first on Education Next.

]]>
49718197
Summer “Vacation Academies” Can Narrow Coronavirus Learning Gaps https://www.educationnext.org/summer-vacation-academies-narrow-coronavirus-learning-gaps-springfield/ Thu, 21 May 2020 00:15:41 +0000 http://www.educationnext.org/?p=49711441 Small-group instruction, both in person and online, can give students needed support

The post Summer “Vacation Academies” Can Narrow Coronavirus Learning Gaps appeared first on Education Next.

]]>
Massachusetts Governor Charlie Baker visits Forest Park Middle School, which participates in the Springfield Empowerment Zone Partnership.
Massachusetts Governor Charlie Baker visits Forest Park Middle School, which uses vacation-academy instruction as part of the Springfield Empowerment Zone Partnership.

The American K–12 public school system looks nothing like it did two months ago. Educators are scrambling to adapt to virtual environments, while too many students have not yet engaged with online learning at all. These access issues do not affect all students equally but instead play out along familiar lines of social class and race. Given all that educational researchers know about economic downturns, absenteeism, disruption, trauma, and learning time, the pandemic will have devastating effects on student learning and widen race- and class-based educational opportunity and outcome gaps.

School-system leaders rightly focused first on addressing students’ immediate needs: their health and safety, access to basics like food and shelter, and emotional wellbeing. But they quickly pivoted to determining how best to support students academically, now and once in-person schooling resumes. Many are touting this as an unprecedented opportunity for innovation. Remedying learning losses will require new solutions, but it would be a mistake to ignore tried-and-true, evidence-based strategies. What practices are most promising for catching up students who will re-enter school the farthest behind? One answer may lie with an old strategy that is backed by a rigorous and consistent body of research: tutoring and small-group instruction.

Tutoring—a format dating back to at least the ancient Greeks—is hardly a novel innovation, but research consistently shows its effectiveness. Comprehensive reviews of “gold standard” randomized controlled trials on a variety of educational programs reveal that tutoring—particularly intensive “high-dosage” tutoring—demonstrates profound results. A recent evaluation of the Match Corps tutoring model implemented with academically disadvantaged high-school students in Chicago showed large impacts. These programs involve a screening process for tutors with a college degree, training and ongoing support for tutors, one-on-one or small-group instruction, and student-tutor pairings that last a full year. Tutoring partly explains the success of high-performing charter schools, as well as efforts to improve low-performing traditional public schools.

So why haven’t all districts adopted high-dosage tutoring? Despite research showing these programs have impressive cost-benefit ratios, they still come with a high upfront price tag. Therefore, while tutoring should indeed be one of the tools used to address coronavirus-related learning loss, other approaches to individualized instruction might provide an even more affordable and scalable alternative. One option is “vacation academy” small-group programming, for which districts select teachers they consider to be highly effective and offer them the opportunity to instruct groups of roughly ten struggling students in a single subject over weeklong vacation breaks. This strategy has demonstrated strong results in rigorous studies.

The vacation-academy model could be implemented to minimize learning loss for those students most likely to fall behind due to coronavirus learning disruptions and tailored to the timing and nature of school re-openings in a given context. Vacation academies could be deployed this summer, either in-person where safe or virtually with adaptations, to make up for lost spring time. They could also be implemented, in-person or virtually, in the weeks leading up to the start of the academic year to help students readjust, or during vacation breaks in the 2020–21 school year to supplement instruction for those students in need of extra support. Vacation academies could even make up for future lost time in the event of rolling school closures.

Why is this model particularly well-suited to the time of coronavirus?

First, such a program can target the students most affected by school closures. Low teacher-to-student ratios allow instructors to tailor to the range of needs students will have due to variation in out-of-school experiences while in-person schooling was on hold. Further, virtual small-group instruction may be more feasible than managing large groups on online platforms, and in-person small-group instruction may be safer than large gatherings, from a public health perspective, for engaging students once shelter-in-place orders are lifted.

Second, educators can opt in or out, which is important since some teachers will have less capacity to participate—for example, if they are caring for their own young children or those affected directly by the disease, or if they themselves are vulnerable—while others have greater flexibility. There is also potential to enlist instructors from beyond the pool of traditionally certified teachers, as Match Corps does, and access a supply of unusual talent given record unemployment numbers. Centralized recruitment for academy instructors could facilitate teachers from one district serving students from another, as has been done in places like Massachusetts. This is especially true for virtual academies that do not require geographic proximity, providing rare opportunities for disadvantaged students to receive instruction from their state’s most effective educators.

Vacation academies would not only benefit students academically but also support their broader well-being. Program participants in Springfield, Massachusetts, saw both gains on test scores and reductions in suspensions when they returned to school after the program. The improvement on disciplinary outcomes was especially pronounced for students assigned to the same instructor for the duration of the program, suggesting the importance of relationship-building. Support from a caring adult could be more impactful than ever at a time when many students have been feeling otherwise disconnected.

We should avoid repeating past mistakes, however. The underwhelming results of No Child Left Behind’s Supplemental Educational Services provision highlight that not all individualized-instructional programs are created equal. Ensuring high quality must be top of mind. For example, all model programs emphasize instructor selection. Furthermore, given the unique circumstances, no existing approach will work without modification, and evidence is needed on how to carry out individualized instruction online successfully. Researchers should stand at the ready to help leaders learn from the resulting experiments.

Vacation academies alone will not eliminate coronavirus learning loss and may not be right for every student. They should therefore be part of a broader strategy. Implementing such efforts will require clearing legal, logistical, financial, and political hurdles, which vary from place to place. However, parents with the means are already providing their children with supplemental learning experiences. States, districts, and schools should take inspiration from creative, individualized approaches to minimize the educational gaps this pandemic is likely to exacerbate.

Beth Schueler is an Assistant Professor of Education and Public Policy at the University of Virginia studying K-12 education policy, politics, and inequality. You can follow her on Twitter at @BethSchueler.

Read more from Education Next on coronavirus and Covid-19.

The post Summer “Vacation Academies” Can Narrow Coronavirus Learning Gaps appeared first on Education Next.

]]>
49711441