Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

EdWorkingPapers

David Blazar, Doug McNamara, Genine Blue.

Instructional coaching is an attractive alternative to one-size-fits-all teacher training and development in part because it is purposefully differentiated: programming is aligned to individual teachers’ needs and implemented by an individual coach. But, how much of the benefit of coaching as an instructional improvement model depends on the specific coach with whom a teacher works? Collaborating with a national teacher training and development organization, TNTP, we find substantial variability in effectiveness across coaches in terms of changes in teachers’ classroom practice (0.43 standard deviations). The magnitude of coach effectiveness heterogeneity is close to average coaching program effects identified in other research. These findings suggest that identifying, recruiting, and supporting highly skilled coaches will be key to scaling instructional coaching programs.

More →


Vladimir Kogan.

How do adult "culture wars" in education affect student learning in the classroom? I explore this question by combining information on nearly 500 school district political controversies with data on state test scores. Leveraging variation in the location and timing of these events as the basis for a difference-in-differences design, I show that student achievement declines in the wake of adult political battles. The effects are concentrated in math achievement -- the equivalent of approximately 10 days of lost learning -- and persist for at least four years. The declines are particularly pronounced for controversies surrounding racial issues and the teaching of evolution. These results suggest that well-intentioned education advocacy efforts focused on salient social justice issues may backfire, producing in unintended negative impacts on student achievement, and raise new questions about the adequacy of local democratic processes for the governance of public schools.

More →


Sarah Guthery, Lauren P. Bailes.

Texas reduced new teacher preparation requirements in 2001 to allow more alternate paths to licensure. Within five years, this policy change resulted in over half the state’s new teachers being alternatively licensed. Using a series of first difference models, this study examines the relationship between the increased supply of new teachers in Texas and new teacher salaries prior to the policy change and in the fifteen years thereafter. We find that the policy change did increase the supply of new teachers via alternative licensing, but pay for new EC-6 teachers declined by 2 to 13 percent with differential effects based on the rate at which districts hired alternatively licensed teachers.

More →


Heather McCambly, Quinn Mulroy.

Public discussions of racial inclusion and equal opportunity initiatives in the U.S. are often met with claims that expanding access to an institution, space, or public good is likely to diminish its quality. Examples of this pattern include: anticipated (and real) property value declines when predominantly white neighborhoods become more racially diverse; fears that the excellence of white schools will decline when the population of Black and brown students grows; apprehensions that equitable hiring practices necessarily entail lower standards for job candidates. In this paper, we examine how a federal agency, the Fund for the Improvement of Postsecondary Education (FIPSE), charged with addressing the aftermath of the ‘access wave’ of new college students promulgated by the Higher Education Act of 1965, came to reconcile its commitments to educational equity and quality. Through a novel examination of the historical development of what we term (e)quality politics in the administration of civil rights policy in higher education, we trace how two concepts - equity and quality – became discursively linked and contested in American politics. (E)quality politics refers to the introduction of a policy paradigm that reframes equity discussions and goals around the professed need to preserve and advance institutional “quality” using measures and standards that are, importantly, defined and instantiated under the era of segregation that precedes equal access policies. In particular, we uncover the discursive patterns by which the perceived threats to “quality” posed by racial diversity can prompt administrators to compensate, protect, and maintain the prerogatives of high-status institutions or groups that benefited under previous eras of exclusion. Understood as part of a backlash to egalitarian reforms, we argue, these quality measures undermine equity goals.

More →


Taylor Odle, Lauren C. Russell.

Reverse transfer associate degrees are credentials retroactively awarded to current bachelor’s degree seekers that combine current four-year credits with credits previously earned at a community college. Providing students with an associate degree may not only increase motivation and persistence en route to completing a bachelor’s but may also provide important labor market benefits by way of increased marketability and earnings potential. Despite the proliferation of reverse transfer policies across at least 15 states to date, there is no causal evidence documenting their effect on students’ outcomes. Leveraging administrative data from Tennessee matched with records on its statewide reverse transfer program and a difference-in-differences design, we find reverse transfer degrees generally have little impact on students’ short- and intermediate-term academic and labor market outcomes. Our results point to suggestive yet small positive gains in GPA and short-term employment for recipients, but these estimates accompany no impacts on bachelor’s degree attainment and estimates that confidently reject any meaningful impacts on recipients’ earnings. Our findings contrast those of existing descriptive works on reverse transfer that reported large benefits for students, due in part to our methodological improvements and more robust data. These findings should guide policymakers considering the adoption, design, and ongoing operation of reverse transfer programs.

More →


Brian Heseung Kim, Katharine Meyer, Alice Choe.

Interactive, text message-based advising programs have become an increasingly common strategy to support college access and success for underrepresented student populations. Despite the proliferation of these programs, we know relatively little about how students engage in these text-based advising opportunities and whether that relates to stronger student outcomes – factors that could help explain why we’ve seen relatively mixed evidence about their efficacy to date. In this paper, we use data from a large-scale, two-way text advising experiment focused on improving college completion to explore variation in student engagement using nuanced interaction metrics and automated text analysis techniques (i.e., natural language processing). We then explore whether student engagement patterns are associated with key outcomes including persistence, GPA, credit accumulation, and degree completion. Our results reveal substantial variation in engagement measures across students, indicating the importance of analyzing engagement as a multi-dimensional construct. We moreover find that many of these nuanced engagement measures have strong correlations with student outcomes, even after controlling for student baseline characteristics and academic performance. Especially as virtual advising interventions proliferate across higher education institutions, we show the value of applying a more codified, comprehensive lens for examining student engagement in these programs and chart a path to potentially improving the efficacy of these programs in the future.

Open source code on GitHub.

More →


Matthew A. Kraft, John A. List, Jeffrey A. Livingston, Sally Sadoff.

A substantial body of experimental evidence demonstrates that in-person tutoring programs can have large impacts on K-12 student achievement. However, such programs typically are costly and constrained by a limited local supply of tutors. In partnership with CovEducation (CovEd), we conduct a pilot program that has potential to ease both of these concerns. We conduct an experiment where volunteer tutors from all over the country meet 1-on-1 with middle school students online during the school day. We find that the program produces consistently positive (0.07σ for math and 0.04σ for reading) but statistically insignificant effects on student achievement. While these estimates are notably smaller than those found in many higher-dosage in-person tutoring programs, they are from a significantly lower-cost program that was delivered within the challenging context of the COVID-19 pandemic. We provide evidence that is consistent with a dosage model of tutoring where additional hours result in larger effects.

More →


Matthew A. Kraft, Joshua Bleiberg.

Economic downturns can cause major funding shortfalls for U.S. public schools, often forcing districts to make difficult budget cuts including teacher layoffs. In this brief, we synthesize the empirical literature on the widespread teacher layoffs caused by the Great Recession. Studies find that teacher layoffs harmed student achievement and were inequitably distributed across schools, teachers, and students. Research suggests that specific elements of the layoff process can exacerbate these negative effects. Seniority-based policies disproportionately concentrate layoffs among teachers of color who are more likely to be early career teachers. These “last-in first-out” policies also disproportionately affect disadvantaged students because these students are more likely to be taught by early career teachers. The common practice of widely distributing pink slips warning about a potential job loss also appears to increase teacher churn and negatively impact teacher performance. Drawing on this evidence, we outline a set of policy recommendations to minimize the need for teacher layoffs during economic downturns and ensure that the burden of any unavoidable job cuts does not continue to be borne by students of color and students from low-income backgrounds.

More →


Taylor Odle.

Promoting equality in college enrollment and completion must start early in students’ college-going journeys, including with their expectations to first earn a college degree. With a nationally representative sample of high school students, I evaluate the ability of a recent collection of college access policies (place-based “promise” scholarships or “free” college programs) to increase students’ college expectations and test the heterogeneity of these impacts across students’ race and family income. Evidence from a difference-in-differences design and lagged-dependent-variable regressions suggest the introduction of promise programs increased the likelihood a student expected to attain an associate degree or higher by 8.5 to 15.0 percentage points by the end of high school, with larger effects for low-income and racially minoritized students. This study is the first to test the power of “free” college in shaping pre-college students’ educational plans, and, in doing so, not only addresses an existing gap in the literature but also identifies a key mechanism through which many of the positive college-going impacts observed across promise programs in the current literature may in fact originate. Given the rapid proliferation of promise programs across the nation, this study provides policymakers with a fuller view of the potential impacts of these programs, particularly concerning how they influence students’ outcomes along dimensions of race and income.

More →


Christine Mulhern, Isaac M. Opper.

There is an emerging consensus that teachers impact multiple student outcomes, but it remains unclear how to measure and summarize the multiple dimensions of teacher effectiveness into simple metrics for research or personnel decisions. We present a multidimensional empirical Bayes framework and illustrate how to use noisy estimates of teacher effectiveness to assess the dimensionality and predictive power of teachers' true effects. We find that it is possible to efficiently summarize many dimensions of effectiveness and most summary measures lead to similar teacher rankings; however, focusing on any one specific measure alone misses important dimensions of teacher quality.

More →