Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Kaitlin P. Anderson, Bashir Sadat, Raquel Sosa.

Advanced course-taking in high school sends an important signal to college admissions officers, helps reduce the cost and time to complete a post-secondary degree, and increases educational attainment and future earnings. However, Black and Hispanic students in the U.S. are underrepresented in Advanced Placement coursework and dual enrollment (i.e. early college). In this paper, we systematically examine the social, demographic, economic, and policy factors that are predictive of racial gaps in AP enrollment and access to DE across the U.S. We find that many of the same factors that predict higher AP access overall also predict higher racial/ethnic gaps in AP, suggesting that policies aimed at increasing AP access need to specifically attend to the inequitable access, rather than simply focusing on increasing access overall. We also find evidence that that might indicate opportunity hoarding by White families contributes to AP gaps – but not DE gaps – suggesting that DE acts as a more equitable avenue for access to college coursework. Our most novel contribution to the literature is our analysis of policies aimed at reducing teacher shortages in high needs areas, in which we find no evidence that the disparities in access to advanced coursework were reduced following implementation of these policies.

More →


Heather C. Hill, Anna Erickson.

Poor program implementation constitutes one explanation for null results in trials of educational interventions. For this reason, researchers often collect data about implementation fidelity when conducting such trials. In this article, we document whether and how researchers report and measure program fidelity in recent cluster-randomized trials. We then create two measures—one describing the level of fidelity reported by authors and another describing whether the study reports null results—and examine the correspondence between the two. We also explore whether fidelity is influenced by study size, type of fidelity measured and reported, and features of the intervention. We find that as expected, fidelity level relates to student outcomes; we also find that the presence of new curriculum materials positively predicts fidelity level.

More →


Ishtiaque Fazlul, Cory Koedel, Eric Parsons.

Free and reduced-price meal (FRM) enrollment is commonly used in education research and policy applications as an indicator of student poverty. However, using multiple data sources external to the school system, we show that FRM status is a poor proxy for poverty, with enrollment rates far exceeding what would be expected based on stated income thresholds for program participation. This is true even without accounting for community eligibility for free meals, although community eligibility has exacerbated the problem in recent years. Over the course of showing the limitations of using FRM data to measure poverty, we also provide early evidence on the potential value of two alterative measures of school poverty.

More →


Rachel M. Perera.

Using newly available data on all civil rights complaints submitted to the U.S. Department of Education’s Office for Civil Rights related to racial discrimination in discipline between 1999 and 2018, I provide the first systematic evidence on how modern federal civil rights enforcement is used to address racial discrimination in discipline. I find that less than 50 percent of complaints received each year result in a federal investigation. I also find that 70 to 80 percent of investigations are closed due to insufficient evidence of a civil rights violation. Results also suggest that districts with higher shares of minoritized students, higher levels of segregation, and districts with larger racial educational gaps are more likely to receive a civil rights complaint after controlling for other district factors.

More →


Beth E. Schueler, Joshua Bleiberg.

Local school boards have primary authority for running educational systems in the U.S. but little is known empirically about the merits of this arrangement. State takeovers of struggling districts represent a rare alternative form of educational governance and have become an increasingly common response to low performance. However, limited research explores whether this effectively improves student outcomes. We track all takeovers nationwide from the late 1980s, when the first takeovers occurred, through 2016 and describe takeover districts. While these districts are low performing, we find academic performance plays less of a role in predicting takeover for districts serving larger concentrations of African American students. We then use a new data source allowing for cross-state comparisons of student outcomes to estimate the effect of takeovers that occurred between 2011 and 2016. On average, we find no evidence that takeover generates academic benefits. Takeover appears to be disruptive in the early years of takeover, particularly to English Language Arts achievement, although the longer-term effects are less clear. We also observe considerable heterogeneity of effects across districts. Takeovers were least effective in districts with higher baseline achievement and least harmful in majority Latinx communities. Leaders should be cautious about using takeover without considering local context and a better understanding of why some takeovers are more effective than others.

More →


Thurston Domina, Deven Carlson, James S. Carter III, Matthew A. Lenard, Andrew McEachin, Rachel Perera.

Many public school diversity efforts rely on reassigning students from one school to another. While opponents of such efforts articulate concerns about the consequences of reassignments for students’ educational experiences, little evidence exists regarding these effects, particularly in contemporary policy contexts. Using an event study design, we leverage data from an innovative socioeconomic school desegregation plan to estimate the effects of reassignment on reassigned students’ achievement, attendance, and exposure to exclusionary discipline. Between 2000 and 2010, North Carolina’s Wake County Public School System (WCPSS) reassigned approximately 25 percent of students with the goal of creating socioeconomically diverse schools. Although WCPSS’s controlled school choice policy provided opportunities for reassigned students to opt out of their newly reassigned schools, our analysis indicates that reassigned students typically attended their newly reassigned schools. We find that reassignment modestly boosts reassigned students’ math achievement, reduces reassigned students’ rate of suspension, and has no offsetting negative consequences on other outcomes. Exploratory analyses suggest that the effects of reassignment do not meaningfully vary by student characteristics or school choice decisions. The results suggest that carefully designed school assignment policies can improve school diversity without imposing academic or disciplinary costs on reassigned students.

More →


John Papay, Matthew A. Kraft, Jessalynn James.

Numerous high-profile efforts have sought to “turn around” low-performing schools. Evidence on the effectiveness of school turnarounds, however, is mixed, and research offers little guidance on which models are more likely to succeed. We present a mixed-methods case study of turnaround efforts led by the Blueprint Schools Network in three schools in Boston. Using a difference-in-differences framework, we find that Blueprint raised student achievement in ELA by at least a quarter of a standard deviation, with suggestive evidence of comparably large effects in math. We document qualitatively how differential impacts across the three Blueprint schools relate to contextual and implementation factors. In particular, Blueprint’s role as a turnaround partner (in two schools) versus school operator (in one school) shaped its ability to implement its model. As a partner, Blueprint provided expertise and guidance but had limited ability to fully implement its model. In its role as an operator, Blueprint had full authority to implement its turnaround model, but was also responsible for managing the day-to-day operations of the school, a role for which it had limited prior experience.

More →


Scott J. Peters, James S. Carter III.

A wide research base has documented the unequal access to and enrollment in K-12 gifted and talented services and other forms of advanced learning opportunities. This study extends that knowledge base by integrating multiple population-level datasets to better understand correlates of access to and enrollment in gifted and talented services, seventh-grade Algebra 1, and eighth-grade Geometry. Results show that states vary widely with some serving 20% of their students as gifted while others serve 0%. Similarly, within-district income segregation, income-related achievement gaps, and the percent of parents with a college degree are the dominant predictors of a school offering these opportunities and the size of the school population served.

More →


Taylor Mattia.

Brown v. Board (1954) catalyzed a nationwide effort by the federal judiciary to desegregate public schools by court order, representing a major achievement for the U.S. civil rights movement. Four decades later, courts began dismissing schools from desegregation decrees in a staggered fashion, causing their racial homogeneity to rise. I leverage this exogenous source of variation in the racial mix of schools released from court orders between 1990 and 2014 to explore two key aspects of how whites react to attending schools with students of color. First, contemporaneous survey data indicate that as schools re-segregated, white students in these schools expressed more favorable attitudes towards black and Latino students. Second, present-day voter records from six Southern states of white students in schools that re-segregated show that they are significantly more likely to identify with the more racially liberal party -- the Democrats -- today. The findings are consistent with white students experiencing resegregation as a reduction in social threat, and indicate that school desegregation efforts may have caused life-long shifts among white students toward racial and political conservatism.

More →


Carly D. Robinson, Susanna Loeb.

Research consistently demonstrates that tutoring interventions have substantial positive effects on student learning. As a result, tutoring has emerged as a promising strategy for addressing COVID-related learning loss and affording greater educational opportunities for students living in poverty. The effectiveness of tutoring programs, however, varies greatly, and these variations may drive differential gains in student learning. Therefore, determining the program characteristics that do and do not drive positive student outcomes will be key to providing guidance for policymakers and practitioners who want to implement high-impact tutoring at scale. Our goal is to highlight the programs, characteristics, and conditions that evidence suggests make for effective tutoring and to create an evidence-based framework for delivering and evaluating tutoring interventions. In addition, we identify promising questions for future research.

More →