Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.


Kenneth A. Shores, Hojung Lee, Elinor Williams.

Levels of governance (the nation, states, and districts), student subgroups (racial and ethnic minoritized and economically disadvantaged students), and types of resources (expenditures, class sizes, and teacher quality) intersect to represent a complex and comprehensive picture of K-12 educational resource inequality. Drawing on multiple sources of the most recently available data, we describe inequality in multiple dimensions. At the national level, racial and ethnic minoritized and economically disadvantaged students receive less K-12 expenditures per pupil than White and economically advantaged students (between $400 to $1,200 less per pupil). At the state and district levels, racial and ethnic minoritized and economically disadvantaged students receive more K-12 expenditures per pupil than white and economically advantaged students (between $200 to $400 more). The notable exception is Hispanic students, who receive no additional funding per pupil than white students, on average, at the state level. Among districts, minoritized and economically disadvantaged students have smaller class sizes than their subgroup counterparts, but these students also have greater exposure to inexperienced teachers. About 20 percent of additional teacher hires favoring traditionally disadvantaged student subgroups is for novice teachers. We see no evidence that district-level spending in favor of traditionally disadvantaged subgroups is explained by district size, average district spending, teacher turnover, or the size of the special education population.

More →

Jing Liu, Michael S. Hayes, Seth Gershenson.

We use novel data on disciplinary referrals, including those that do not lead to suspensions, to better understand the origins of racial disparities in exclusionary discipline. We find significant differences between Black and white students in both referral rates and the rate at which referrals convert to suspensions. An infraction fixed-effects research design that compares the disciplinary outcomes of white and non-white students who were involved in the same multi-student incident identifies systematic racial biases in sentencing decisions. On both the intensive and extensive margins, minoritized students receive harsher sentences than their white co-conspirators. This result is driven by high school infractions and applies to all infraction types. Reducing racial disparities in exclusionary discipline will require addressing underlying gaps in disciplinary referrals and the systematic biases that appear in the adjudication process.

More →

Matthew A. Kraft, Alexander Bolves, Noelle M. Hurd.

We document a largely unrecognized pathway through which schools promote human capital development – by fostering informal mentoring relationships between students and school personnel. Using longitudinal data from a large, nationally representative sample of adolescents, we explore the frequency, nature, and consequences of school-based natural mentorships. Estimates across a range of fixed effect (FE) specifications, including student FE and twins FE models, consistently show that students with school-based mentors achieve greater academic success and higher levels of post-secondary attainment. These apparent benefits are evident for students across a wide range of backgrounds but are largest for students of lower socioeconomic status.

More →

Bobby W. Chung, Jian Zou.

The educative Teacher Performance Assessment (edTPA) - a performance-based examination for prospective PreK-12 teachers to guarantee teaching readiness - has gained popularity in recent years. This research offers the first causal evidence about the effects of this nationwide initiative on teacher supply and student outcomes of new teachers. We leverage the quasi-experimental setting of different adoption timing by states and analyze multiple data sources containing a national sample of prospective teachers and students of new teachers in the US. We find that the new license requirement reduced the number of graduates from teacher preparation programs by 14%. The negative effect is stronger for non-white prospective teachers at less-selective universities. Contrary to the policy intention, we find evidence that edTPA has adverse effects on student learning.

More →

C. Kirabo Jackson, Claire Mackevicius.

We examine all known "credibly causal" studies to explore the distribution of the causal effects of public K-12 school spending on student outcomes in the United States. For each of the 31 included studies, we compute the same marginal spending effect parameter estimate. Precision-weighted method of moments estimates indicate that, on average, a $1000 increase in per-pupil public school spending (for four years) increases test scores by 0.0352 standard deviations, high school graduation by 1.92 percentage points, and college-going by 2.65 percentage points. These pooled averages are significant at the 0.0001 level. When benchmarked against other interventions, test score impacts are smaller than those on educational attainment -- suggesting that test-score impacts understate the value of school spending. 

The benefits to marginal capital spending increases take about five years to materialize, and are about half as large as (and less consistently positive than) those of non-capital-specific spending increases. The marginal spending impacts for all spending types are less pronounced for economically advantaged populations -- though not statistically significantly so. Consistent with a cumulative effect, the educational attainment impacts are larger with more years of exposure to the spending increase.  Average impacts are similar across a wide range of baseline spending levels and geographic characteristics -- providing little evidence of diminishing marginal returns at current spending levels.

To assuage concerns that pooled averages aggregate selection or confounding biases across studies, we use a meta-regression-based method that tests for, and removes, certain biases in the reported effects. This approach is straightforward and can remove biases in meta-analyses where the parameter of interest is a ratio, slope, or elasticity. We fail to reject that the meta-analytic averages are unbiased. Moreover, policies that generate larger increases in per-pupil spending tend to generate larger improvements in outcomes, in line with the pooled average. 

To speak to generalizability, we estimate the variability across studies attributable to effect heterogeneity (as opposed to sampling variability). This heterogeneity explains between 76 and 88 percent of the variation across studies. Estimates of heterogeneity allow us to provide a range of likely policy impacts. Our estimates suggest that a policy that increases per-pupil spending for four years will improve test scores and/or educational attainment over 90 percent of the time. We find evidence of small possible publication bias among very imprecise studies, but show that any effects on our precision-weighted estimates are minimal.

More →

Oded Gurantz, Ryan Sakoda, Shayak Sarkar.

This paper examines how financial aid reform based on postsecondary institutional performance impacts student choice. Federal and state regulations often reflect concerns about the private, for-profit sector's poor employment outcomes and high loan defaults, despite the sector's possible theoretical advantages. We use student level data to examine how eliminating public subsidies to attend low-performing for-profit institutions impacts students' college enrollment and completion behavior. Beginning in 2011, California tightened eligibility standards for their state aid program, effectively eliminating most for-profit eligibility. Linking data on aid application to administrative payment and postsecondary enrollment records, this paper utilizes a differences-in-differences strategy to investigate students' enrollment and degree completion responses to changes in subsidies. We find that restricting the use of the Cal Grant at for-profit institutions resulted in significant state savings but led to relatively small changes in students' postsecondary trajectories. For older, non-traditional students we find no impact on enrollment or degree completion outcomes. Similarly, for high school graduates, we find that for-profit enrollment remains strong. Unlike the older, non-traditional students, however, there is some evidence of declines in for-profit degree completion and increased enrollment at community colleges among the high school graduates, but these results are fairly small and sensitive to empirical specification. Overall, our results suggest that both traditional and non-traditional students have relatively inelastic preferences for for-profit colleges under aid-restricting policies.

More →

Kelli A. Bird, Benjamin L. Castleman, Zachary Mabel, Yifeng Song.

Colleges have increasingly turned to predictive analytics to target at-risk students for additional support. Most of the predictive analytic applications in higher education are proprietary, with private companies offering little transparency about their underlying models. We address this lack of transparency by systematically comparing two important dimensions: (1) different approaches to sample and variable construction and how these affect model accuracy; and (2) how the selection of predictive modeling approaches, ranging from methods many institutional researchers would be familiar with to more complex machine learning methods, impacts model performance and the stability of predicted scores. The relative ranking of students’ predicted probability of completing college varies substantially across modeling approaches. While we observe substantial gains in performance from models trained on a sample structured to represent the typical enrollment spells of students and with a robust set of predictors, we observe similar performance between the simplest and most complex models.

More →

Jeehee Han, Amy Ellen Schwartz.

Is public housing bad for children? Critics charge that public housing projects concentrate poverty and create neighborhoods with limited opportunities, including low-quality schools. However, whether the net effect is positive or negative is theoretically ambiguous and likely to depend on the characteristics of the neighborhood and schools compared to origin neighborhoods. In this paper, we draw on detailed individual-level longitudinal data on students moving into New York City public housing and examine their academic outcomes over time. Exploiting plausibly random variation in the precise timing of entry into public housing, we estimate credibly causal effects of public housing using both difference-in-differences and event study designs. We find credibly causal evidence of positive effects of moving into public housing on student test scores, with larger effects over time. Stalled academic performance in the first year of entry may reflect, in part, disruptive effects of residential and school moves. Neighborhood matters: effects are larger for students moving out of low-income neighborhoods or into higher-income neighborhoods, and these students move to schools with higher average test scores and lower shares of economically disadvantaged peers. We also find some evidence of improved attendance outcomes and reduction in incidence of childhood obesity for boys following public housing residency. Our study results refute the popular belief that public housing is bad for kids and probe the circumstances under which public housing may work to improve academic outcomes for low-income students.

More →

Andrew Bacher-Hicks, Joshua Goodman, Jennifer Greif Green, Melissa K. Holt.

School bullying is widespread and has substantial social costs. One in five U.S. high school students report being bullied each school year and these students face greater risks of serious mental health challenges that extend into adulthood. As the COVID-19 pandemic forced most students into online education, many have worried that cyberbullying prevalence would grow dramatically. We use data from Google internet searches to examine changing bullying patterns as COVID-19 disrupted in-person schooling. Pre-pandemic historical patterns show that internet searches provide useful information about actual bullying behavior. Real-time data then shows that searches for school bullying and cyberbullying both dropped about 30-40 percent as schools shifted to remote learning in spring 2020. This drop is sustained through the fall and winter of the 2020-21 school year, though the gradual return to in-person instruction partially returns bullying searches to pre-pandemic levels. These results highlight how in-person interaction is an important mechanism underlying not only in-person school bullying, but also cyberbullying. We discuss how this otherwise damaging shock to students and schools provides insight into the mixed impact of the pandemic on student well-being.

More →

Beth E. Schueler, Daniel Rodriguez-Segura.

Covid-19-induced school closures generated great interest in tutoring as a strategy to make up for lost learning time. Tutoring is backed by a rigorous body of research, but it is unclear whether it can be delivered effectively remotely. We study the effect of teacher-student phone call interventions in Kenya when schools were closed. Schools (n=105) were randomly assigned for their 3rd, 5th and 6th graders (n=8,319) to receive one of two versions of a 7-week weekly math-focused intervention—5-minute accountability checks or 15-minute mini-tutoring sessions—or to the control group. Although calls increased student perceptions that teachers cared, accountability checks had no effect on math performance up to four months after the intervention and tutoring decreased math achievement among students who returned to their schools after reopening. This was, in part, because the relatively low-achieving students most likely to benefit from calls were least likely to return and take in-person assessments. Tutoring substituted away from more productive uses of time, at least among returning students. Neither intervention affected enrollment. Tutoring remains a valuable tool but to avoid unintended consequences, careful attention should be paid to aligning tutoring interventions with best practices and targeting interventions to those who will benefit most.

More →