Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Robert C. Carr, Tyler Watts, Jade M. Jenkins, Yu Bai, Ellen S. Peisner-Feinberg, Clara G. Muschkin, Helen F. Ladd, Kenneth A. Dodge.

Prior research has found that financial investments in North Carolina’s pre-kindergarten (pre-K) program generated positive effects on student reading and math achievement through eighth grade (Bai et al., 2020). The current study examined the interaction between NC Pre-K funding and two key dimensions of the subsequent educational environment students experience in their school districts: average achievement and achievement growth. In relation to student reading and math achievement in eighth grade, the benefits of NC Pre-K funding were found to be additive to the benefits of school-district average achievement. The benefits of NC Pre-K funding were also found to interact with the benefits of school-district achievement growth such that the NC Pre-K effect was larger in school districts with lower rates of growth in academic achievement. These findings suggest that public investments in early childhood education may be particularly beneficial in the long term for children who subsequently experience low-growth schooling environments compared to children in high-growth environments.

More →


Veronica Minaya, Judith Scott-Clayton, Rachel Yang Zhou.

Graduate education is among the fastest growing segments of the U.S. higher educational system. This paper provides up-to-date causal evidence on labor market returns to Master’s degrees and examines heterogeneity in the returns by field area, student demographics and initial labor market conditions. We use rich administrative data from Ohio and an individual fixed effects model that compares students’ earnings trajectories before and after earning a Master’s degree. Findings show that obtaining a Master’s degree increased quarterly earnings by about 12% on average, but the returns vary largely across graduate fields. We also find gender and racial disparities in the returns, with higher average returns for women than for men, and for White than for Black graduates. In addition, by comparing returns among students who graduated before and under the Great Recession, we show that economic downturns appear to reduce but not eliminate the positive returns to Master’s degrees.

More →


D'Wayne Bell, Jing Feng, John Holbein, Jonathan Smith.

For decades, pundits, politicians, college administrators, and academics have lamented the dismal rates of civic engagement among students who enroll in courses and eventually major in science, technology, engineering, and mathematics (i.e., STEM) fields. However, the research supporting this conclusion has faced distinct challenges in terms of data quality. Does STEM actually decrease the odds that young people will be actively involved in democracy? This paper assesses the relationship between studying STEM and voting.  To do so, we create a dataset of over 23 million students in the U.S. matched to national validated voting records.  The novel dataset is the largest known individual-level dataset in the U.S. connecting high school and college students to voting outcomes.  It also contains a rich set of demographic and academic variables, to account for many of the common issues related to students' selection into STEM coursework. We consider two measures of STEM participation ---Advanced Placement (AP) Exam taking in high school and college major. Using both measures, we find that, unconditionally, STEM students are slightly more likely to vote than their non-STEM peers.  After including the rich set of controls, the sign reverses and STEM students are slightly less likely to vote than their non-STEM peers. However, these estimated relationships between STEM and voting are small in magnitude---about the same effect size as a single get-out-the-vote mailer---and we can rule out even very modest causal effects of marginally more STEM coursework on voting for the typical STEM student.  We cannot rule out modest effects for a few subfields. Our analyses demonstrate that, on average, marginally more STEM coursework in high school and college does not contribute to the dismally low participation rates among young people in the U.S.

More →


John Papay, Ann Mantil, Richard J. Murnane.

Many states use high-school exit examinations to assess students’ career and college readiness in core subjects. We find meaningful consequences of barely passing the mathematics examination in Massachusetts, as opposed to just failing it. However, these impacts operate at different educational attainment margins for low-income and higher-income students. As in previous work, we find that barely passing increases the probability of graduating from high school for low-income (particularly urban low-income) students, but not for higher-income students. However, this pattern is reversed for 4-year college graduation. For higher-income students only, just passing the examination increases the probability of completing a 4-year college degree by 2.1 percentage points, a sizable effect given that only 13% of these students near the cutoff graduate.

More →


Hernando Grueso.

In this paper, I study the causal relationship between violence and human capital accumulation. Due to a power vacuum left in conflict zones of Colombia after the 2016 peace agreement, large spikes in violence were reported in the municipalities of the country dominated by the rebel group FARC. I compare student test scores in municipalities that experienced the increase in violence to the ones that did not, before and after the national peace agreement. I find that a 10 percent increase in the homicide rate reduces average high school test scores by approximately 0.03 standard deviations. However, this impact is greater in the case of poor students who suffered a reduction of about 0.1 standard deviations per subject area, equivalent to 3.3 percentage points out of the final score. I also consider heterogeneity by gender finding a slightly larger negative impact on female students. This disparate effect on women and on the poorest students adds new evidence to the literature on the effects of armed conflict on learning outcomes.

More →


Jordan S. Berne.

Nearly all studies of preschool’s long-run effects examine means-tested programs; little is known about the long-run effects of universal programs. A number of key differences—including population served, scale, and counterfactual options—may cause universal programs to have different effects than previously studied means-tested programs. Using a difference-in-differences framework, I estimate the effects of Georgia’s first-in-the-nation statewide universal pre-K program on adult educational attainment and employment. The program made children 4.5 percent more likely to graduate from high school and 13.7 percent more likely to obtain a bachelor’s degree (although the latter effect is imprecise). I find similar results in a supplemental analysis that uses the synthetic control method. I find no effects on associate degree attainment or employment.

More →


Serena Canaan, Stefanie Fischer, Pierre Mouganie, Geoffrey C. Schnorr.

To boost college graduation rates, policymakers often advocate for academic supports such as coaching or mentoring. Proactive and intensive coaching interventions are effective, but are costly and difficult to scale. We evaluate a relatively lower-cost group coaching program targeted at first-year college students placed on academic probation. Participants attend a workshop where coaches aim to normalize failure and improve self-confidence. Coaches also facilitate a process whereby participants reflect on their academic difficulties, devise solutions to address their challenges, and create an action plan. Participants then hold a one-time follow-up meeting with their coach or visit a campus resource. Using a difference-in-discontinuity design, we show that the program raises students’ first-year GPA by 14.6% of a standard deviation, and decreases the probability of first-year dropout by 8.5 percentage points. Effects are concentrated among lower-income students who also experience a significant increase in the probability of graduating. Finally, using administrative data we provide the first evidence that coaching/mentoring may have substantial long-run effects as we document significant gains in lower-income students’ earnings 7–9 years following entry to the university. Our findings indicate that targeted, group coaching can be an effective way to improve marginal students’ academic and early career outcomes.

More →


Monnica Chan, Zachary Mabel, Preeya Pandya Mbekeani.

Performance-based funding models for higher education, which tie state support for institutions to performance on student outcomes, have proliferated in recent decades. Some states have designed these policies to also address educational attainment gaps by including bonus payments for traditionally low-performing groups. Using a Synthetic Control Method research design, we examine the impact of these funding regimes on race-based completion gaps in Tennessee and Ohio. We find no evidence that performance-based funding narrowed race-based completion gaps. In fact, contrary to their intended purpose, we find that performance-based funding widened existing gaps in certificate completion in Tennessee. Across both states, the estimated impacts on associate degree outcomes are also directionally consistent with performance-based funding exacerbating racial inequities in associate degree attainment.

More →


Kevin J. Mumford.

Financing college expenses through an income share agreement (ISA) is an arrangement where the student agrees to pay a fixed percentage of future earned income for a designated period of time in exchange for college funding. Using administrative and survey data for all eligible applicants to a university ISA program, I estimate the adverse selection into the ISA and provide preliminary estimates of the moral hazard for ISA participants. Identification of adverse selection comes from being able to observe the full set of eligible students who apply to the program. There is evidence of selection on the offered income share rate (which is determined by the student’s major) as well as on parent characteristics, though not parent income. Surprisingly, there is no evidence of adverse selection on student ability as measured by SAT score and college grades. I find no differential selection on other student characteristics including demographics and measures of debt aversion, risk aversion, and time preference. Controlling for observable factors, ISA participation increases the likelihood of college graduation by 3 percentage points and decreases starting salary by $5,000 on average.

More →


Kathleen Lynch, Lily An, Zid Mancenido.
We present results from a meta-analysis of 37 contemporary experimental and quasi-experimental studies of summer programs in mathematics for children in Grades pre-K-12, examining what resources and characteristics predict stronger student achievement. Children who participated in summer programs that included mathematics activities experienced significantly better mathematics achievement outcomes, compared to their control group counterparts. We find an average weighted impact estimate of +0.10 standard deviations on mathematics achievement outcomes. We find similar effects for programs conducted in higher- and lower-poverty settings. We undertook a secondary analysis exploring the effect of summer programs on non-cognitive outcomes and found positive mean impacts. The results indicate that summer programs are a promising tool to strengthen children’s mathematical proficiency outside of school time.

More →