Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Multiple outcomes of education

Carly D. Robinson, Biraj Bisht, Susanna Loeb.

Billions of dollars are invested in opt-in, educational resources to accelerate students’ learning. Although advertised to support struggling, marginalized students, there is no guarantee these students will opt in. We report results from a school system’s implementation of on-demand tutoring. The take up was low. At baseline, only 19% of students ever accessed the platform, and struggling students were far less likely to opt in than their more engaged and higher achieving peers. We conducted a randomized controlled trial (N=4,763) testing behaviorally-informed approaches to increase take-up. Communications to parents and students together increase the likelihood students access tutoring by 46%, which led to a four-percentage point decrease in course failures. Nonetheless, take-up remained low, showing concerns that opt-in resources can increase—instead of reduce—inequality are valid. Without targeted investments, opt-in educational resources are unlikely to reach many students who could benefit.

More →


Sara White, Leiah Groom-Thomas, Susanna Loeb.

This study synthesizes existing research on the implementation of tutoring programs which we define as one-to-one or small-group instruction in which a human tutor supports students grades K-12 in an academic subject area. Tutoring has emerged as an especially promising strategy for supporting students’ academic success with strong causal evidence finding large, positive effects on students' math and reading test scores across grade levels. Prior studies have reviewed this causal evidence of effects, but none have summarized the evidence on implementation. We iteratively developed search and selection criteria to identify studies addressing key research questions and synthesized these 40 studies which employ a range of research methodologies to describe how tutoring is implemented and experienced. We find that existing research provides rich descriptions of tutoring implementation within specific programs of focus, with most studies describing after-school tutoring and small-scale programs run by university professors. While few elements of implementation are studied in depth across multiple studies, common patterns emerge. Tutoring program launch is often facilitated by strategic relationships between schools and external tutoring providers and strengthened by transparent assessments of program quality and effectiveness. Successful tutoring implementation often hinges on the support of key school leaders with the power to direct the use of school funding, space, and time. Tutoring setting and schedule, tutor recruitment and training, and curriculum identification influence whether students are able to access tutoring services and the quality of the instruction provided. Ultimately, the evidence points to strong tutoring being driven by positive student-tutor relationships through which tutors provide instruction strategically targeted for students’ strengths and needs driving towards a long-term academic goal.

More →


Kai Hong, Syeda Sana Fatima, Sherry Glied, Leanna Stiefel, Amy Ellen Schwartz.

There is increasing concern about risky behaviors and poor mental health among school-aged youth. A critical factor in youth well-being is school attendance. This study evaluates how school organization and structure affect health outcomes by examining the impacts of a popular urban high school reform -- “small schools” -- on youth risky behaviors and mental health, using data from New York City. To estimate a causal estimate of attending small versus large high schools, we use a two-sample-instrumental-variable approach with the distance between student residence and school as the instrument for school enrollment. We consider two types of small schools – “old small schools,” which opened prior to a system-wide 2003 reform aimed at increasing educational achievement and “new small schools,” which opened in the wake of that reform. We find that girls enrolled in older small schools are less likely to become pregnant, and boys are less likely to be diagnosed with mental health disorders than their counterparts in large schools. Both girls and boys enrolled in more recently opened small schools, however, are more likely to be diagnosed with violence-associated injuries and (for girls only) with mental health disorders. These disparate results suggest that improving a school’s organization and inputs together is likely more effective in addressing youth risky behaviors than simply reducing school size.

More →


Benjamin W. Arold.

Anti-scientific attitudes can impose substantial costs on societies. Can schools be an important agent in mitigating the propagation of such attitudes? This paper investigates the effect of the content of science education on anti-scientific attitudes, knowledge, and choices. The analysis exploits staggered reforms that reduce or expand the coverage of evolution theory in US state science education standards. I compare adjacent cohorts in models with state and cohort fixed effects and conduct fine-grained placebo tests to rule out scientific, religious and political confounders. There are three main results. First, expanded evolution coverage increases students’ knowledge about evolution. Second, the reforms translate into greater evolution belief in adulthood, but do not crowd out religiosity or affect political attitudes. Third, the reforms affect high-stakes life decisions, namely the probability of working in life sciences.

More →


Lindsey Rose Bullinger, Maithreyi Gopalan, Caitlin Lombardi.
Publicly funded adult health insurance through the Affordable Care Act (ACA) has had positive effects on low-income adults. We examine whether the ACA’s Medicaid expansions influenced child development and family functioning in low-income households. We use a difference-in-differences framework that exploits cross-state policy variation and focus on children in low-income families from a nationally representative, longitudinal sample followed from kindergarten to fifth grade. The ACA Medicaid expansions improved children’s reading test scores by approximately 2 percent (0.04 SD). Potential mechanisms for these effects within families are more time spent reading at home, less parental help with homework, and eating dinner together. We find no effects for children’s math test scores or socioemotional skill development.

More →


C. Kirabo Jackson, Sebastian Kiguel, Shanette C. Porter, John Q. Easton.

We estimate the longer-run effects of attending an effective high school (one that improves a combination of test scores, survey measures of socio-emotional development, and behaviors in 9th grade) for students who are more versus less educationally advantaged (i.e., likely to attain more years of education based on 8th-grade characteristics). All students benefit from attending effective schools, but the least advantaged students experience larger improvements in high-school graduation, college going, and school-based arrests. This heterogeneity is not solely due to less-advantaged groups being marginal for particular outcomes. Commonly used test-score value-added understates the long-run importance of effective schools, particularly for less-advantaged populations. Patterns suggest this partly reflects less-advantaged students being relatively more responsive to non-test-score dimensions of school quality.

More →


D'Wayne Bell, Jing Feng, John Holbein, Jonathan Smith.

For decades, pundits, politicians, college administrators, and academics have lamented the dismal rates of civic engagement among students who enroll in courses and eventually major in science, technology, engineering, and mathematics (i.e., STEM) fields. However, the research supporting this conclusion has faced distinct challenges in terms of data quality. Does STEM actually decrease the odds that young people will be actively involved in democracy? This paper assesses the relationship between studying STEM and voting.  To do so, we create a dataset of over 23 million students in the U.S. matched to national validated voting records.  The novel dataset is the largest known individual-level dataset in the U.S. connecting high school and college students to voting outcomes.  It also contains a rich set of demographic and academic variables, to account for many of the common issues related to students' selection into STEM coursework. We consider two measures of STEM participation ---Advanced Placement (AP) Exam taking in high school and college major. Using both measures, we find that, unconditionally, STEM students are slightly more likely to vote than their non-STEM peers.  After including the rich set of controls, the sign reverses and STEM students are slightly less likely to vote than their non-STEM peers. However, these estimated relationships between STEM and voting are small in magnitude---about the same effect size as a single get-out-the-vote mailer---and we can rule out even very modest causal effects of marginally more STEM coursework on voting for the typical STEM student.  We cannot rule out modest effects for a few subfields. Our analyses demonstrate that, on average, marginally more STEM coursework in high school and college does not contribute to the dismally low participation rates among young people in the U.S.

More →


Jordan S. Berne.

Nearly all studies of preschool’s long-run effects examine means-tested programs; little is known about the long-run effects of universal programs. A number of key differences—including population served, scale, and counterfactual options—may cause universal programs to have different effects than previously studied means-tested programs. Using a difference-in-differences framework, I estimate the effects of Georgia’s first-in-the-nation statewide universal pre-K program on adult educational attainment and employment. The program made children 4.5 percent more likely to graduate from high school and 13.7 percent more likely to obtain a bachelor’s degree (although the latter effect is imprecise). I find similar results in a supplemental analysis that uses the synthetic control method. I find no effects on associate degree attainment or employment.

More →


Lucy C. Sorensen, Montserrat Avila Acosta, John Engberg, Shawn D. Bushway.
U.S. public school students increasingly attend schools with sworn law enforcement officers present. Yet, little is known about how these school resource officers (SROs) affect school environments or student outcomes. Our study uses a fuzzy regression discontinuity (RD) design with national school-level data from 2014 to 2018 to estimate the impacts of SRO placement. We construct this discontinuity based on the application scores for federal school based policing grants of linked police agencies. We find that SROs effectively reduce some forms of violence in schools, but do not prevent gun-related incidents. We also find that SROs intensify the use of suspension, expulsion, police referral, and arrest of students. These increases in disciplinary and police actions are consistently largest for Black students, male students, and students with disabilities.

More →


Serena Canaan, Stefanie Fischer, Pierre Mouganie, Geoffrey C. Schnorr.

To boost college graduation rates, policymakers often advocate for academic supports such as coaching or mentoring. Proactive and intensive coaching interventions are effective, but are costly and difficult to scale. We evaluate a relatively lower-cost group coaching program targeted at first-year college students placed on academic probation. Participants attend a workshop where coaches aim to normalize failure and improve self-confidence. Coaches also facilitate a process whereby participants reflect on their academic difficulties, devise solutions to address their challenges, and create an action plan. Participants then hold a one-time follow-up meeting with their coach or visit a campus resource. Using a difference-in-discontinuity design, we show that the program raises students’ first-year GPA by 14.6% of a standard deviation, and decreases the probability of first-year dropout by 8.5 percentage points. Effects are concentrated among lower-income students who also experience a significant increase in the probability of graduating. Finally, using administrative data we provide the first evidence that coaching/mentoring may have substantial long-run effects as we document significant gains in lower-income students’ earnings 7–9 years following entry to the university. Our findings indicate that targeted, group coaching can be an effective way to improve marginal students’ academic and early career outcomes.

More →