Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Program and policy effects

Corey A. DeAngelis.

Access to private schools and public charter schools might improve parent and student satisfaction through competitive pressures and improved matches between educators and students. Using a nationally representative sample of 13,436 students in the United States in 2016, I find that public charter schools and private schools outperform traditional public schools on six measures of parent and student satisfaction. Respondents with children in private schools also tend to report higher levels of satisfaction than respondents with children in public charter schools. The results are robust to various analytic techniques and specifications.

More →


Thomas S. Dee, Emily Penner.

The My Brother’s Keeper (MBK) Challenge developed by President Obama supports communities that promote civic initiatives designed to improve the educational and economic opportunities specifically for young men of color. In Oakland, California, the MBK educational initiative features the African American Male Achievement (AAMA) program. The AAMA focuses on regularly scheduled classes exclusively for Black, male students and taught by Black, male teachers who focus on social-emotional training, African-American history, culturally relevant pedagogy, and academic supports. In this study, we present quasi-experimental evidence on the dropout effects of the AAMA by leveraging its staggered scale-up across high schools in the Oakland Unified School District (OUSD). We find that AAMA availability led to a significant reduction in the number of Black males who dropped out as well as smaller reductions among Black females, particularly in 9th grade.

More →


Matthew Kraft, Alexander Bolves.

We explore the potential for mobile technology to facilitate more frequent and higher-quality teacher-parent communication among a sample of 132 New York City public schools. We provide participating schools with free access to a mobile communication app and randomize schools to receive intensive training and guidance for maximizing the efficacy of the app. User supports led to substantially higher levels of communication within the app in the treatment year, but had few subsequent effects on perceptions of communication quality or student outcomes. Treatment teachers used the app less frequently the following year when they no longer received communication tips and reminders. We analyze internal user data to suggest organizational policies schools might adopt to increase the take-up and impacts of mobile communication technology.

More →


Andrew C. Barr, Chloe Gibbs.

Despite substantial evidence that resources and outcomes are transmitted across generations, there has been limited inquiry into the extent to which anti-poverty programs actually disrupt the cycle of bad outcomes. We explore how the effects of the United States’ largest early childhood program, Head Start, transfer across generations. We leverage the rollout of this federally funded, means-tested preschool program to estimate the effect of early childhood exposure among mothers on their children’s long-term outcomes. We find evidence of intergenerational transmission of effects in the form of increased educational attainment, reduced teen pregnancy, and reduced criminal engagement in the second generation.
 

More →


Simon Burgess, Shenila Rawal, Eric S. Taylor.

This paper reports improvements in teacher job performance, as measured by student test scores, resulting from a program of (zero-) low-stakes peer evaluation. Teachers working at the same school observed and scored each other’s teaching. Students in randomly-assigned treatment schools scored 0.07σ higher on math and English exams (0.09σ lower-bound on TOT). Within each treatment school, teachers were further randomly assigned to roles: observer and observee. Teachers in both roles improved, perhaps slightly more for observers. The typical treatment school completed 2-3 observations per observee teacher. Variation in observations was generated partly by randomly assigning a low and high (2*low) dose of suggested number of observations. Benefits were quite similar across dose conditions. 

More →


Megan Kuhfeld, James Soland, Christine Pitts, Margaret Burchinal.

Students’ level of academic skills at school entry are a strong predictor of later academic success, and focusing on improving these skills during the preschool years has been a priority during the past ten years. Evidence from two prior nationally representative studies indicated that incoming kindergarteners’ math and literacy skills were higher in 2010 than 1998, but no national studies have examined trends since 2010. This study examines academic skills at kindergarten entry from 2010 and 2017 using data from over 2 million kindergarten students. Results indicated kindergarteners in 2017 have slightly lower math and reading skills than in 2010, but that inequalities at school entry by race/ethnicity and school poverty level have decreased during this period.

More →


Drew H. Bailey, Jade M. Jenkins, Daniela Alvarez-Vargas.

The sustaining environments hypothesis refers to the popular idea, stemming from theories in developmental, cognitive, and educational psychology, that the long-term success of early educational interventions is contingent on the quality of the subsequent learning environment. Several studies have investigated whether specific kindergarten classroom and other elementary school factors account for patterns of persistence and fadeout of early educational interventions. These analyses focus on the statistical interaction between an early educational intervention – usually whether the child attended preschool – and several measures of the quality of the subsequent educational environment. The key prediction of the sustaining environments hypothesis is a positive interaction between these two variables. To quantify the strength of the evidence for such effects, we meta-analyze existing studies that have attempted to estimate interactions between preschool and later educational quality in the United States. We then attempt to establish the consistency of the direction and a plausible range of estimates of the interaction between preschool attendance and subsequent educational quality by using a specification curve analysis in a large, nationally representative dataset that has been used in several recent studies of the sustaining environments hypothesis. The meta-analysis yields small positive interaction estimates ranging from approximately .00 to .04, depending on the specification. The specification curve analyses yield interaction estimates of approximately 0. Results suggest that the current mix of methods used to test the sustaining environments hypothesis cannot reliably detect realistically sized effects. Our recommendations are to combine large sample sizes with strong causal identification strategies, and to study combinations of interventions that have a strong probability of showing large main effects.

More →


Hans Fricke, Susanna Loeb, Robert Meyer, Andrew Rice, Libby Pier, Heather Hough.

Recent attempts to measure schools’ influence on students' SEL show differences across schools, but whether these differences measure the true effect of schools is unclear. We examine the stability of school-by-grade effects on students' SEL across two years using a large-scale survey. Correlations among effects in the same grades across different years are positive but lower than those for math and English. Schools in the top or bottom of the effect distribution have more persistent impacts across years than those in the middle. Overall, the results suggest that these school effects measure real contributions to students' SEL. However, their low stability draws into question whether including school value-added measures of self-reported SEL in school performance systems would be beneficial.

More →


Oded Gurantz, Matea Pender, Zachary Mabel, Cassandra Larson, Eric Bettinger.

We examine whether virtual advising – college counseling using technology to communicate remotely – increases postsecondary enrollment in selective colleges. We test this approach using a sample of approximately 16,000 high-achieving, low- and middle-income students identified by the College Board and randomly assigned to receive virtual advising from the College Advising Corps. The offer of virtual advising had no impact on overall college enrollment, but increased enrollment in high graduation rate colleges by 2.7 percentage points (5%), with instrumental variable impacts on treated students of 6.1 percentage points. We also find that non-white students who were randomly assigned to a nonwhite adviser exhibited stronger treatment effects.

More →


Jing Liu, Monica Lee, Seth Gershenson.

We provide novel evidence on the causal impact of student absences in middle and high school on state test scores, course grades, and educational attainment using a rich administrative dataset that includes the date and class period of each absence. Our identification strategy addresses potential endogeneity due to time-varying student-level shocks by exploiting the fact that in a given year, there exists within-student, between-class variation in absences. We also leverage information on the timing of absences to show that absences that occur after the annual window for state standardized testing do not appear to affect test scores, which provides a further check of our identification strategy. We find that absences in middle and high school harm contemporaneous student achievement and longer-term educational attainment: On average, missing 10 math classes reduces math test scores by 7% of a standard deviation, math course grades by 19% of a standard deviation, the probability of on-time graduation by 8%, and the probability of immediate college enrollment by 7%. Similar results hold for absences in English Language Arts classes. These results suggest that absences in middle school and high school are just as harmful, if not more so, than absences in elementary school. Moreover, the timing of absences during the school year matters, as both the occurrence and the impact of absences are dynamic phenomena.

More →