Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Benjamin L. Castleman, Francis X. Murphy, Richard W. Patterson, William L. Skimmyhorn.

The Post-9/11 GI Bill allows service members to transfer generous education benefits to a dependent. We run a large scale experiment that encourages service members to consider the transfer option among a population that includes individuals for whom the transfer benefits are clear and individuals for whom the net-benefits are significantly more ambiguous. We find no impact of a one-time email about benefits transfer among service members for whom we predict considerable ambiguity in the action, but sizeable impacts among service members for whom education benefits transfer is far less ambiguous. Our work contributes to the nascent literature investigating conditions when low-touch nudges at scale may be effective. JEL Classification: D15, D91, H52, I24

More →


Matthew A. Kraft, Alexander Bolves.

We study the adoption and implementation of a new mobile communication app among a sample of 132 New York City public schools. The app provides a platform for sharing general announcements and news as well as engaging in personalized two-way communication with individual parents. We provide participating schools with free access to the app and randomize schools to receive intensive support (training, guidance, monitoring, and encouragement) for maximizing the efficacy of the app. Although user supports led to higher levels of communication within the app in the treatment year, overall usage remained low and declined in the following year when treatment schools no longer received intensive supports. We find few subsequent effects on perceptions of communication quality or student outcomes. We leverage rich internal user data to explore how take-up and usage patterns varied across staff and school characteristics. These analyses help to identify early adopters and reluctant users, revealing both opportunities and obstacles to engaging parents through new communication technology.

More →


Philip Oreopoulos.

This article takes stock of where the field of behavioral science applied to education policy seems to be at, which avenues seem promising and which ones seem like dead ends. I present a curated set of studies rather than an exhaustive literature review, categorizing interventions by whether they nudge (keep options intact) or “shove” (restrict choice), and whether they apply a high or low touch (whether they use face-to-face interaction or not). Many recent attempts to test large-scale low touch nudges find precisely estimated null effects, suggesting we should not expect letters, text messages, and online exercises to serve as panaceas for addressing education policy’s key challenges.  Programs that impose more choice-limiting structure to a youth’s routine, like mandated tutoring, or programs that nudge parents, appear more promising.

More →


Mingyu Chen, Jessica Howell, Jonathan Smith.
Recent immigration policies have created massive uncertainty for international students to obtain F-1 visas. Yet, before the COVID-19 pandemic, student visa applicants already faced an approximately 27 percent refusal rate that varies by time and region. Using data on the universe of SAT takers between 2004 and 2015 matched with college enrollment records, we examine how the anticipated F-1 visa restrictiveness influences US undergraduate enrollment outcomes of international students. Using an instrumental variables approach, we find that a higher anticipated F-1 student visa refusal rate decreases the number of international SAT takers, decreases the probability of sending SAT scores to US colleges, and decreases international student enrollment in the US. The decreases are larger among international students with higher measured academic achievement. We also document academic achievement of international students and show that over 40 percent of high-scoring international SAT takers do not pursue US college education.

More →


Robert Gonzalez, Sarah Komisarow.

In this paper we study the impact on student absenteeism of a large school-based community crime monitoring program that employed local community members to monitor and report crime on designated city blocks during students’ travel to and from school. We find that the program resulted in a 0.78 percentage point reduction in the school-level absence rate (11 percent effect). We explore two potential channels to explain this: we find improvements “outside of the school walls” in the form of reduced crime near treated schools and “inside of the school walls” in the form of reduced incidents of serious student misconduct.

More →


Sarah Komisarow.

StudentU is a comprehensive program that provides education, nutrition, and social support services to disadvantaged students outside of the regular school day. In this paper I investigate the effects of this multi-year program on the early high school outcomes of participating students by exploiting data from oversubscribed admissions lotteries. I estimate that lottery winners who entered the comprehensive program with low baseline achievement earned more course credits (0.82 credits), achieved higher grade point averages (0.37 grade points), and were less likely to be suspended (17.1 percentage points) during ninth grade than their lottery loser counterparts. Investigation of candidate channels indicates that increased student effort and improved behavior in school are likely mechanisms. Using an index of early high school outcomes, I predict that lottery winners are around 4 percentage points more likely to graduate from high school than lottery losers (5 percent effect). These results suggest that comprehensive services delivered outside of the regular school day have the potential to improve the educational outcomes of disadvantaged students.

More →


Blake Heller, Kirsten Slungaard Mumma.

While current debates center on whether and how to admit immigrants to the United States, little attention has been paid to interventions designed to help immigrants integrate after they arrive. Public adult education programs are the primary policy lever for building the language skills of the over 23 million adults with limited English proficiency in the United States. We leverage the enrollment lottery of a publicly-funded adult English for Speakers of Other Languages (ESOL) program in Massachusetts to estimate the effects of English language training on voting behavior and employer-reported earnings. Attending ESOL classes more than doubles rates of voter registration and increases annual earnings by $2,400 (56%). We estimate that increased tax revenue from earnings gains fully pay for program costs over time, generating a 6% annual return for taxpayers. Our results demonstrate the social value of post-migration investments in the human capital of adult immigrants.

More →


Elise Swanson, Joseph Kitchen, Tatiana Melguizo, Francisco Martorell.

We examine the impact of the Thompson Scholars Learning Community (TSLC), a comprehensive college transition program serving students with a variety of majors, on students’ science, technology, engineering, and math (STEM)-related outcomes. We use an explanatory mixed-methods design, which prioritizes the quantitative analyses and uses qualitative analyses to contextualize and explain our quantitative findings. Overall, participating in TSLC does not make students more likely to declare a STEM major, although we do find a positive effect for students of color. TSLC students earn higher overall GPAs than their scholarship-only peers, and TSLC students majoring in STEM outperform scholarship-only STEM majors in STEM courses. Qualitative analyses suggest these results stem from the student-centered and proactive support the program provides students. Our results suggest that a disciplinarily-agnostic program can support student success in STEM, and may increase equitable representation in STEM fields.

More →


Elise Swanson, Tatiana Melguizo, Francisco Martorell.

This paper estimates the relationship between students’ psychosocial and academic outcomes during their first three years enrolled at public, four-year institutions. Our sample is comprised of students from low-income backgrounds who applied for a competitive scholarship and enrolled at a four-year public institution. We follow two cohorts of entering students throughout their first three years on campus. We observe their cumulative GPA and persistence decisions each semester, and have annual measures of four psychosocial outcomes: mattering to campus, sense of belonging to campus, academic self-efficacy, and social self-efficacy. We find that psychosocial outcomes are moderately predictive of academic outcomes, with sense of belonging and academic self-efficacy emerging as most predictive of both cumulative GPA and persistence.

More →


Plamen Nikolov, Nusrat Jimi.

Evidence on educational returns and the factors that determine the demand for schooling in developing countries is extremely scarce. We use two surveys from Tanzania to estimate both the actual and perceived schooling returns and subsequently examine what factors drive individual misperceptions regarding actual returns. Using ordinary least squares and instrumental variable methods, we find that each additional year of schooling in Tanzania increases earnings, on average, by 9 to 11 percent. We find that on average, individuals underestimate returns to schooling by 74 to 79 percent, and three factors are associated with these misperceptions: income, asset poverty, and educational attainment. Shedding light on what factors relate to individual beliefs about educational returns can inform policy on how to structure effective interventions to correct individuals' misperceptions.

More →