Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Kevin J. Mumford, Richard W. Patterson, Anthony Yim.

What happens when college students are not able to enroll in the courses they want? We use a natural experiment at Purdue University in which first-year students are conditionally randomly assigned to oversubscribed courses. Compared to students who are assigned a requested course, those who are shut out are 40% less likely to ever take the oversubscribed course and 30% less likely to ever take a course in the same subject. While a course shutout is equally likely to occur to female and male students who requested the course, shutouts are much more disruptive for female students. In the short run, shutouts decrease the credits female students earn as well as their GPA. In the long-run, shutouts increase the probability female students drop out of school in the first year, decrease the probability they choose majors in STEM fields (Science, Technology, Engineering, and Math), decrease cumulative GPA, and decrease the probability of graduating within four years. In contrast, shutouts have no effects on short-run credits earned, dropout, majoring in STEM, cumulative GPA, or four-year graduation for male students. Shutouts do have one large measurable long-run impact on male students---shutouts significantly increase the probability that men choose a major from the business school.

More →


Seth B. Hunter, Katherine M. Bowser.

We extend teacher evaluation research by estimating a reformed evaluation system's plausibly causal average effects on rural student achievement, identifying the settings where evaluation works, and incorporating evaluation expenditures. That the literature omits these contributions is concerning as research implies it hinders evidence-based teacher evaluation policymaking for rural districts, which outnumber urban districts. We apply a difference-in-differences framework to Missouri administrative data. Missouri districts could design and maintain reformed systems or outsource these tasks for a small fee to organizations like the Network for Educator Effectiveness (NEE), an evaluation system created for rural users. NEE does not affect student achievement on average but it improves math, and possibly reading, achievement in rural schools where the average student's prior-year achievement score is below the state average or the average teacher's years of experience are below the state average.

More →


Kelli A. Bird, Benjamin L. Castleman.

Recent work highlights the challenge of scaling evidence-based educational programs. We report on a randomized controlled trial of a financial incentive program designed to increase the efficacy of a national remote college advising initiative for high-achieving students. We find substantial positive effects of the program on student engagement with college advisors; applications to well-matched colleges and universities; and review of financial aid awards. Yet treated students were no more likely to enroll at higher-quality institutions. Student survey responses suggest that institutional admissions and affordability barriers, alongside student preferences to attend institutions closer to home, explain the lack of enrollment effects.

More →


Umut Özek.

Public policies targeting individuals based on need often impose disproportionate burden on communities that lack the resources to implement these policies effectively. In an elementary school setting, I examine whether community-level interventions focusing on similar needs and providing resources to build capacity in these communities could improve outcomes by improving the effectiveness of individual-level interventions. I find that the extended school day policy that targets lowest-performing schools in reading in Florida significantly improved the effectiveness of the third-grade retention policy in these schools. These complementarities were large enough to close the gap in retention effects between targeted and higher-performing schools.

More →


Reuben Hurst, Andrew Simon, Michael Ricks.

To understand the causes and consequences of polarized demand for government expenditure, we conduct three field experiments in the context of public higher education. The first two experiments study polarization in taxpayer demand. We provide information to shape beliefs about social returns on investment. Our treatments narrow the political partisan gap in ideal policies---a reduction in ideological polarization---by up to 32%, with differences in partisan reasoning as a key mechanism. Providing information also affects how people communicate their ideal policies to elected officials, increasing their propensity to write a (positive) letter to an official of the other party---a reduction in affective polarization. In the third experiment, we send these letters to a randomized subset of elected officials to study how policymakers respond to constituent demand. We find that officials who receive their constituents' demands engage more with higher education issues in our correspondences.

More →


Florence Xiaotao Ran, Hojung Lee.

The landscape of developmental education has experienced significant shifts over the last decade nationwide, as more than 20 states and higher education systems have transitioned from the traditional prerequisite model to corequisite remediation. Drawing on administrative data from Tennessee community colleges from 2010 to 2020, this study examined the heterogeneous effects of corequisite reform for remediation-eligible students with varying levels of academic preparation. Using difference-in-differences and event study designs, we found that corequisite remediation significantly improved gateway and subsequent college-level course completion for students in all placement test score groups below the college-level threshold. For math, the positive effects on college-level course completion were stronger for higher-scoring remedial students than for those with lower placement test scores, whereas the pattern was reversed for English. However, since the corequisite reform, students requiring remediation were more likely to drop out of the public college system, and those with the lowest scores were less likely to earn short-term certificates.

More →


Jordan S. Berne, Brian A. Jacob, Tareena Musaddiq, Anna Shapiro, Christina Weiland.

Transitional Kindergarten (TK) is a relatively recent entrant into the U.S. early education landscape, combining features of public pre-K and regular kindergarten. We provide the first estimates of the impact of Michigan’s TK program on 3rd grade test scores. Using an augmented regression discontinuity design, we find that TK improves 3rd grade test scores by 0.29 (math) and 0.19 (English Language Arts) standard deviations relative to a counterfactual that includes other formal and informal early learning options. These impacts are notably large relative to the prior pre-K literature.

More →


Jordan S. Berne, Katia Cordoba Garcia, Brian A. Jacob, Tareena Musaddiq, Samuel Owusu, Anna Shapiro, Christina Weiland.

In recent years, several states have expanded a new publicly funded learning option: Transitional Kindergarten (TK). TK programs bridge prekindergarten and kindergarten in their eligibility, requirements, and design. We use Michigan’s TK program as a case study on the fit of this new entrant in the early learning landscape. Michigan’s program is well suited for this purpose because it contains most of the research-aligned program design elements of other large-scale TK programs across the country. Using statewide administrative data, we describe which districts offer TK when doing so is optional, the characteristics of children who enroll in TK at four and five years old, and substitution patterns between TK and alternative learning options. Broadly, we find TK in Michigan closes some socioeconomic gaps in early program enrollment while exacerbating others. Specifically, districts with larger proportions of White students and smaller proportions of economically disadvantaged students are more likely to offer TK than other districts. Within districts that do not offer TK in every school, TK is targeted to schools with more economically disadvantaged students. Among preschool-age children, those from non-economically disadvantaged families are more likely to enroll in TK than their peers; among kindergarten-age children, there is little difference in take-up by family income. Finally, we find evidence of substitution, with some children enrolling in TK instead of state-funded prekindergarten or instead of enrolling in kindergarten early, though with no evidence that public slots decline overall. Our findings have implications for addressing the fragmented early education landscape when expanding programs.

More →


Alvin Makori, Patricia Burch, Susanna Loeb.

High-impact tutoring has emerged as a primary school district investment for addressing learning loss that occurred during the COVID-19 pandemic. While existing research shows that high-impact tutoring is effective for accelerating student learning, this study examined the school-level facilitators and barriers to scaling high-impact tutoring. Situated in an urban traditional school district and an urban charter management organization, we collected survey and interview data from teachers and administrators to identify scaling challenges. Major barriers to scaling included time and space constraints, tutor supply and quality, updated data systems, and school level costs, while a key facilitator was teacher buy-in. We end the paper with recommendations for how districts can strategically grow their high-impact tutoring efforts.

More →


D'Wayne Bell, John B. Holbein, Samuel Imlay, Jonathan Smith.

We study how colleges shape their students' voting habits by linking millions of SAT takers to their college-enrollment and voting histories. To begin, we show that the fraction of students from a particular college who vote varies systematically by the college's attributes (e.g. increasing with selectivity) but also that seemingly similar colleges can have markedly different voting rates. Next, after controlling for students' college application portfolios and pre-college voting behavior, we find that attending a college with a 10 percentage-point higher voting rate increases entrants' probability of voting by 4 percentage points (10 percent). This effect arises during college, persists after college, and is almost entirely driven by higher voting-rate colleges making new voters. College peers' initial voting propensity plays no discernible role.

More →