Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Christopher Doss, Hans Fricke, Susanna Loeb, Justin B. Doromal.

This study assesses the effects of two text messaging programs for parents that aim to support the development of math skills in prekindergarten students. One program focuses purely on math, while the other takes an identical approach but focuses on a combination of math, literacy, and social-emotional skills. We find no evidence that the math-only program benefits children’s math development. However, the combination program shows greater promise, particularly for girls. Quantile regressions indicate that the effects are concentrated in the lower half of the outcome distribution. We discuss and provide evidence for various hypotheses that could explain these differences.

Highlights:

  • We test the effects of two text messaging curricula that leverage behavioral economics principles to help parents support the math development of prekindergarteners in the home.
  • We find that a program that cycles through literacy, mathematics, and social-emotional skills increases math achievement for girls, while a program focusing solely on mathematics has no effects.
  • Benefits for girls are concentrated on those with weaker performance on mathematics assessments.
  • We posit potential mechanisms based on the literature.

More →


Dan Goldhaber, Cyrus Grout, Kris Holden, Josh B. McGee.

Over the last two decades, twenty-two states have moved away from traditional defined benefit (DB) pension systems and toward pension plan structures like the defined contribution (DC) plans now prevalent in the private sector. Others are considering such a reform as it is seen as a means of limiting future pension funding risk. It is important to understand the implications of such reforms for end-of-career exit patterns and workforce composition. Empirical evidence on the relationship between pension plan structure and retirement timing is currently limited, primarily because, most state pension reforms are so new that few employees enrolled in those alternative plans have reached retirement age. An exception, and the subject of our analysis, is the teacher retirement system in Washington State, which introduced a hybrid DB-DC plan in 1996 and allowed employees in its traditional DB plan to transfer into the new plan. Our analysis focuses on a years-of-service threshold, the crossing of which grants employees early retirement eligibility and, in many cases, a large upward shift in retirement wealth. The financial implications of crossing this threshold are far greater under the state’s traditional DB plan than under the hybrid plan. We find that employees are responsive to crossing the years-of-service threshold, but we fail to find significant evidence that the propensity to exit the workforce varies according to plan enrollment.

More →


Leiah Groom-Thomas, Monica Lee, Cate Smith Todd, Kathleen Lynch, Susanna Loeb, Scott McConnell, Lydia Carlis.

Many preschool agencies nationwide continue to experience closures and/or conversions to virtual or hybrid instruction due to the ongoing COVID-19 pandemic. Despite the importance of understanding young children’s learning and development during the COVID emergency, limited knowledge exists on adaptable practices of assessing young children during the pandemic. We detail practices used to assess learning in 336 Head Start children across four states during three different time periods in the 2020-21 school year, using adaptation of traditionally in-person assessments of early numeracy, early literacy, and executive functioning. In doing so, we distill early lessons for the field from the application of a novel, virtual assessment method with the early childhood population. The paper describes adaptations of assessment administration for virtual implementation and incorporation of feedback into continued virtual delivery of assessments. Applications and limitations in broader contexts are discussed.

More →


Kaitlin P. Anderson.

Black and Latinx students are under-represented in Advanced Placement (AP) and Dual Enrollment (DE), and implicit bias of educators has been discussed as one potential contributing factor. In this study, I test whether implicit and explicit racial bias are related to AP and DE participation and racial/ethnic gaps in participation, controlling for various observable contextual factors. I find a small relationship between implicit racial bias and disparate AP participation for Black students relative to White students, and suggestive evidence of a relationship between explicit racial bias and disparate DE participation for Black students relative to White students. Further, more explicitly-biased communities tend to have lower AP participation rates overall. Implications for school leaders regarding implicit bias training and other ways to address systemic inequities in access are discussed.

More →


Lucas Husted, Isaac M. Opper, R. Jisung Park.

We show that natural disasters affect a region’s aggregate human capital through at least four channels. In addition to causing out-migration, natural disasters reduce student achievement, lower high school graduation rates, and decrease post-secondary attendance. We estimate that disasters that cause at least $500 in per capita property damage reduce the net present value (NPV) of an affected county’s human capital by an average of $505 per person. These negative effects on human capital are not restricted to large disasters: less severe events – disasters with property damages of $100-$500 per capita – also cause significant and persistent reductions in student achievement and post-secondary attendance.

More →


William A. Fischel.

This article reviews the development of my thesis that the California Supreme Court's Serrano decisions, which began in 1971 and sought to disconnect district school spending with local property taxes, led to the fiscal conditions that caused California voters to embrace Proposition 13 in 1978, which radically undermined the local property tax system. I submit that my thesis is most likely true because of Proposition 13’s durability and the absence of alternative explanations that account for its longstanding power over California politics. The article then circles back to John Serrano himself. I want to respectfully suggest that John’s views about the role of public education and my own have more in common than might be suspected. At the very least I want to correct the impression that John supported Proposition 13, which was suggested by the title of my last full article about this topic.

More →


Susha Roy.

In this paper, I study the effect of winning the public school choice lottery on public school enrollment. In particular, I look at how different outside options affect how sensitive students are to receiving their first choice in the public school lottery, focusing on three measures of outside options: ability to afford private schools, geographic convenience of private schools, and zoned-school quality. Using rich administrative data from applications submitted through a centralized enrollment system in Tulsa Public Schools (TPS), I find that overall, students who do not get assigned to their top choice school in a public school choice program are 15 percentage points more likely to leave the public school system entirely than those who do get an offer at their top choice. This effect is driven by higher-income students: these students, who are more likely to be able to afford private schools, are 33 percentage points more likely to leave the public school system if they do not get an offer at the public school they rank first than those who do get a spot. Geographic convenience of private schools and zoned-school quality do not differentially affect students’ enrollment decisions once they receive a school assignment. These effects are important to understand as districts undergo efforts to increase participation in school choice programs, while seeking to maintain district enrollment. They also provide useful insights about how attrition may affect estimates of the impact of choice schools on student outcomes.

More →


Sidrah Baloch, Thomas J. Kane, Ethan Scherer, Douglas O. Staiger.

Educators must balance the needs of students who start the school year behind grade level with their obligation to teach grade-appropriate content to all students. Educational software could help educators strike this balance by targeting content to students’ differing levels of mastery. Using a regression discontinuity design and detailed software log and administrative data, we compare two versions of an online mathematics program used by students in three education agencies. We find that although students assigned the modified curriculum did progress through content objectives more quickly than students assigned the default curriculum, they did not perform better on pre- and post-objective quizzes embedded in the software, and most never progressed far enough to reach the grade-level content. Furthermore, there was no statistically significant effect of the modified curriculum on formative test scores. These findings suggest policymakers and practitioners should exercise caution when assigning exclusively remedial content to students who start the school year behind grade level, even though this is a common feature of many math educational software programs.

More →


Zid Mancenido.

Many teacher education researchers have expressed concerns with the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, external validity, and measurement. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher preparation practices published in peer-reviewed journals between 2002-2019. Although I find that very few studies address issues of internal validity, external validity and measurement, I highlight some innovative approaches and present a checklist of considerations to assist future researchers in designing more rigorous impact evaluations.

More →


Jane Arnold Lincove, Catherine Mata, Kalena E. Cortes.

High school exit exams are meant to standardize the quality of public high schools and to ensure that students graduate with a set of basic skills and knowledge. Evidence suggests that a common perverse effect of exit exams is an increase in dropout for students who have difficulty passing tests, with a larger effect on minority students. To mitigate this, some states offer alternative, non-tested pathways to graduation for students who have failed their exit exams. This study investigates the post-secondary effects of an alternative high school graduation program. Among students who initially fail an exit exam, those who eventually graduate through an alternative project-based pathway have lower college enrollment, but similar employment outcomes to students who graduate by retaking and passing their exit exams. Compared to similar students who fail to complete high school, those students who take the alternative pathway have better post-secondary outcomes in both education and employment.

More →