Search for EdWorkingPapers here by author, title, or keywords.
We examine the effect of air pollution from power production on students' cognitive outcomes by leveraging year-to-year production variation, wind patterns, and plant closures. We find that every one million megawatt hours of coal-fired power production decreases student performance in schools within ten kilometers by 0.02 standard deviations. Gas-fired plants exhibit no such relationship. Extrapolating our results nationwide indicates that the decline in coal use over the last decade raises test scores by 0.008 standard deviations and reduces the black-white test score gap by 0.006 standard deviations. The nationwide effect obscures substantial spatial variation: The respective numbers for the Midwest are 0.016 and 0.023.
The public narrative surrounding efforts to improve low-performing K-12 schools in the U.S. has been notably gloomy. Observers argue that either nothing works or we don’t know what works. At the same time, the federal government is asking localities to implement evidence-based interventions. But what is known empirically about whether school improvement works, how long it takes, which policies are most effective, and which contexts respond best to intervention? We meta-analyze 141 estimates from 67 studies of turnaround policies implemented post-NCLB. On average, these policies have had a moderate positive effect on math but no effect on ELA achievement as measured by high-stakes exams. We find evidence of positive impacts on low-stakes exams in STEM and humanities subjects and no evidence of harm on non-test outcomes. Some elements of reform, namely extended learning time and teacher replacements, predict greater effects. Contexts serving majority-Latinx populations have seen the largest improvements.
Many states mandate districts or schools notify parents when students have missed multiple unexcused days of school. We report a randomized experiment (N = 131,312) evaluating the impact of sending parents truancy notifications modified to target behavioral barriers that can hinder effective parental engagement. Modified truancy notifications that used simplified language, emphasized parental efficacy, and highlighted the negative incremental effects of missing school reduced absences by 0.07 days compared to the standard, legalistic, and punitively-worded notification—an estimated 40% improvement over the standard truancy notification. This work illustrates how behavioral insights and randomized experiments can be used to improve administrative communications in education.
Our goal in this paper, presented at the 2020 Brookings Municipal Finance Conference, is to better understand teacher pension funding dynamics with a focus on sustainability and intergenerational equity. The origin of this paper is our analysis of the funding policy recommended in a highly publicized paper first presented at the 2019 Brookings Municipal Finance Conference (Lenney, Lutz, and Sheiner, 2019a; 2019b). That proposed policy aims to alleviate rising pension payments that crowd-out classroom expenditures and teacher salaries by abandoning the attempt to pay down pension debt. While the problem of crowd-out is real, we show that, with uncertain investment returns, the recommended policy would carry significant risk of pension fund insolvency and a jump in contributions to the pay-go rate, which is much higher than current rates. We close by proposing a policy evaluation framework that better incorporates risk and the intertemporal tradeoffs between current contributions and likely future outcomes. We illustrate throughout with data from the California Teachers Retirement System (CalSTRS).
Teacher evaluation policies seek to improve student outcomes by increasing the effort and skill levels of current and future teachers. Current policy and most prior research treats teacher evaluation as balancing two aims: accountability and skill development. Proper teacher evaluation design has been understood as successfully weighting the accountability and professional growth dimensions of policy and practice. I develop a model of teacher effectiveness that incorporates improvement from evaluation and detail conditions which determine the effectiveness of teacher evaluation for growth and accountability at improving student outcomes. Drawing on empirical evidence from the personnel economics, economics of education and measurement literatures, I simulate the long-term effects of a set of teacher evaluation policies. I find that those that treat evaluation for accountability and evaluation for growth as substitutes outperform policies that treat them as complements. I conclude that optimal teacher evaluation policies would impose accountability on teachers performing below a defined level and above which teachers would be subject to no accountability pressure but would receive intensive instructional supports.
A common rationale for offering online courses in K-12 schools is that they allow students to take courses not offered at their schools; however, there has been little research on how online courses are used to expand curricular options when operating at scale. We assess the extent to which students and schools use online courses for this purpose by analyzing statewide, student-course level data from high school students in Florida, which has the largest virtual sector in the nation. We introduce a “novel course” framework to address this question. We define a virtual course as “novel” if it is only available to a student virtually, not face-to-face through their own home high school. We find that 7% of high school students in 2013-14 enroll in novel online courses. Novel courses were more commonly used by higher-achieving students, in rural schools, and in schools with relatively few Advanced Placement/International Baccalaureate offerings.
Tutoring—defined here as one-on-one or small-group instructional programming by teachers, paraprofessionals, volunteers, or parents—is one of the most versatile and potentially transformative educational tools in use today. Within the past decade, dozens of preK-12 tutoring experiments have been conducted, varying widely in their approach, context, and cost. Our study represents the first systematic review and meta-analysis of these and earlier studies. We develop a framework for considering different types of programs to not only examine overall effects, but also explore how these effects vary by program characteristics and intervention context. We find that tutoring programs yield consistent and substantial positive impacts on learning outcomes, with an overall pooled effect size estimate of 0.37 SD. Effects are stronger, on average, for teacher and paraprofessional tutoring programs than for nonprofessional and parent tutoring. Effects also tend to be strongest among the earlier grades. While overall effects for reading and math interventions are similar, reading tutoring tends to yield higher effect sizes in earlier grades, while math tutoring tends to yield higher effect sizes in later grades. Tutoring programs conducted during school tend to have larger impacts than those conducted after school.
Younger siblings take more advanced high school course end of year exams when their older siblings perform better in those same exams. Using a regression discontinuity and data from millions of siblings who take Advanced Placement (AP) exams, we show that younger siblings with older siblings who marginally “pass” an AP exam are more likely to take at least one AP exam, increase the total number of AP exams, and are more likely to take the same exam as their sibling. The largest impacts are found among sisters, but we do not see differential effects in coursework where females are underrepresented.
We study personnel flexibility in charter schools by exploring how teacher retention varies with teacher and school quality in Massachusetts. Charters are more likely to lose their highest and lowest value-added teachers. Low performers tend to exit public education, while high performers tend to switch to traditional public schools. To rationalize these findings, we propose a model in which educators with high fixed-costs use charter schools to explore teaching careers before obtaining licenses required for higher paying public sector jobs. The model suggests charter schools create positive externalities for traditional public schools by increasing the average quality of available teachers.