Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Education outside of school (after school, summer…)

Douglas N. Harris, Lihan Liu, Daniel Oliver, Cathy Balfe, Sara Slaughter, Nicholas Mattei.

COVID-19 has forced essentially all schools in the country to close their doors to inperson activities. In this study, we provide new evidence about variation in school responses across school types. We focus on five main constructs of school activity during COVID-19: personalization and engagement in instruction, personalization and engagement in other school communication with students, progress monitoring (especially assignment grading), breadth of services (e.g., counseling and meals), and equitable access (to technology and services for students with special needs). We find that the strongest predictor of the extent of school activities was the education level of parents and other adults in schools’ neighborhoods. Internet access also predicts school responses. Race, parent/adult income, and school spending do not predict school responses. Private schools shifted to remote learning several days faster than traditional public schools, though others eventually caught up. On some measures, charter schools exceeded the responses of other schools; in other cases, traditional public schools had the highest overall measures. States in the Midwest responded more aggressively than those in other regions, especially the South, even after controlling for the full set of additional covariates. Learning management systems were reported by a large majority of schools, followed by video communication tools and tutorial/assessment programs. Several methods are proposed and implemented to address differential website use. We discuss potential implications of these findings for policy and effects on student outcomes.

More →


Carycruz Bueno.

The COVID-19 pandemic has put virtual schooling at the forefront of policy concerns, as millions of children worldwide shift to virtual schooling with hopes of “slowing the spread”. Given the emergency shift to online education coupled with the large increase in demand for virtual education over the last decade it is imperative to explore the impacts of virtual education on student outcomes. This paper estimates the causal effect of full-time virtual school attendance on student outcomes with important implications for school choice, online education, and education policy. Despite the increasing demand for K-12 virtual schools over the past decade little is known about the impact of full-time virtual schools on students’ cognitive and behavioral outcomes. The existing evidence on the impact of online education on students’ outcomes is mixed. I use a longitudinal data set composed of individual-level information on all public-school students and teachers throughout Georgia from 2007 to 2016 to investigate how attending virtual schools influences student outcomes. I implement a variety of econometric specifications to account for the issue of potential self-selection into full-time virtual schools. I find that attending a virtual school leads to a reduction of 0.1 to 0.4 standard deviations in English Language Arts, Mathematics, Science, and Social Studies achievement test scores for students in elementary and middle school. I also find that ever attending a virtual school is associated with a 10-percentage point reduction in the probability of ever graduating from high school. This is early evidence that full-time virtual schools as a type of school choice could be harmful to students’ learning and future economic opportunities, as well as a sub-optimal use of taxpayer money.

More →


Allison Atteberry, Andrew McEachin.

Summer learning loss (SLL) is a familiar and much-studied phenomenon, yet new concerns that measurement artifacts distorted canonical SLL findings create a need to revisit basic research on SLL. Though race/ethnicity and SES only account for about 4% of the variance in SLL, nearly all prior work focuses on these factors. We zoom out to the full spread of differential SLL and its contribution to students’ positions in the eighth grade achievement distribution. Using a large, longitudinal Northwest Evaluation Association dataset, we document dramatic variability in SLL. While some students actually maintain their school-year learning rate, others lose nearly all their school-year progress. Moreover, decrements are not randomly distributed—52% of students lose ground in all 5 consecutive years (ELA).

More →


Megan Kuhfeld, James Soland, Beth Tarasawa, Angela Johnson, Erik Ruzek, Jing Liu.

With 55 million students in the United States out of school due to the COVID-19 pandemic, education systems are scrambling to meet the needs of schools and families, including planning how best to approach instruction in the fall given students may be farther behind than in a typical year. Yet, education leaders have little data on how much learning has been impacted by school closures. While the COVID-19 learning interruptions are unprecedented in modern times, existing research on the impacts of missing school (due to absenteeism, regular summer breaks, and school closures) on learning can nonetheless inform projections of potential learning loss due to the pandemic. In this study, we produce a series of projections of COVID-19-related learning loss and its potential effect on test scores in the 2020-21 school year based on (a) estimates from prior literature and (b) analyses of typical summer learning patterns of five million students. Under these projections, students are likely to return in fall 2020 with approximately 63-68% of the learning gains in reading relative to a typical school year and with 37-50% of the learning gains in math. However, we estimate that losing ground during the COVID-19 school closures would not be universal, with the top third of students potentially making gains in reading. Thus, in preparing for fall 2020, educators will likely need to consider ways to support students who are academically behind and further differentiate instruction.

 

More →


Megan Kuhfeld, James Soland.

Important educational policy decisions, like whether to shorten or extend the school year, often require accurate estimates of how much students learn during the year.  Yet, related research relies on a mostly untested assumption: that growth in achievement is linear throughout the entire school year.  We examine this assumption using a data set containing math and reading test scores for over seven million students in kindergarten through 8th grade across the fall, winter, and spring of the 2016-17 school year. Our results indicate that assuming linear within-year growth is often not justified, particularly in reading. Implications for investments in extending the school year, summer learning loss, and racial/ethnic achievement gaps are discussed.

More →


Paul T. von Hippel.

Year-round school calendars take the usual 175-180 instruction days of the school year and redistribute them, replacing the usual schedule – nine months on, three months off – with a more “balanced” schedule of short instruction periods alternating with shorter breaks across all four seasons of the year. Over the past three decades, the number of schools using year-round calendars has increased ninefold, from 410 in 1985 to 3,700 in 2011-12 (Skinner, 2014). Over 2 million children now attend year-round schools – as many as attend charter schools – yet year-round schools have attracted relatively little attention from researchers and the public.

In this chapter, I review the evidence for the effects of year-round calendars on test scores. Once thought to be positive, these effects now appear to be neutral at best. Although year-round calendars do increase summer learning, they reduce learning at other times of year, so that the total amount learned over a 12-month period is no greater under a year-round calendar than under a nine-month calendar. I also review evidence that year-round calendars make it harder to recruit and retain experienced teachers, make it harder for mothers to work outside the home, and reduce property values. When students' schedules are staggered, year-round calendars do offer a way to reduce school crowding – an alternative to busing or portable classrooms, and a low-cost alternative to new school construction.

More →


Beth Schueler, Daniel Rodriguez-Segura.

Access to quality secondary schooling can be life-changing for students in developing contexts. In Kenya, entrance to such schools has historically been determined by performance on a high-stakes exam. Understandably then, preparation for this exam is a high priority for Kenyan families and educators. To increase the share of students gaining entry to these schools, some educational providers offer targeted instruction for students they believe have a chance of securing a spot. We experimentally evaluate the impact of these “symposia” programs—week-long, sleep-away camps where eighth grade students receive a burst of academic instruction from teachers selected based on merit. While similar models have been tested in the U.S., less is known about this intervention in developing settings. Our results suggest these programs are not particularly effective for the average nominated student relative to a typical week of school. However, we find large, positive effects among students attending schools from which few students are nominated for symposia. We provide suggestive evidence that this was because students from low- representation schools had less pre-camp practice test resources outside of school. The results have implications for program design and contribute to the growing literature on the effectiveness of appropriately targeted individualized instruction.

More →


Michael Gilraine, Uros Petronijevic, John D. Singleton.

While school choice may enhance competition, incentives for public schools to raise productivity may be muted if public education is viewed as imperfectly substitutable with alternatives. This paper estimates the aggregate effect of charter school expansion on education quality while accounting for the horizontal differentiation of charter school programs. To do so, we combine student-level administrative data with novel information about the educational programs of charter schools that opened in North Carolina following the removal of the statewide cap in 2011. The dataset contains students' standardized test scores as well as geocoded residential addresses, which allow us to compare the test score changes of students who lived near the new charters prior to the policy change with those for students who lived farther away. We apply this research design to estimate separate treatment effects for exposure to charter schools that are and are not differentiated horizontally from public school instruction. The results indicate learning gains for treated students that are driven entirely by non-horizontally differentiated charter schools: we find that non-horizontally differentiated charter school expansion causes a 0.05 SD increase in math scores. These learning gains are driven by public schools responding to increased competition.

More →


Alex Eble, Chris Frost, Alpha Camara, Baboucarr Bouy, Momodou Bah, Maitri Sivaraman, Jenny Hsieh, Chitra Jayanty, Tony Brady, Piotr Gawron, Peter Boone, Diana Elbourne.

Despite large schooling and learning gains in many developing countries, children in highly deprived areas are often unlikely to achieve even basic literacy and numeracy. We study how much of this problem can be resolved using a multi-pronged intervention combining several distinct interventions known to be effective in isolation. We conducted a cluster-randomized trial in The Gambia evaluating a literacy and numeracy intervention designed for primary-aged children in remote parts of poor countries. The intervention combines para teachers delivering after-school supplementary classes, scripted lesson plans, and frequent monitoring focusing on improving teacher practice (coaching). A similar intervention previously demonstrated large learning gains in a cluster-randomized trial in rural India. After three academic years, Gambian children receiving the intervention scored 46 percentage points (3.2 SD) better on a combined literacy and numeracy test than control children.  This intervention holds great promise to address low learning levels in other poor, remote settings.

More →


Di Xu, Qing Zhang, Xuehan Zhou.

This paper presents new experimental estimates of the impact of low-ability peers on own outcomes using nationally representative data from China. We exploit the random assignment of students to junior high school classrooms and find that the proportion of low-ability peers, defined as having been retained during primary school (“repeaters”), has negative effects on non-repeaters’ cognitive and non-cognitive outcomes. An exploration of the mechanisms shows that a larger proportion of repeater peers is associated with reduced after-school study time. The negative effects are driven by male repeaters and are more pronounced among students with less strict parental monitoring at home.

More →