Search EdWorkingPapers
Search EdWorkingPapers by author, title, or keywords.
Search
EdWorkingPapers
Longitudinal studies can produce biased estimates of learning if children miss tests. In an application to summer learning, we illustrate how missing test scores can create an illusion of large summer learning gaps when true gaps are close to zero. We demonstrate two methods that reduce bias by exploiting the correlations between missing and observed scores on tests taken by the same child at different times. One method, multiple imputation, uses those correlations to fill in missing scores with plausible imputed scores. The other method models the correlations implicitly, using child-level random effects. Widespread adoption of these methods would improve the validity of summer learning studies and other longitudinal research in education.
Criminal activity is seasonal, peaking in the summer and declining through the winter. We provide the first evidence that arrests of children and reported crimes involving children follow a different pattern: peaking during the school year and declining in the summer. We use a regression discontinuity design surrounding the exact start and end dates of the school year to show that this pattern is caused by school: children aged 10-17 are roughly 50% more likely to be involved in a reported crime during the beginning of the school year relative to the weeks before school begins. This sharp increase is driven by student-on-student crimes occurring in school and during school hours. We use the timing of these patterns and a seasonal adjustment to argue that school increases reported crime rates (and arrests) involving 10-17-year-old offenders by 47% (41%) annually relative to a counterfactual where crime rates follow typical seasonal patterns. School exacerbates preexisting sex-based and race-based inequality in reported crime and arrest rates, increasing both the Black-white and male-female gap in reported juvenile crime and arrest rates by more than 40%.
During the pandemic, a number of states instituted hold-harmless funding policies to protect school district financially from declining enrollments (Center for Public Education, 2021). In addition, some school choice policies have protected traditional public schools financially from declining enrollments. Together, these policies raise the question of whether competitive effects can exist in a policy environment of reduced financial pressure. Theoretically, despite the lack of financial pressure, schools could feel competitive pressure in other ways including a loss of reputation as students move to schools of choice (Epple, Romono, & Urquiola, 2017; Friedman, 1962; MacLeod & Urquiola, 2009; Urquiola, 2016). To provide insights on whether schools can improve without the threat of financial loss, we examine the Seoul school choice program which introduced autonomous private high schools (APHSs) in the context in which there is equalized funding across schools. More specifically, we examine whether competition induced by APHSs affects the achievement of students attending traditional public and private schools. The effect of APHSs is identified by exploiting plausible exogenous APHSs’ entry through the random assignment of students. We find a small and positive effect of APHS penetration on the Korean and English achievement of private school students while finding no effects for traditional public schools, which have limited ability to respond.
The Every Student Succeeds Act (ESSA) began a new wave of school accountability under which states draw on multiple measures to assess school quality. States have options in terms of how to weight components in their school quality indices and how many years of data to use to determine school ratings. In this study, we simulate school ratings using eight years of administrative data in North Carolina to demonstrate how state decisions about school ratings and identification influence school ratings and the list of schools identified for improvement. We then evaluate these decisions against a framework that considers the validity, stability, and equity of the ratings, underscoring the inherent tradeoffs that come with each. We show that while a system that weights proficiency more heavily than growth produces more stable school ratings, identifying schools based on multiple years of performance data instead of one more than offsets the loss of stability in shifting to a growth measure. We conclude with recommendations for state accountability systems under ESSA and for federal policymaking moving forward.
The persistently high employment share of the informal sector makes entrepreneurship a necessity for youth in many developing countries. We exploit exogenous variation in the implementation of Rwanda’s entrepreneurship education reform in secondary schools to evaluate its effect on student economic outcomes up to three years after graduation. Using a randomized controlled trial, we evaluated a three-year intensive training for entrepreneurship teachers, finding pedagogical changes as intended and increased entrepreneurial activity among students. In this paper, we tracked students following graduation and found that increased entrepreneurship persisted one year later, in 2019. Students from treated schools were six percentage points more likely to be entrepreneurs, an increase of 19 percent over the control mean. However, gains in entrepreneurship faded after three years, in 2021. Employment was six percentage points lower in the treatment group. By some measures, income and profits were lower in the treatment group, with no robust differences in these outcomes overall. Lower incomes and profits were concentrated among marginal students induced into entrepreneurship by the program. Youth entrepreneurship programs may therefore steer some participants away from their comparative advantage. Nonetheless, the program increased university enrollment, suggesting the potential for higher long run returns.
Teacher preparation programs are increasingly expected to use data on pre-service teacher (PST) skills to drive program improvement and provide targeted supports. Observational ratings are especially vital, but also prone to measurement issues. Scores may be influenced by factors unrelated to PSTs’ instructional skills, including rater standards and mentor teachers’ skills. Yet we know little about how these measurement challenges play out in the PST context. Here we investigate the reliability and sensitivity of two observational measures. We find measures collected during student teaching are especially prone to measurement issues; only 3-4% of variation in scores reflects consistent differences between PSTs, while 9-17% of variation can be attributed to the mentors with whom they work. When high scores stem not from strong instructional skills, but instead from external circumstances, we cannot use them to make consequential decisions about PSTs’ individual needs or readiness for independent teaching.
School districts across the U.S. have adopted funding policies designed to distribute resources more equitably across schools. However, schools are also increasing external fundraising efforts to supplement district budget allocations. We document the interaction between funding policies and fundraising efforts in Chicago Public Schools (CPS). We find that adoption of a weighted-student funding policy successfully reallocated more dollars to schools with high shares of students eligible for free/reduced-price (FRL) lunch, creating a policy-induced per-pupil expenditure gap. Further, almost all schools raised external funds over the study period with most dollars raised concentrated in schools serving relatively affluent populations. We estimate that external fundraising offset the policy-induced per- pupil expenditure gap between schools enrolling the lowest and highest shares of FRL-eligible students by 26-39 percent. Other districts have attempted to reallocate fundraised dollars to all schools; such a policy in CPS would have little impact on most schools’ budgets.
School districts historically approached conflict-resolution from a zero-sum perspective: suspend students seen as disruptive and potentially harm them, or avoid suspensions and harm their classmates. Restorative practices (RP) -- focused on reparation and shared ownership of disciplinary justice -- are designed to avoid this trade-off by addressing undesirable behavior without imparting harm. This study examines Chicago Public Schools' adoption of RP. We identify decreased suspensions, improved school climate, and find no evidence of increased classroom disruption. We estimate a 19% decrease in arrests, including for violent offenses, with reduced arrests outside of school, providing evidence that RP substantively changed behavior.
The COVID-19 pandemic disrupted teacher candidates’ capacity to complete licensure requirements. In response, many states temporarily reduced professional entry requirements to prevent a pandemic-induced teacher shortage. Using mixed methods, we examine the role of the emergency teaching license in Massachusetts, which provided an opportunity for individuals to enter the public school teacher workforce with only a bachelor’s degree. Our results show that emergency licenses increased the supply of teachers in two ways by: 1) providing an entry point for individuals who previously wanted to become teachers but could not meet traditional licensure requirements and 2) expanding the pool of individuals interested in the profession. Among those teachers hired with an emergency license, we find that they were substantially more ethnoracially diverse than their peers with traditional licenses, and they overwhelmingly intend to obtain permanent licensure and remain in the profession. These results suggest that rethinking initial entry requirements may be an effective policy tool to increase the supply of teachers, particularly among teachers of color.
Ample research investigates returns to teacher preparation and other instructional inputs for the general student population, yet evidence is lacking for students with disabilities (SWDs). This study uses North Carolina data to estimate achievement returns to teacher preparation by classroom type and level of classroom support for SWDs. I find that SWDs perform better when placed in inclusive classrooms and when these classrooms have co-teachers. Regardless of classroom type, SWDs benefit from more experienced teachers, but only gain from special education certified teachers in certain classroom configurations. These results indicate that education leaders can optimize resource allocation by minimizing separate classrooms for SWDs, relaxing special education certification requirements, and investing in an experienced teacher workforce with support from co-teachers.