Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

EdWorkingPapers

Douglas N. Harris, Lihan Liu, Daniel Oliver, Cathy Balfe, Sara Slaughter.

COVID-19 has forced essentially all schools in the country to close their doors to inperson activities. In this study, we provide new evidence about variation in school responses across school types. We focus on five main constructs of school activity during COVID-19: personalization and engagement in instruction, personalization and engagement in other school communication with students, progress monitoring (especially assignment grading), breadth of services (e.g., counseling and meals), and equitable access (to technology and services for students with special needs). We find that the strongest predictor of the extent of school activities was the education level of parents and other adults in schools’ neighborhoods. Internet access also predicts school responses. Race, parent/adult income, and school spending do not predict school responses. Private schools shifted to remote learning several days faster than traditional public schools, though others eventually caught up. On some measures, charter schools exceeded the responses of other schools; in other cases, traditional public schools had the highest overall measures. States in the Midwest responded more aggressively than those in other regions, especially the South, even after controlling for the full set of additional covariates. Learning management systems were reported by a large majority of schools, followed by video communication tools and tutorial/assessment programs. Several methods are proposed and implemented to address differential website use. We discuss potential implications of these findings for policy and effects on student outcomes.

More →


Lucy C. Sorensen, Stephen B. Holt.

Since their introduction in the 1990s, charter schools have grown from a small-scale experiment to a ubiquitous feature of the public education landscape. The current study uses the legislative removal of a cap on the maximum number of charters, and the weakening of regulations on these new schools, in North Carolina as a natural experiment to assess the intensive impacts of charter school growth on teacher quality and student composition in traditional public schools (TPS) at different levels of local market penetration. Using an instrumental variable difference-in-differences approach to account for endogenous charter demand, we find that intensive local charter entry reduces the inflow of new teachers at nearby TPS, leading to a more experienced and credentialed teaching workforce on average. However, we find that the entry of charters serving predominantly White students leads to reductions in average teacher experience, effectiveness, and credentials at nearby TPS. Overall these findings suggest that the composition of the teacher workforce in TPS will continue to change as charter schools further expand, and that the spillover effects of future charter expansion will vary by the types of students served by charters.

More →


Manuel Alcaino, Jennifer. L. Jennings .

We investigate the determinants and consequences of increased school choice by analyzing a 22-year school panel matched to county-level demographic, economic, and political data.  Using an event-study design exploiting the precise timing of charter school enrollment change, we provide robust evidence that charter enrollment growth increases racial and especially socioeconomic school segregation, a finding that is partially explained by non-poor students’ transition from the private to public sector. Charter growth drives public sector incorporation, while also increasing within-public sector segregation. To assess the effects of disparate choice policies on segregation, we replicate this analysis for magnet schools, which have admissions practices intended to increase diversity, and find no evidence that magnet enrollment growth increases segregation.

More →


Anna Shapiro.

Much of the literature estimating disproportionality in special education identification rates has focused on socioeconomic status, race, and gender. However, recent evidence suggests that a student’s school starting age also impacts the likelihood they receive special education services, particularly in the early grades. I build on the evidence that the youngest students in a grade more likely to be diagnosed with Attention Deficit/Hyperactivity Disorder and more likely to be placed in special education by estimating the effect of school starting age on special education identification in Michigan. I also estimate heterogeneity in this effect by student characteristics and across school districts. Using a regression discontinuity design exploiting variation in kindergarten starting age generated by a statewide kindergarten entrance age policy, I find that the youngest students in a kindergarten cohort are 40% more likely (3.3 percentage points, p<0.001) to be placed in special education than are the oldest students, and that this effect persists through eighth grade. Despite little evidence of heterogeneity by gender, race, or socioeconomic status, I find some suggestive evidence that the effect is particularly large for white boys in the early elementary grades and for black girls in the later elementary grades. I find no evidence that these effects vary across school districts. Finally, I find exploratory evidence of variation by school cohort age composition, suggesting these effects are driven moreso by relative age comparisons than absolute age developmental differences. Given the importance of special education services to the academic success of children with disabilities, these findings have implications for schools and for policymakers seeking to improve special education program provision.

More →


David D. Liebowitz, Lorna Porter.

Despite empirical evidence suggesting the important influence school leaders have on learning conditions and student outcomes in schools, relatively little is understood about the professional pathways they take into their roles. In this descriptive paper, we document the professional experiences, personal characteristics and instructional effectiveness of Oregon's principals and assistant principals between 2006 and 2019. We highlight the diversity of roles educators assume prior to entering school leadership. We find that school leaders who have prior teaching experience in tested grades and subjects do not raise student achievement at substantively or statistically meaningful higher rates than their peers. We document that female principals and assistant principals have become more representative of the teaching workforce, but that there have been almost no changes in the racial/ethnic composition of school leaders in Oregon. Finally, we observe minimal differences in female and non-White assistant principals' time-to-entry into the principalship. Our findings provide insights on potential points of intervention during the educator career trajectory to attract and develop more effective and demographically representative school leaders.

More →


David M. Quinn, Andrew D. Ho.

Researchers decompose test score “gaps” and gap-changes into within- and between-school portions to generate evidence on the role that schools play in shaping educational inequality.  However, existing decomposition methods (a) assume an equal-interval test scale and (b) are a poor fit to coarsened data such as proficiency categories. We develop two decomposition approaches that overcome these limitations: an extension of V, an ordinal gap statistic (Ho, 2009), and an extension of ordered probit models (Reardon et al., 2017). Simulations show V decompositions have negligible bias with small within-school samples. Ordered probit decompositions have negligible bias with large within-school samples but more serious bias with small within-school samples. These methods are applicable to decomposing any ordinal outcome by any categorical grouping variable.

More →


Thomas S. Dee, Susanna Loeb, Ying Shi.

Major philanthropic initiatives that incorporate features of venture-capital practices have become increasingly prominent, particularly in K-12 public education. In this study, we provide empirical evidence on the reach, character, and impact of the Broad Superintendents Academy, a prominent and controversial venture-philanthropic initiative designed to transform leadership in the nation’s largest school districts. Using a novel dataset on all Broad trainees and a linked panel data set of all large school districts over 20 years, we find that Broad superintendents have had extensive reach (e.g., serving nearly 3 million students at their peak). We also show that, within districts that hired Broad trainees, Broad superintendents were 40 percent more likely to be Black than their non-Broad peers, but also had tenures that were 18 percent shorter. Panel-based estimates provide evidence that Broad-trained leaders had no clear effects on several district outcomes such as enrollment, school closures, per-pupil instructional and support-service spending, and student completion rates. However, Broad-trained leaders initiate a trend towards an increased number of charter schools and higher charterschool enrollment.

More →


Paul T. von Hippel, Ana P. Cañedo.

Many kindergarten teachers place students in higher and lower “ability groups” to learn math and reading. Ability group placement should depend on student achievement, but critics charge that placement is biased by socioeconomic status (SES), gender, and race/ethnicity. We predict group placement in the Early Childhood Longitudinal Study of the Kindergarten class of 2010-11, using linear and ordinal regression models with classroom fixed effects. The best predictors of group placement are test scores, but girls, high-SES students, and Asian Americans receive higher placements than their test scores alone would predict. One third of students move groups during kindergarten, and some movement is predicted by changes in test scores, but high-SES students move up more than score gains would predict, and Hispanic children move up less. Net of SES and test scores, there is no bias in the placement of African American children. Differences in teacher-reported behaviors explain the higher placement of girls, but do little to explain the higher or lower placement of other groups. Although achievement is the best predictor of ability group placement, there are signs of bias.

More →


Bryan S. Graham, Geert Ridder, Petra Thiemann, Gema Zamarro.

We study the effects of counterfactual teacher-to-classroom assignments on average student achievement in elementary and middle schools in the US. We use the Measures of Effective Teaching (MET) experiment to semiparametrically identify the average reallocation effects (AREs) of such assignments. Our findings suggest that changes in within-district teacher assignments could have appreciable effects on student achievement. Unlike policies which require hiring additional teachers (e.g., class-size reduction measures), or those aimed at changing the stock of teachers (e.g., VAM-guided teacher tenure policies), alternative teacher-to-classroom assignments are resource neutral; they raise student achievement through a more efficient deployment of existing teachers.

More →


Heather Hill, Zid Mancenido, Susanna Loeb.

Despite calls for more evaluative research in teacher education, formal assessments of the effectiveness of novel teacher education practices remain rare. One reason is that we lack designs and measurement approaches that appropriately meet the challenges of causal inference in the field. In this article, we seek to fill this gap. We first outline the difficulties of doing evaluative work in teacher education. We then describe a set of replicable practices for developing measures of key teaching outcomes, and propose evaluative research designs that can be adapted to suit the needs of the field. Finally, we identify community-wide initiatives that are necessary to advance useful evaluative research.

More →