Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Thomas S. Dee

Sarah Novicoff, Thomas S. Dee.

While policymakers have demonstrated considerable enthusiasm for “science of reading” initiatives, the evidence on the impact of related reforms when implemented at scale is limited. In this pre-registered, quasi-experimental study, we examine California’s recent initiative to improve early literacy across the state’s lowest-performing elementary schools. The Early Literacy Support Block Grant (ELSBG) provided teacher professional development grounded in the science of reading as well as aligned supports (e.g., assessments and interventions), new funding (about $1000 per student), spending flexibility within specified guidelines, and expert facilitation and oversight of school-based planning. We find that ELSBG generated significant (and cost-effective) improvements in ELA achievement in its first two years of implementation (0.14 SD) as well as smaller, spillover improvements in math achievement.

More →


Elizabeth Huffaker, Sarah Novicoff, Thomas S. Dee.

A controversial, equity-focused mathematics reform in the San Francisco Unified School District (SFUSD) featured delaying Algebra I until ninth grade for all students. This descriptive study examines student-level longitudinal data on mathematics course-taking across successive cohorts of SFUSD students who spanned the reform’s implementation. We observe large changes in ninth and tenth grades (e.g., delaying Algebra I and Geometry). Participation in Advanced Placement (AP) math initially fell 15% (6 pp.) driven by declines in AP Calculus and among Asian/Pacific-Islander students. However, growing participation in acceleration options attenuated these reductions. Large ethnoracial gaps in advanced math course-taking remained.

More →


Thomas S. Dee, Elizabeth Huffaker, Cheryl Philips, Eric Sagara.

Before the 2020-21 school year, educators, policymakers, and parents confronted the stark and uncertain trade-offs implied by the health, educational, and economic consequences of offering instruction remotely, in person, or through a hybrid of the two. Most public schools in the U.S. chose remote-only instruction and enrollment fell dramatically (i.e., a loss of roughly 1.1 million K-12 students). We examine the impact of these choices on public-school enrollment using unique panel data that combine district-level enrollment trajectories with information on their instructional modes. We find offering remote-only instead of in-person instruction reduced enrollment by 1.1 percentage points (i.e., a 42 percent increase in disenrollment from -2.6 to -3.7 percent). The disenrollment effects of remote instruction are concentrated in kindergarten and, to a lesser extent, elementary schools. We do not find consistent evidence that remote instruction influenced middle or high-school enrollment or that hybrid instruction had an impact.

More →


Jaymes Pyne, Erica Messner, Thomas S. Dee.

The evidence that student learning declines sharply (or stagnates) during the summer has motivated a substantial interest in programs that provide intensive academic instruction during the summer. However, the existing literature suggests that such programs, which typically focus on just one or two subjects, have modest effects on students’ achievement and no impact on measures of their engagement in school. In this quasi-experimental study, we present evidence on the educational impact of a unique and mature summer learning program that serves low-income middle school students and features unusual academic breadth and a social emotional curriculum with year-to-year scaffolding. Our results indicate that this program led to substantial reductions in unexcused absences, chronic absenteeism and suspensions and a modest gain in ELA test scores. We find evidence that the gains in behavioral engagement grow over time and with additional summers of participation. Our results also suggest that these effects were particularly concentrated among boys and Latinx students.

More →


Thomas S. Dee, Graciela Perez-Nunez.

A growing body of evidence suggests that vocationally focused programs of study substantially improve high-school completion and longer-run economic success. However, the corresponding recommendations to expand vocational programs may have unintended, negative consequences for low-income, academically successful students (i.e., the “missing one offs”) who have the capacity and motivation to attend highly selective universities. This study contributes to our understanding of these issues by examining an innovative, college-preparatory program targeted to academically successful Chilean students attending vocational high schools serving lower-income communities. This program (Escuela Desarrollo de Talentos or EDT) provides academic and social-emotional supports aligned with admission to selective universities. We examine the educational effects of EDT participation using a fuzzy regression-discontinuity design based on its eligibility rules. We find that the EDT program did not increase the probability of graduating from high school but did increase performance in math courses. We also find corresponding evidence suggesting that EDT participation increased math performance on college entrance exams and shifted students away from further postsecondary vocational training and towards matriculation at elite universities.

More →


Thomas S. Dee, Susanna Loeb, Ying Shi.

Major philanthropic initiatives that incorporate features of venture-capital practices have become increasingly prominent, particularly in K-12 public education. In this study, we provide empirical evidence on the reach, character, and impact of the Broad Superintendents Academy, a prominent and controversial venture-philanthropic initiative designed to transform leadership in the nation’s largest school districts. Using a novel dataset on all Broad trainees and a linked panel data set of all large school districts over 20 years, we find that Broad superintendents have had extensive reach (e.g., serving nearly 3 million students at their peak). We also show that, within districts that hired Broad trainees, Broad superintendents were 40 percent more likely to be Black than their non-Broad peers, but also had tenures that were 18 percent shorter. Panel-based estimates provide evidence that Broad-trained leaders had no clear effects on several district outcomes such as enrollment, school closures, per-pupil instructional and support-service spending, and student completion rates. However, Broad-trained leaders initiate a trend towards an increased number of charter schools and higher charterschool enrollment.

More →


Thomas S. Dee, Jessalynn James, James H. Wyckoff.

Ten years ago, many policymakers viewed the reform of teacher evaluation as a highly promising mechanism to improve teacher effectiveness and student achievement. Recently, that enthusiasm has dimmed as the available evidence suggests the subsequent reforms had a mixed record of implementation and efficacy. Even in districts where there was evidence of efficacy, the early promise of teacher evaluation may not sustain as these systems mature and change. This study examines the evolving design of IMPACT, the teacher evaluation system in the District of Columbia Public Schools (DCPS). We describe the recent changes to IMPACT which include higher performance standards for lower-performing teachers and a reduced emphasis on value-added test scores. Descriptive evidence on the dynamics of teacher retention and performance under this redesigned system indicate that lower-performing teachers are particularly likely to either leave or improve. Corresponding causal evidence similarly indicates that imminent dismissal threats for persistently low-performing teachers increased both teacher attrition and the performance of returning teachers. These findings suggest teacher evaluation can provide a sustained mechanism for improving the quality of teaching.

More →


Thomas S. Dee, Emily Penner.

The My Brother’s Keeper (MBK) Challenge developed by President Obama supports communities that promote civic initiatives designed to improve the educational and economic opportunities specifically for young men of color. In Oakland, California, the MBK educational initiative features the African American Male Achievement (AAMA) program. The AAMA focuses on regularly scheduled classes exclusively for Black, male students and taught by Black, male teachers who focus on social-emotional training, African-American history, culturally relevant pedagogy, and academic supports. In this study, we present quasi-experimental evidence on the dropout effects of the AAMA by leveraging its staggered scale-up across high schools in the Oakland Unified School District (OUSD). We find that AAMA availability led to a significant reduction in the number of Black males who dropped out as well as smaller reductions among Black females, particularly in 9th grade.

More →