Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

EdWorkingPapers

Jihyun Kim, Ken Frank, Peter Youngs, Serena Salloum, Kristen Bieda.

While teacher evaluation policies have been central to efforts to enhance teaching quality over the past decade, little is known about how teachers change their instructional practices in response to such policies. To address this question, this paper drew on classroom observation and survey data to examine how early career teachers’ (ECTs’) perceptions of pressure associated with teacher evaluation policies seemed to affect their enactment of ambitious mathematics instruction. As part of our analysis, we also considered the role that mathematical knowledge for teaching (MKT) and school norms regarding teaching mathematics shape the potential influence of teacher evaluation policies on ECTs’ instructional practices. Understanding how the confluence of these factors is associated with teachers’ instruction provides important insights into how to improve teaching quality, which is one of the most important inputs for student learning.

More →


Adam Altmejd, Andres Barrios-Fernandez, Marin Drlje, Joshua Goodman, Michael Hurwitz, Dejan Kovac, Christine Mulhern, Christopher Neilson, Jonathan Smith.

Family and social networks are widely believed to influence important life decisions but identifying their causal effects is notoriously difficult. Using admissions thresholds that directly affect older but not younger siblings’ college options, we present evidence from the United States, Chile, Sweden and Croatia that older siblings’ college and major choices can significantly influence their younger siblings’ college and major choices. On the extensive margin, an older sibling’s enrollment in a better college increases a younger sibling’s probability of enrolling in college at all, especially for families with low predicted probabilities of enrollment. On the intensive margin, an older sibling’s choice of college or major increases the probability that a younger sibling applies to and enrolls in that same college or major. Spillovers in major choice are stronger when older siblings enroll and succeed in more selective and higher-earning majors. The observed spillovers are not well-explained by price, income, proximity or legacy effects, but are most consistent with older siblings transmitting otherwise unavailable information about the college experience and its potential returns. The importance of such personally salient information may partly explain persistent differences in college-going rates by geography, income, and other determinants of social networks.

More →


Megan Kuhfeld, James Soland, Beth Tarasawa, Angela Johnson, Erik Ruzek, Jing Liu.

With 55 million students in the United States out of school due to the COVID-19 pandemic, education systems are scrambling to meet the needs of schools and families, including planning how best to approach instruction in the fall given students may be farther behind than in a typical year. Yet, education leaders have little data on how much learning has been impacted by school closures. While the COVID-19 learning interruptions are unprecedented in modern times, existing research on the impacts of missing school (due to absenteeism, regular summer breaks, and school closures) on learning can nonetheless inform projections of potential learning loss due to the pandemic. In this study, we produce a series of projections of COVID-19-related learning loss and its potential effect on test scores in the 2020-21 school year based on (a) estimates from prior literature and (b) analyses of typical summer learning patterns of five million students. Under these projections, students are likely to return in fall 2020 with approximately 63-68% of the learning gains in reading relative to a typical school year and with 37-50% of the learning gains in math. However, we estimate that losing ground during the COVID-19 school closures would not be universal, with the top third of students potentially making gains in reading. Thus, in preparing for fall 2020, educators will likely need to consider ways to support students who are academically behind and further differentiate instruction.

 

More →


Matthew A. Kraft.

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this paper, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, cost, and scalability into the process of interpreting the policy importance of effect sizes.

More →

Download PDF808.62 KB

Charles T. Clotfelter, Helen F. Ladd, Calen R. Clifton, Mavzuna Turaeva.

Using detailed administrative data for public schools, we document racial and ethnic segregation at the classroom level in North Carolina, a state that has experienced a sharp increase in Hispanic enrollment. We decompose classroom-level segregation in counties into within-school and between-school components. We find that the within-school component accounted for a sizable share of total segregation in middle schools and high schools. Recognizing its importance could temper the praise for school assignment policies that reduce racial disparities between schools but allow large disparities within them. More generally, we observe between the two components a complementary relationship, with one component tending to be large when the other one is small. Comparing the degree of segregation for the state’s two largest racial/ethnic minority groups, we find that White/Hispanic segregation was more severe than White/Black segregation, particularly within schools. Analyzed as separate administrative units, schools with large shares of Black students tended to have more White/Black segregation across classrooms than schools with smaller shares. Finally, we examine enrollment patterns by course and show that school segregation brings with it differences by race and ethnicity in the courses that students take, with White students more likely to be enrolled in advanced classes.

More →


Brendan Bartanen, Andrew Kwok.

Using rich longitudinal data from one of the largest teacher education programs in Texas, we examine the measurement of pre-service teacher (PST) quality and its relationship with entry into the K–12 public school teacher workforce. Drawing on rubric-based observations of PSTs during clinical teaching, we find that little of the variation in observation scores is attributable to actual differences between PSTs. Instead, differences in scores largely reflect differences in the rating standards of field supervisors. We also find that men and PSTs of color receive systematically lower scores. Finally, higher-scoring PSTs are slightly more likely to enter the teacher workforce and substantially more likely to be hired at the same school as their clinical teaching placement.

More →


Quynh Tien Le, Morgan Polikoff.

Castañeda v. Pickard (1981) mandated that educational programs for emergent bilinguals be tested for program efficacy. Since English language development (ELD) curricular materials are one part of an instructional program, we assess this mandate by examining the effectiveness of ELD materials in Texas. Using local linear matching, we find that schools that do not purchase any ELD curricula have significantly lower English language proficiency scores relative to schools that purchase state-adopted ELD materials. These results are robust across various matching models—inverse probability weights with regression adjustment, kernel matching, and nearest neighbor matching--and a comparative interrupted time series design. There is no significant difference between schools that adopt the two most popular ELD curricula—Rigby On Our Way to English and National Geographic Reach. This study suggests that emergent bilinguals (EBs) who attend schools that have instructional materials that explicitly foreground English language proficiency standards outperform those in schools that do not have such materials.

More →


Albert Cheng, Paul E. Peterson.

Although qualitative research suggests that school choice and other interventions are more beneficial for moderately disadvantaged than severely deprived students, the subject has barely been explored by quantitative studies with either observational or experimental designs.  We estimate experimentally the impact of a voucher offer on college attainment of poor minority students by household income and parental education. Estimates are obtained from a 1997 private, lottery-based voucher intervention in New York City.  National Student Clearinghouse provided 2017 postsecondary outcomes.  Positive impacts on moderately disadvantaged students do not extend to the severely deprived.

More →


Zeyu Xu, Ben Backes, Amanda Oliveira, Dan Goldhaber.

This study adds to the currently limited evidence base on the efficacy of interventions targeting non-college-ready high school students by examining the impact of Kentucky’s Targeted Interventions (TI) program. We focus on interventions that students received under TI in the senior year of high school based on their 11th grade ACT test scores. Using difference-in-regression discontinuity and difference-in-difference designs with seven cohorts of 11th grade students, we find that, for an average per-student cost of about $600, TI significantly reduces the likelihood that students enroll in remedial course in both 2- and 4-year postsecondary institutions by 5–10 percentage points in math and 3–4 percentage points in English. These effects are similar among students who are eligible for free-or reduced-price lunch, Black and Hispanic students, students with remediation needs in multiple subjects, and students in lower-performing schools. Evidence also shows that TI increases the likelihood that students enroll in and pass college math before the end of the first year by four percentage points in 4-year universities. However, little evidence exists for TI affecting credit accumulation or persistence.

More →


Megan Kuhfeld, James Soland.

Important educational policy decisions, like whether to shorten or extend the school year, often require accurate estimates of how much students learn during the year.  Yet, related research relies on a mostly untested assumption: that growth in achievement is linear throughout the entire school year.  We examine this assumption using a data set containing math and reading test scores for over seven million students in kindergarten through 8th grade across the fall, winter, and spring of the 2016-17 school year. Our results indicate that assuming linear within-year growth is often not justified, particularly in reading. Implications for investments in extending the school year, summer learning loss, and racial/ethnic achievement gaps are discussed.

More →