Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

EdWorkingPapers

Daniel Rodriguez-Segura, Beth E. Schueler.

A significant share of education and development research uses data collected by workers called “enumerators.” It is well-documented that “enumerator effects”—or inconsistent practices between the individual people who administer measurement tools— can be a key source of error in survey data collection. However, it is less understood whether this is a problem for academic assessments or performance tasks. We leverage a remote phone-based mathematics assessment of primary school students and survey of their parents in Kenya. Enumerators were randomized to students to study the presence of enumerator effects. We find that both the academic assessment and survey was prone to enumerator effects and use simulation to show that these effects were large enough to lead to spurious results at a troubling rate in the context of impact evaluation. We therefore recommend assessment administrators randomize enumerators at the student level and focus on training enumerators to minimize bias.

More →


Min Sun, Christopher A. Candelaria, David Knight, Zachary LeClair, Sarah E. Kabourek, Katherine Chang.

Knowing how policy-induced salary schedule changes affect teacher recruitment and retention will significantly advance our understanding of how resources matter for K-12 student learning. This study sheds light on this issue by estimating how legislative funding changes in Washington state in 2018-19—induced by the McCleary court-ordered reform—affected teacher salaries and labor market outcomes. By embedding a simulated instrumental variables approach in a mixed methods design, we observed that local collective bargaining negotiations directed new state-level funding allocations toward certificated base salaries, particularly among more senior teachers. Variability in political power, priorities, and interests of both districts and unions led to greater heterogeneity in teacher salary schedules. Teacher mobility rate was reduced in the first year of the reform, and subsequently new hiring rate was reduced in the second year. Suggestive evidence indicates that a $1,000 salary increase would have larger effects on junior teachers’ hiring and their transfers between districts to a greater extent than late-career teachers.

More →


Edward J. Kim.

This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student’s capacity to signal their assigned teacher’s quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity parameters, whereas traditional VAMs represent a special case where all students exhibit identical parameters. Simulation study results indicate that SW VAMs outperform traditional VAMs at recovering true teacher quality when the assumption of student parameter invariance is met but have mixed performance under alternative assumptions of the true data generating process depending on data availability and the choice of priors. Evidence using an empirical data set suggests that SW VAM and traditional VAM results may disagree meaningfully in practice. These findings suggest that SW VAMs have promising potential to recover true teacher value-added in practical applications and, as a version of value-added models that attends to student differences, can be used to test the validity of traditional VAM assumptions in empirical contexts.

More →


David S. Knight, Pooya Almasi, JoLynn Berge.

In this forthcoming book chapter, the authors provide an in-depth description of the history and current issues pertaining to public school finance in Washington State, including how recent federal stimulus funding impacted resource levels. The state uses a resource-based funding model, where the amount of funds each school district receives is based on the district’s enrollment level and a series of staffing ratios and salary schedules. In contrast, most U.S. states use a simpler, dollar-based funding formula that determines district funding levels using a per-student dollar amount. Dollar-based funding models typically include student weights that drive more state funds to school districts with greater need. Washington’s resource-based model does not have weights and provides approximately equal per-pupil state funding regardless of local need. When combined with the state’s local tax revenues, Washington’s K-12 finance system provides higher per-pupil funding levels to districts serving wealthier student populations. The system creates racial funding gaps that systematically disadvantage Latinx and Pacific Islander students. Federal COVID-19 stimulus funds were allocated progressively with respect to student income level; however, these funds are temporary, and districts may need to reduce budgets or identify additional funds once the federal stimulus is expended. The chapter concludes with recommendations for further reading.

More →


David Blazar, Beth Schueler.

What guidance does research provide school districts about how to improve system performance and increase equity? Despite over 30 years of inquiry on the topic of effective districts, existing frameworks are relatively narrow in terms of disciplinary focus (primarily educational leadership perspectives) and research design (primarily qualitative case studies). To bridge this gap, we first review the theoretical literatures on how districts are thought to affect student outcomes, arguing that an expanded set of disciplinary perspectives—organizational behavior, political science, and economics—have distinct theories about why districts matter. Next, we conduct a systematic review of quantitative studies that estimate the relationship between district-level inputs and performance outcomes. This review reveals benefits of district-level policies that cross disciplinary perspectives, including higher teacher salaries and strategic hiring, lower student-teacher ratios, and data use. One implication is that future research on district-level policymaking needs to consider multiple disciplinary perspectives. Our review also reveals the need for significant additional causal evidence and provides a multidisciplinary map of theorized pathways through which districts could influence student outcomes that are ripe for rigorous testing.

More →


Daniela Alvarez-Vargas, Sirui Wan, Lynn S. Fuchs, Alice Klein, Drew H. Bailey.

Despite policy relevance, longer-term evaluations of educational interventions are relatively rare. A common approach to this problem has been to rely on longitudinal research to determine targets for intervention by looking at the correlation between children’s early skills (e.g., preschool numeracy) and medium-term outcomes (e.g., first-grade math achievement). However, this approach has sometimes over—or under—predicted the long-term effects (e.g., 5th-grade math achievement) of successfully improving early math skills. Using a within-study comparison design, we assess various approaches to forecasting medium-term impacts of early math skill-building interventions. The most accurate forecasts were obtained when including comprehensive baseline controls and using a combination of conceptually proximal and distal short-term outcomes (in the nonexperimental longitudinal data). Researchers can use our approach to establish a set of designs and analyses to predict the impacts of their interventions up to two years post-treatment. The approach can also be applied to power analyses, model checking, and theory revisions to understand mechanisms contributing to medium-term outcomes.

More →


Cory Koedel, Trang Pham.

We study the conditional gender wage gap among faculty at public research universities in the U.S. We begin by using a cross-sectional dataset from 2016 to replicate the long-standing finding in research that conditional on rich controls, female faculty earn less than their male colleagues. Next, we construct a data panel to track the evolution of the wage gap through 2021. We show that the gap is narrowing. It declined by more than 50 percent over the course of our data panel to the point where by 2021, it is no longer detectable at conventional levels of statistical significance.

More →


Johnathan G. Conzelmann, Steven W. Hemelt, Brad J. Hershbein, Shawn Martin, Andrew Simon, Kevin Stange.

This paper introduces a new measure of the labor markets served by colleges and universities across the United States. About 50 percent of recent college graduates are living and working in the metro area nearest the institution they attended, with this figure climbing to 67 percent in-state. The geographic dispersion of alumni is more than twice as great for highly selective 4-year institutions as for 2-year institutions. However, more than one-quarter of 2-year institutions disperse alumni more diversely than the average public 4-year institution. In one application of these data, we find that the average strength of the labor market to which a college sends its graduates predicts college-specific intergenerational economic mobility. In a second application, we quantify the extent of “brain drain” across areas and illustrate the importance of considering migration patterns of college graduates when estimating the social return on public investment in higher education.

More →


Oded Gurantz, Ann Obadan.

The absence of federal support leaves undocumented students reliant on state policies to financially support their postsecondary education. We descriptively examine the postsecondary trajectories of tens of thousands of undocumented students newly eligible for California’s state aid program, using detailed application data to compare them to similar peers. In this context, undocumented students who apply and are eligible for the program use grant aid to attend college at rates similar to their peers. Undocumented students remain more likely to enroll in a community college at the expense of attending a broad access four-year college and have higher exit rates from two-year colleges. Yet undocumented students are equally likely to attend the more selective University of California system, and across four-year public colleges have persistence rates similar to their peers, showing that those who do attend four-year colleges perform well.

More →


Tammy Kolbe, Elizabeth Dhuey, Sara Menlove Doutre.

The formula used to allocate federal funding for state and local special education programs is one of the Individual with Disabilities Act’s most critical components. The formula not only serves as the primary mechanism for dividing available federal dollars among states, it also represents policymakers’ intent to equalize educational opportunities for students with disabilities nationwide. In this study, we evaluate the distribution of IDEA Part B(611) funding in the wake of changes to the formula that were instituted at the law’s 1997 reauthorization. We find that the revised formula generated large and concerning disparities among states in federal special education dollars. We find that, on average, states with proportionally larger populations of children and children living in poverty, children identified for special education, and non-White and Black children receive fewer federal dollars, both per pupil and per student receiving special education. We present policy simulations that illustrate how changes to the existing formula might improve the fairness and efficiency with which federal IDEA Part B funding is allocated to states.

More →