Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Program and policy effects

Cory Koedel, Trang Pham.

We study the conditional gender wage gap among faculty at public research universities in the U.S. We begin by using a cross-sectional dataset from 2016 to replicate the long-standing finding in research that conditional on rich controls, female faculty earn less than their male colleagues. Next, we construct a data panel to track the evolution of the wage gap through 2021. We show that the gap is narrowing. It declined by more than 50 percent over the course of our data panel to the point where by 2021, it is no longer detectable at conventional levels of statistical significance.

More →


Oded Gurantz, Ann Obadan.

The absence of federal support leaves undocumented students reliant on state policies to financially support their postsecondary education. We descriptively examine the postsecondary trajectories of tens of thousands of undocumented students newly eligible for California’s state aid program, using detailed application data to compare them to similar peers. In this context, undocumented students who apply and are eligible for the program use grant aid to attend college at rates similar to their peers. Undocumented students remain more likely to enroll in a community college at the expense of attending a broad access four-year college and have higher exit rates from two-year colleges. Yet undocumented students are equally likely to attend the more selective University of California system, and across four-year public colleges have persistence rates similar to their peers, showing that those who do attend four-year colleges perform well.

More →


David M. Houston, Matthew P. Steinberg.

In spring 2020, nearly every public school in the U.S. closed at the onset of the Covid-19 pandemic. Existing evidence suggests that initial decisions to re-open schools for in-person instruction were generally unrelated to Covid case and death rates. Instead, local political partisanship and teachers union strength were better predictors of school re-opening status in fall 2020. We replicate and extend these analyses using data collected over the entire 2020-21 academic year. We demonstrate that Covid case and death rates were, in fact, meaningfully related to initial rates of in-person instruction. We also show that all three of these factors—Covid, partisanship, and teachers unions—became less predictive of in-person instruction as the school year continued. Conversely, the relationship between prior student achievement and the rate of in-person instruction increased in salience. We then leverage data from two nationally representative surveys of Americans’ attitudes toward education and identify an as-yet-undiscussed factor that predicts in-person instruction: pre-pandemic public support for increasing teacher salaries. We speculate that education leaders were better able to manage the logistical and political complexities of school reopenings in communities with greater support for educators.

More →


Elizabeth S. Park, Di Xu.

Growing literature documents the promise of active learning instruction in engaging students in college classrooms. Accordingly, faculty professional development (PD) programs on active learning have become increasingly popular in postsecondary institutions; yet, quantitative evidence on the effectiveness of these programs is limited. Using administrative data and an individual fixed effects approach, we estimate the effect of an active learning PD program on student performance and persistence at a large public institution. Findings indicate that the training improved subsequent persistence in the same field. Using a subset of instructors whose instruction was observed by independent observers, we identify a positive association between training and implementation of active learning teaching practices. These findings provide suggestive evidence that active learning PD has the potential to improve student outcomes. 

More →


Sarah Guthery, Lauren P. Bailes.

Texas reduced new teacher preparation requirements in 2001 to allow more alternate paths to licensure. Within five years, this policy change resulted in over half the state’s new teachers being alternatively licensed. Using a series of first difference models, this study examines the relationship between the increased supply of new teachers in Texas and new teacher salaries prior to the policy change and in the fifteen years thereafter. We find that the policy change did increase the supply of new teachers via alternative licensing, but pay for new EC-6 teachers declined by 2 to 13 percent with differential effects based on the rate at which districts hired alternatively licensed teachers.

More →


Taylor Odle, Lauren Russell.

Reverse transfer associate degrees are credentials retroactively awarded to current bachelor’s degree seekers that combine current four-year credits with credits previously earned at a community college. Providing students with an associate degree may not only increase motivation and persistence en route to completing a bachelor’s but may also provide important labor market benefits by way of increased marketability and earnings potential. Despite the proliferation of reverse transfer policies across at least 15 states to date, there is no causal evidence documenting their effect on students’ outcomes. Leveraging administrative data from Tennessee matched with records on its statewide reverse transfer program and a difference-in-differences design, we find reverse transfer degrees generally have little impact on students’ short- and intermediate-term academic and labor market outcomes. Our results point to suggestive yet small positive gains in GPA and short-term employment for recipients, but these estimates accompany no impacts on bachelor’s degree attainment and estimates that confidently reject any meaningful impacts on recipients’ earnings. Our findings contrast those of existing descriptive works on reverse transfer that reported large benefits for students, due in part to our methodological improvements and more robust data. These findings should guide policymakers considering the adoption, design, and ongoing operation of reverse transfer programs.

More →


Brian Heseung Kim, Katharine Meyer, Alice Choe.

Interactive, text message-based advising programs have become an increasingly common strategy to support college access and success for underrepresented student populations. Despite the proliferation of these programs, we know relatively little about how students engage in these text-based advising opportunities and whether that relates to stronger student outcomes – factors that could help explain why we’ve seen relatively mixed evidence about their efficacy to date. In this paper, we use data from a large-scale, two-way text advising experiment focused on improving college completion to explore variation in student engagement using nuanced interaction metrics and automated text analysis techniques (i.e., natural language processing). We then explore whether student engagement patterns are associated with key outcomes including persistence, GPA, credit accumulation, and degree completion. Our results reveal substantial variation in engagement measures across students, indicating the importance of analyzing engagement as a multi-dimensional construct. We moreover find that many of these nuanced engagement measures have strong correlations with student outcomes, even after controlling for student baseline characteristics and academic performance. Especially as virtual advising interventions proliferate across higher education institutions, we show the value of applying a more codified, comprehensive lens for examining student engagement in these programs and chart a path to potentially improving the efficacy of these programs in the future.

Open source code on GitHub.

More →


Matthew A. Kraft, John A. List, Jeffrey A. Livingston, Sally Sadoff.

A substantial body of experimental evidence demonstrates that in-person tutoring programs can have large impacts on K-12 student achievement. However, such programs typically are costly and constrained by a limited local supply of tutors. In partnership with CovEducation (CovEd), we conduct a pilot program that has potential to ease both of these concerns. We conduct an experiment where volunteer tutors from all over the country meet 1-on-1 with middle school students online during the school day. We find that the program produces consistently positive (0.07σ for math and 0.04σ for reading) but statistically insignificant effects on student achievement. While these estimates are notably smaller than those found in many higher-dosage in-person tutoring programs, they are from a significantly lower-cost program that was delivered within the challenging context of the COVID-19 pandemic. We provide evidence that is consistent with a dosage model of tutoring where additional hours result in larger effects.

More →


Katharine Meyer, Lindsay C. Page, Eric Smith, B. Tyler Walsh, C. Lindsey Fifield, Michael Evans.

Despite documented benefits to college completion, more than a third of students who initially enroll in college do not ultimately earn a credential. Completing college requires students to navigate both institutional administrative tasks (e.g., registering for classes) and academic tasks within courses (e.g., completing homework). In postsecondary education, several promising interventions have shown that text-based outreach and communication can be a low-cost, easy to implement, and effective strategy for supporting administrative task navigation. In this paper, we report on a randomized controlled trial testing the effect of a text-based chatbot with artificial intelligence (AI) capability on students' academic task navigation. We find the academic chatbot significantly shifted students’ final grades, increasing the likelihood students received a course grade of B or higher by eight percentage points. We find large and significant treatment effects for first-generation students, estimating the intervention increased their final course grades by about 11 points on a 100-point scale (and a 16 percentage point increase in earning a B or higher) as well as their completion of and performance on individual course deliverables (e.g., readings, activities, exams).

More →


Jing Liu, Monica Lee, Xiaoxue Zhou.

Student absenteeism is often conceptualized and quantified in a static, uniform manner, providing an incomplete understanding of this important phenomenon. Applying growth curve models to detailed class-attendance data, we document that secondary school students' unexcused absences grow steadily throughout a school year and over grades, while the growth of excused absences remain essentially unchanged. Importantly, students starting the school year with a high number of unexcused absences, Black and Hispanic students, and low-income students accumulate unexcused absences at a significantly faster rate than their counterparts. Lastly, students with higher growth rates in unexcused absences consistently report lower perceptions of all aspects of school culture than their peers. Interventions targeting unexcused absences and/or improving school culture can be crucial to mitigating disengagement.

More →