Search EdWorkingPapers
Search EdWorkingPapers by author, title, or keywords.
Search
Program and policy effects
Providing consistent, individualized feedback to teachers is essential for improving instruction but can be prohibitively resource intensive in most educational contexts. We develop an automated tool based on natural language processing to give teachers feedback on their uptake of student contributions, a high-leverage teaching practice that supports dialogic instruction and makes students feel heard. We conduct a randomized controlled trial as part of an online computer science course, Code in Place (n=1,136 instructors), to evaluate the effectiveness of the feedback tool. We find that the tool improves instructors’ uptake of student contributions by 27% and present suggestive evidence that our tool also improves students’ satisfaction with the course and assignment completion. These results demonstrate the promise of our tool to complement existing efforts in teachers’ professional development.
Teachers affect a wide range of students’ educational and social outcomes, but how they contribute to students’ involvement in school discipline is less understood. We estimate the impact of teacher demographics and other observed qualifications on students’ likelihood of receiving a disciplinary referral. Using data that track all disciplinary referrals and the identity of both the referred and referring individuals from a large and diverse urban school district in California, we find students are about 0.2 to 0.5 percentage points (7% to 18%) less likely to receive a disciplinary referral from teachers of the same race or gender than from teachers of different demographic backgrounds. Students are also less likely to be referred by more experienced teachers and by teachers who hold either an English language learners or special education credential. These results are mostly driven by referrals for defiance and violence infractions, Black and Hispanic male students, and middle school students. While it is unclear whether these findings are due to variation in teachers’ effects on actual student behavior, variation in teachers’ proclivities to make disciplinary referrals, or a combination of the two, these results nonetheless suggest that teachers play a central role in the prevalence of, and inequities in, office referrals and subsequent student discipline.
The impact of school resources on student outcomes was first raised in the 1960s and has been controversial since then. This issue enters into the decision making on school finance in both legislatures and the courts. The historical research found little consistent or systematic relationship of spending and achievement, but this research frequently suffers from significant concerns about the underlying estimation strategies. More recent work has re-opened the fundamental resource-achievement relationship with more compelling analyses that offer stronger identification of resource impacts. A thorough review of existing studies, however, leads to similar conclusions as the historical work: how resources are used is key to the outcomes. At the same time, the research has not been successful at identifying mechanisms underlying successful use of resources or for ascertaining when added school investments are likely to be well-used. Direct investigations of alternative input policies (capital spending, reducing class size, or salary incentives for teachers) do not provide clear support for such specific policy initiatives.
What happens when employers screen their employees but only observe a subset of output? We specify a model with heterogeneous employees and show that their response to the screening affects output in both the probationary period and the post-probationary period. The post-probationary impact is due to their heterogeneous responses affecting which individuals are retained and hence the screening efficiency. We show that the impact of the endogenous response on both the unobserved outcome and screening efficiency depends on whether increased effort on one task increases or decreases the marginal cost of effort on the other task. If the response decreases unobserved output in the probationary period then it increases the screening efficiency, and vice versa. We then assess these predictions empirically by studying a change to teacher tenure policy in New York City, which increased the role that a single measure -- test score value-added -- played in tenure decisions. We show that in response to the policy teachers increased test score value-added and decreased output that did not enter the tenure decision. The increase in test score value-added was largest for the teachers with more ability to improve students' untargeted outcomes, increasing their likelihood of getting tenure. We estimate that the endogenous response to the policy announcement reduced the screening efficiency gap -- defined as the reduction of screening efficiency stemming from the partial observability of output -- by 28%, effectively shifting some of the cost of partial observability from the post-tenure period to the pre-tenure period.
A stable learning environment is critical to high school reforms aimed at promoting postsecondary educational success. High teacher attrition can disrupt stable learning environments by uprooting student-teacher relationships and harming school climate. Educational leaders need greater understanding of how college readiness reforms alter learning environments generally, and teacher retention in particular. We study teacher turnover in two Texas College and Career Readiness School Models (CCRSM), called Early College High Schools and inclusive Science, Technology, Engineering, and Math Academies. We find (a) CCRSM schools have lower teacher turnover compared to traditional public high schools, (b) charter versions of CCRSM schools have higher turnover, but (c) non-CCRSM charters have the highest overall teacher turnover. We discuss implications for improving high school-based college readiness reforms.
The prevalence of school-based healthcare has increased markedly over the past decade. We study a modern mode of school-based healthcare, telemedicine, that offers the potential to reach places and populations with historically low access to such care. School-based telemedicine clinics (SBTCs) provide students with access to healthcare during the regular school day through private videoconferencing with a healthcare provider. We exploit variation over time in SBTC openings across schools in three rural districts in North Carolina. We find that school-level SBTC access reduces the likelihood that a student is chronically absent by 2.5 percentage points (29 percent) and reduces the number of days absent by about 0.8 days (10 percent). Relatedly, access to an SBTC increases the likelihood of math and reading test-taking by between 1.8-2.0 percentage points (about 2 percent). Heterogeneity analyses suggest that these effects are driven by male students. Finally, we see suggestive evidence that SBTC access reduces violent or weapons-related disciplinary infractions among students but has little influence on other forms of misbehavior.
Many policies in higher education are intended to improve college access and degree completion, yet often those policies fall short of their aims by making it difficult for prospective or current college students to access benefits for which they are eligible. Barriers that inhibit access to policy benefits, such as cumbersome paperwork, can weigh more heavily on members of marginalized communities, including racially minoritized students. Such administrative burdens can thus reinforce patterns of inequity. In this paper, we present a conceptual framework for examining administrative burdens embedded in higher education policies that can negatively affect prospective and current college students, especially those who are racially minoritized. With the use of our proposed framework, researchers can improve the understanding of ethnoracial disparities in higher education, inform policymakers’ design of racially equitable policies for higher education, and enable practitioners to implement those policies to promote racial equity.
Colleges across the United States are now placing most or all students directly into college-level courses and providing supplementary, aligned academic support alongside the courses, also known as “corequisite remediation.” Developmental education reforms like corequisite remediation could advance racial and ethnic equity in postsecondary education by facilitating early academic progression. However, there is limited evidence available on differential impacts of corequisite models by race and ethnicity. To better understand the potential for differential impacts of English corequisites for Latinx students, this study leverages data from a randomized control trial across five large urban community colleges across Texas. We also utilize student survey data to develop a deeper understanding of how corequisites shape the experiences of Latinx students in their college-level English courses. Latinx students in our study colleges saw larger benefits from taking corequisite English than non-Latinx students in terms of gateway course completion. The survey findings suggest that corequisites provided an environment where Latinx students felt less academically overwhelmed and less bored relative to patterns observed for traditional DE course enrollees. However, Latinx students in corequisites also reported being less likely to participate in class discussions and ask questions relative to their non-Latinx peers.
This paper provides one of the first natural experimental evidence on the consequences of a transition from college-major (early specialization) to college-then-major (late specialization) choice mechanism. Specifically, we study a recent reform in China that allows college applicants to apply to a meta-major consisting of different majors and to declare a specialization late in college instead of applying to a specific major. Using administrative data over 18 years on the universe of college applicants in a Chinese province, we examine the impacts of the staggered adoption of the reform across institutions on student composition changes. We find substantial heterogeneous effects across institutions and majors despite the aggregate null effects. This paper provides important policy implications regarding college admissions mechanism designs.
One of the most important mechanism design policies in college admissions is to let students choose a college major sequentially (college-then-major choice) or jointly (college-major choice). In the context of the Chinese meta-major reforms that transition from college-major choice to college-then-major choice, we provide the first experimental evidence on the information frictions and heterogeneous preferences that students have in their response to the meta-major option. In a randomized experiment with a nationwide sample of 11,424 high school graduates, we find that providing information on the benefits of a meta-major significantly increased students’ willingness to choose the meta major; however, information about specific majors and assignment mechanisms did not affect student major choice preferences. We also find that information provision mostly affected the preferences of students who were from disadvantaged backgrounds, lacked accurate information, did not have clear major preferences, or were risk loving.