Search for EdWorkingPapers here by author, title, or keywords.
Multiple outcomes of education
This paper describes and evaluates a web-based coaching program designed to support teachers in implementing Common Core-aligned math instruction. Web-based coaching programs can be operated at relatively lower costs, are scalable, and make it more feasible to pair teachers with coaches who have expertise in their content area and grade level. Results from our randomized field trial document sizable and sustained effects on both teachers’ ability to analyze instruction and on their instructional practice, as measured the Mathematical Quality of Instruction (MQI) instrument and student surveys. However, these improvements in instruction did not result in corresponding increases in math test scores as measured by state standardized tests or interim assessments. We discuss several possible explanations for this pattern of results.
The Milwaukee Parental Choice Program (MPCP), the first modern private school choice program in the United States, has grown from 341 students attending 7 private schools in 1990 to 27,857 students attending 126 private schools in 2019. The MPCP has been subject to extensive study focused largely on student performance on standardized tests. This study presents new data on the college enrollment, persistence, and graduation of MPCP and MPS students who were tracked over 12 years beginning in 2006. MPCP participants are compared with a matched sample of MPS students who lived in the same neighborhood and had similar demographic characteristics and test scores at the beginning of the study. The collective evidence in this paper indicates that students in the MPCP program have greater educational attainment than the comparison group, as measured by college experience and outcomes. Most of the college attainment benefits of the MPCP are clear for both students who were in ninth grade at the beginning of the study, for whom positive attainment effects have previously been reported, and students who were initially enrolled in grades three through eight, who we examine here for the first time. As of 2018, MPCP students have spent more total years in a four-year college than their MPS peers. The MPCP students in the grade three through eight sample attained college degrees at rates that are statistically significantly higher than their matched MPS peers.
We examine the effect of admission to 16 stand-alone technical high schools within the Connecticut Technical High School System (CTHSS) on student educational and labor market outcomes. To identify the causal effect of admission on student outcomes, we exploit the fact that CTHSS utilizes a score-based admissions system and identify the effect of admission using a regression discontinuity approach. We find that male students attending one of the technical high schools are approximately 10 percentage points more likely to graduate from high school and 8 percentage points less likely to attend college, although there is some evidence that the negative effects on college attendance fade over time. We also find that male students attending a technical high school have quarterly earnings that are approximately 31% higher. Analyses of potential mechanisms behind these results reveal that male students that attend a technical high school have higher 9th grade attendance rates and higher 10th grade test scores. We find little evidence that attending a technical high school affects the educational or labor outcomes of women. These effects appear relatively broad based across different types of students in that we find little evidence of heterogeneity in these effects over student attributes like race and ethnicity, free lunch eligibility or residence in a poor, central city school district. However, when distinguishing between students based on the Career and Technical Education (CTE) offerings of the high school that these students likely would have attended, we find that the effects of admission to a CTHSS school are noticeably larger when the counterfactual high school has less CTE offerings.
Using novel variation in special education and English Language Learner classification from admissions lotteries, I find that students can achieve large academic gains without specialized services. Enrolling in a Boston charter school doubles the likelihood that students lose their special education or English Language Learner status, but exposes students to a high-performing general education program that includes high intensity tutoring, data driven instruction, and increased instructional time. The positive effects extend to college: charters nearly double the likelihood that English Language Learners enroll in four-year colleges and quadruple the likelihood that special education students graduate from two-year college. A multiple instrument strategy suggests that high quality general education practices drive the gains and finds no detrimental effect from lower classification rates.
New advances in neurobiology are revealing that brain development and the learning it enables are directly dependent on social-emotional experience. Growing bodies of research reveal the importance of socially-triggered epigenetic contributions to brain development and brain network configuration, with implications for social-emotional functioning, cognition, motivation and learning. Brain development is also impacted by health-related and physical developmental factors, such as sleep, toxin exposure, and puberty, which in turn influence social-emotional functioning and cognition. An appreciation of the dynamic interdependencies of social-emotional experience, health-related factors, brain development and learning underscores the importance of a “whole child” approach to education reform, and leads to important insights for research on Social-Emotional Learning (SEL). To facilitate these interdisciplinary conversations, here we conceptualize within a developmental framework current evidence on the fundamental and ubiquitous biological constraints and affordances undergirding SEL-related constructs and learning more broadly. Learning indeed depends on how nature is nurtured.
Student loan borrowing for higher education has emerged as a top policy concern. Policy makers at the institutional, state, and federal levels have pursued a variety of strategies to inform students about loan origination processes and how much a student has cumulatively borrowed, and to provide students with greater access to loan counseling. We conducted an experiment to evaluate the impact of an outreach campaign that prompted loan applicants at a large community college to make informed and active borrowing decisions and that offered them access to remote, one-onone assistance from a loan counselor. The intervention led students to reduce their unsubsidized loan borrowing by 7 percent, resulted in worse academic performance, and increased the likelihood of loan default during the three years after the intervention occurred. Our results suggest policy makers and higher education leaders should carefully examine the potential unintended consequences of efforts to reduce student borrowing, particularly in light of growing evidence regarding the counter-intuitive positive relationship between reduced borrowing levels and worse student academic and financial outcomes.
This paper considers an unavoidable feature of the school environment – what are the long run effects of a student’s ordinal rank in elementary school? Using administrative data from all public school students in Texas, we show that students with a higher third grade academic rank, conditional on ability and classroom fixed effects, have higher subsequent test scores, are more likely to take AP classes, to graduate high school, and to enroll in college, and ultimately have higher earnings 19 years later. The paper concludes by exploring the tradeoff between higher quality schools and higher rank in the presence of these rank-based peer effects.
In recent decades, institutions, teachers, and students report a decline in field trip attendance. The impact of this decline on educational and societal outcomes such as social-emotional skill acquisition is unknown. Social-emotional learning (SEL) are skills thought to be important to life and relationship success and are associated with better long-term student outcomes. This study describes the results of the first-ever longitudinal experiment of the effects of multiple arts-related field trips on elementary school students of color in a large urban school district. Treated students attended three field trips to an art museum, a live theater production, and a symphony performance. We find significant educational benefits from attending multiple arts field trips on social-emotional outcomes, including increased feelings of tolerance and social perspective taking. Our findings also suggest that female treatment students exhibit increased conscientiousness as compared to their control group peers; however, these effects dissipate when treatment ceases. Further, female students who receive three additional field trips in a second treatment year act more conscientious than in the prior year of treatment. Increased exposure to the arts through field trip experiences does not, however, appear to increase students’ desire to consume or participate in the arts, nor do we find an impact of treatment on empathy. These findings suggest that arts-related field trips elicit meaningful changes in students’ social-emotional attitudes and actions and that a decline in field trip attendance may be detrimental.
Field trips to see theater performances are a long-standing educational practice, however, there is little systematic evidence demonstrating educational benefits. This article describes the results of five random assignment experiments spanning two years where school groups were assigned by lottery to attend a live theater performance, or for some groups, watch a movie-version of the same story. We find significant educational benefits from seeing live theater, including higher levels of tolerance, social perspective taking, and stronger command of the plot and vocabulary of those plays. Students randomly assigned to watch a movie did not experience these benefits. Our findings also suggest that theater field trips may cultivate the desire among students to frequent the theater in the future.
The rise of accountability standards has pressed higher education organizations to oversee the production and publication of data on student outcomes more closely than in the past. However, the most common measure of student outcomes, average bachelor's degree completion rates, potentially provides little information about the direct impacts of colleges and universities on student success. Extending scholarship in the new institutionalist tradition, I hypothesize that higher education organizations today exist as, “superficially coupled systems,” where colleges closely oversee their technical outputs but where those technical outputs provide limited insight into the direct role of colleges and universities in producing them. I test this hypothesis using administrative data from the largest, public, urban university system in the United States together with fixed effects regression and entropy balancing techniques, allowing me to isolate organizational effects. My results provide evidence for superficial coupling, suggesting that inequality in college effectiveness exists both between colleges and within colleges, given students' racial background and family income. They also indicate that institutionalized norms surrounding accountability have backfired, enabling higher education organizations, and other bureaucratic organizations like them, to maintain legitimacy without identifying and addressing inequality.