Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Post-secondary education

Matthew Baird, Robert Bozick, Melanie Zaber.

Occupational credentials provide an additional—and, at times, alternative—path other than traditional academic degrees for individuals to increase productivity and demonstrate their abilities and qualifications to employers. These credentials take the form of licenses and certifications. Although a critical part of the workforce landscape, the literature on the returns to credentials is inadequate, with prior research having limited causal identification, typically relying on OLS regressions which do not sufficiently control for selection. Using questions that identify credential receipt from the 2015 and 2016 Current Population Surveys, we construct an instrumental variable of local peer influence using the within-labor market credential rate of individuals sharing the same sociodemographic characteristics, while controlling for the same group’s average wages and a suite of demographic and geographic controls. We use this instrument in a marginal treatment effects estimator, which allows for estimation of the average treatment effect and determines the direction of selection, and we estimate the effects of credentials on labor market outcomes. We find large, meaningful returns in the form of increased employment, an effect which is concentrated primarily among women. The effect of having a credential on log wages is higher for those in the sub-baccalaureate labor market, suggesting the potential role of occupational credentials as an alternative path to marketable human capital and a signal of skills in the absence of a bachelor’s degree.

More →

Dennis A. Kramer II, Christina Lamb, Lindsay C. Page.

We explore the role of defaults and choice architecture on student loan decision-making, experimentally testing the impact pre-populating either decline or accept decisions compared to an active choice, no pre-population, decision. We demonstrate that the default choice presented does influence student loan borrowing decisions. Specifically, compared to active choice, students presented within a pre-populated decline decision were almost five percent less likely to accept all packaged loans and borrowed between 4.6 and 4.8 percent less in federal educational loans. The reductions in borrowing appears to be concentrated within unsubsidized loans with those assigned to the opt-in condition borrowing 8.3 percent less in unsubsidized loans. These changes in borrowing did not induce substitution towards private or Parent PLUS loans nor did they negatively impact enrollment, academic performance, or on-campus work outcomes in the same academic year.

More →

James D. Paul, Albert Cheng, Jay P. Greene, Josh B. McGee.

Employers may favor applicants who played college sports if athletics participation contributes to leadership, conscientiousness, discipline, and other traits that are desirable for labor-market productivity. We conduct a resume audit to estimate the causal effect of listing collegiate athletics on employer callbacks and test for subgroup effects by ethnicity, gender, and sport type. We applied to more than 450 jobs on a large, well-known job board. For each job listing we submitted two fictitious resumes, one of which was randomly assigned to include collegiate varsity athletics. Overall, listing a college sport does not produce a statistically significant change in the likelihood of receiving a callback or interview request. However, among non-white applicants, athletes are 3.2 percentage points less likely to receive an interview request (p = .04) relative to non-athletes. We find no statistically significant differences among males or females.

More →

Alex Eble, Feng Hu.

The quality of college education is hard for students and employers to observe. Knowing this, colleges often change their names to signal higher quality while leaving other features unchanged. We study how these changes affect college choice and labor market performance of college graduates. Using administrative data, we show that name-changing colleges attract more qualified applicants, with larger effects among applicants who have less information about the college. Text from web discussion boards reveals many college applicants lack important information about colleges. A resume audit study shows employers possess nearly perfect information about how college name changes affect student aptitude.

More →

Matthew D. Baird, John Engberg, Isaac M. Opper.

We consider the case in which the number of seats in a program is limited, such as a job training program or a supplemental tutoring program, and explore the implications that peer effects have for which individuals should be assigned to the limited seats. In the frequently-studied case in which all applicants are assigned to a group, the average outcome is not changed by shuffling the group assignments if the peer effect is linear in the average composition of peers. However, when there are fewer seats than applicants, the presence of linear-in-means peer effects can dramatically influence the optimal choice of who gets to participate. We illustrate how peer effects impact optimal seat assignment, first under a general social planner utility function and then from both an efficiency and an equity perspective. We next use data from a recent job training RCT to provide the first evidence of large peer effects in the context of job training for disadvantaged adults. Finally, we combine the two results to show that the program's effectiveness varies greatly depending on whether the assignment choices account for or ignore peer effects. 

More →

Vivian C. Wong, Kylie L. Anglin, Peter M. Steiner.

Recent interest to promote and support replication efforts assume that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our general approach is derived from the Causal Replication Framework (CRF), which formalizes the assumptions under which replication success can be expected. The assumptions may be understood broadly as replication design requirements and individual study design requirements. Replication failure occurs when one or more CRF assumptions are violated. In design-based approaches to replication, CRF assumptions are systematically tested to evaluate the replicability of effects, as well as to identify sources of effect variation when replication failure is observed. In direct replication designs, replication failure is evidence of bias or incorrect reporting in individual study estimates, while in conceptual replication designs, replication failure occurs because of effect variation due to differences in treatments, outcomes, settings, and participant characteristics. The paper demonstrates how multiple research designs may be combined in systematic replication studies, as well as how diagnostic measures may be used to assess the extent to which CRF assumptions are met in field settings.    

More →

10/2020476.4 KB
01/2021560.99 KB

Matt S. Giani, Allison Martin.

Developmental education, in which college students deemed unprepared for college-level coursework enroll in non-credit bearing courses, is widespread in American higher education. The current study evaluates the effect of mobile app courseware on the college outcomes of developmental education students, using a research design which randomly assigned course sections to receive access to the apps or not. The results show that access to the apps significantly improved student performance in developmental education outcomes, marginally improved medium-term college persistence and performance, but did not effect credential attainment in the study timeframe. Despite a number of barriers to implementation, the results suggest the intervention has the potential to improve the short-term outcomes of developmental education students in addition to being low-cost and scalable.

More →

Stephanie Riegg Cellini, Hernando Grueso.

We draw on administrative data from the country of Colombia to assess differences in student learning in online and traditional on-campus college programs. The Colombian context is uniquely suited to study this topic, as students take an exit examination at the end of their studies. We can therefore directly compare performance on the exit exam for students in online and on-campus programs both across and within institutions, degrees, and majors. Using inverse probability weighting methods based on a rich set of background characteristics coupled with institution-degree-major fixed effects, our results suggest that bachelor’s degree students in online programs perform worse on nearly all test score measures (including math, reading, writing, and English) relative to their counterparts in on-campus programs. Results for shorter technical certificates are more mixed.  While online students perform significantly worse than on-campus students on exit exams in private institutions, they perform better in SENA—the main public vocational institution in the country.

More →

Rachel Baker, Elizabeth Friedmann, Michal Kurlaender.

The transfer between two-year and four-year colleges is a critical path to baccalaureate attainment. Yet, students face a number of barriers in transfer pathways, including a lack of coherent coordination and articulation between their community colleges and four-year institutions, resulting in excess units and increased time to degree. In this paper we evaluate the impact of California’s Student Transfer Achievement Reform Act, which aimed to create a more seamless pathway between the Community Colleges and the California State University. We investigate whether the reform effort met its intended goal of improving baccalaureate receipt, and greater efficiency in earning these degrees, among community college transfer students. We tease out plausibly causal effects of the policy by leveraging the exogenous variation in the timing of the implementation of the reform in different campuses and fields of study. We find that this reform effort has led to significant reductions in time to baccalaureate receipt among community college transfers and reduced total unit accumulation. These positive effects were shared across all student subgroups.

More →

Michel Grosz.

I study how postsecondary admission policies affect the composition and subsequent academic outcomes of new cohorts. I leverage the staggered replacement of lotteries and waitlists at California's community college nursing programs with admissions that rely on grades, work experience, and other measures. The change in admissions increased the average prior academic performance of incoming cohorts, but did not improve academic outcomes such as completion rates or pass rates on the national licensing exam. I find suggestive evidence that the change in admissions decreased the share of new students who were not White, but by small amounts. The change in admissions also substantially reduced the time students spent waiting between taking prerequisite coursework and entering the nursing programs.

More →