Search for EdWorkingPapers here by author, title, or keywords.
Educator preparation, professional development, performance and evaluation
Recent interest to promote and support replication efforts assume that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our general approach is derived from the Causal Replication Framework (CRF), which formalizes the assumptions under which replication success can be expected. The assumptions may be understood broadly as replication design requirements and individual study design requirements. Replication failure occurs when one or more CRF assumptions are violated. In design-based approaches to replication, CRF assumptions are systematically tested to evaluate the replicability of effects, as well as to identify sources of effect variation when replication failure is observed. In direct replication designs, replication failure is evidence of bias or incorrect reporting in individual study estimates, while in conceptual replication designs, replication failure occurs because of effect variation due to differences in treatments, outcomes, settings, and participant characteristics. The paper demonstrates how multiple research designs may be combined in systematic replication studies, as well as how diagnostic measures may be used to assess the extent to which CRF assumptions are met in field settings.
Despite calls for more evidence regarding the effectiveness of teacher education practices, causal research in the field remains rare. One reason is that we lack designs and measurement approaches that appropriately meet the challenges of causal inference in the context of teacher education programs. This article provides a framework for how to fill this gap. We first outline the difficulties of doing causal research in teacher education. We then describe a set of replicable practices for developing measures of key teaching outcomes, and propose causal research designs suited to the needs of the field. Finally, we identify community-wide initiatives that are necessary to advance effectiveness research in teacher education at scale.
COVID-19 shuttered schools across the United States, upending traditional approaches to education. We examine teachers’ experiences during emergency remote teaching in the spring of 2020 using responses to a working conditions survey from a sample of 7,841 teachers across 206 schools and 9 states. Teachers reported a range of challenges related to engaging students in remote learning and balancing their professional and personal responsibilities. Teachers in high-poverty and majority Black schools perceived these challenges to be the most severe, suggesting the pandemic further increased existing educational inequities. Using data from both pre-post and retrospective surveys, we find that the pandemic and pivot to emergency remote teaching resulted in a sudden, large drop in teachers’ sense of success. We also demonstrate how supportive working conditions in schools played a critical role in helping teachers to sustain their sense of success. Teachers were less likely to experience declines in their sense of success when they worked in schools with strong communication, targeted training, meaningful collaboration, fair expectations, and authentic recognition during the pandemic.
Although the Janus v. AFCSME (2018) decision fundamentally changed the institutional context for U.S. teachers’ unions by placing all public school teachers in a “Right to Work” (RTW) framework, little research exists to conceptualize the effects of such policies that hinder unionization. To fill this gap, I exploit the different timing across states in the passage of RTW policies in a differences-in-differences framework to identify how exposure to a RTW policy affects students, teachers, and education policymaking. I find that RTW policies lead to declines in teachers’ union power, but contrary to what many union critics have argued, I find that efforts to weaken unions did not result in political opportunities for education reforms nor did they improve student achievement outcomes.
We show that fade out biases value-added estimates at the teacher-level. To do so, we use administrative data from North Carolina and show that teachers' value-added depend on the quality of the teacher that preceded them. Value-added estimators that control for fade out feature no such teacher-level bias. Under a benchmark policy that releases teachers in the bottom five percent of the value-added distribution, fifteen percent of teachers released using traditional techniques are not released once fade out is accounted for. Our results highlight the importance of incorporating dynamic features of education production into the estimation of teacher quality.
Teachers are among the most important school-provided determinants of student success. Effective teachers improve students’ test scores as well as their attendance, behavior, and earnings as adults. However, students do not enjoy equal access to effective teachers. This article reviews some of the key challenges associated with teacher policy confronted by school leaders and education policymakers, and how the tools of applied economics can help address those challenges. The first challenge is that identifying effective teachers is difficult. Economists use value-added models to estimate teacher effectiveness, which works well in certain circumstances, but should be just one piece of a multi-measure strategy for identifying effective teachers. We also discuss how different policies, incentives, school characteristics, and professional-development interventions can increase teacher effectiveness; this is important, as schools face the daunting challenge of hiring effective teachers, helping teachers to improve, and removing ineffective teachers from the classroom. Finally, we discuss the supply and mobility of teachers, including the consequences of teacher absenteeism, the distribution of initial teaching placements, and the characteristics and preferences of those who enter the profession.
This study investigates the influence of principal tenure on the retention rates of the teachers they hire over time. We analyzed the hiring practices and teacher retention rates of 11,717 Texas principals from 1999 to 2017 employing both individual and year fixed effects. Main findings indicate that a principal who stays in the same school for at least three years begins to hire teachers who stay to both three- and five-year benchmarks at increasingly higher rates. However, the average Texas principal leaves a school after four years and while we do find small positive gains in the initial retention rates of teachers at the next school, the majority of principal improvement in teacher retention does not appear to be portable.
We study an early effort amid the Covid-19 pandemic to develop new approaches to virtually serving students, supporting teachers, and promoting equity. This five-week, largely synchronous, summer program served 11,769 rising 4th-9thgraders. “Mentor teachers” provided PD and videos of themselves teaching daily lessons to “partner teachers” across the country. We interviewed a representative sample of teachers and analyzed educator, parent, and student surveys. Stakeholders perceived that students made academic improvements, and the content was rigorous, relevant, and engaging. Teachers felt their teaching improved and appreciated receiving adaptable curricular materials. Participants wanted more relevant math content, more differentiated development, and less asynchronous movement content. Findings highlight promising strategies for promoting online engagement and exploiting virtual learning to strengthen teacher development.
Researchers have noted the importance of equity-based approaches to social and emotional learning (SEL), which emphasize the role of school environment, including adult beliefs, in student well-being. This article builds on this work by examining 129 teachers’ perceptions of efficacy in SEL. While participants worked in urban schools, were selected from national fellowship programs, and had similar years of experience and preparation, survey data found that teachers in one program reported higher levels of efficacy in SEL. Interviews and observations with a purposeful sample of these teachers found that despite common challenges with exclusionary discipline practices and limited resources, efficacious teachers described a “social justice learning community,” geared for teachers of color, that enhanced their capacities to enact SEL in their schools. Discussion includes the need for critical professional development opportunities in SEL that are race-conscious, context-specific, and asset-based, as well as opportunities for teachers from historically marginalized groups to form specialized learning communities.
At least sixteen US states have taken steps toward holding teacher preparation programs (TPPs) accountable for teacher value-added to student test scores. Yet it is unclear whether teacher quality differences between TPPs are large enough to make an accountability system worthwhile. Several statistical practices can make differences between TPPs appear larger and more significant than they are. We reanalyze TPP evaluations from 6 states—New York, Louisiana, Missouri, Washington, Texas, and Florida—using appropriate methods implemented by our new caterpillar command for Stata. Our results show that teacher quality differences between most TPPs are negligible—.01-.03 standard deviations in student test scores—even in states where larger differences were reported previously. While ranking all a state’s TPPs may not be possible or desirable, in some states and subjects we can find a single TPP whose teachers stand out as significantly above or below average. Such exceptional TPPs may reward further study.