- Home
- Brendan Bartanen
Search EdWorkingPapers
Search EdWorkingPapers by author, title, or keywords.
Search
Brendan Bartanen
School principals are viewed as critical actors to improve student outcomes, but there remain important methodological questions about how to measure principals’ effects. We propose a framework for measuring principals’ contributions to student outcomes and apply it empirically using data from Tennessee, New York City, and Oregon. As commonly implemented, value-added models misattribute to principals changes in student performance caused by unobserved time-varying factors over which principals exert minimal control, leading to biased estimates of individual principals’ effectiveness and an overstatement of the magnitude of principal effects. Based on our framework, which better accounts for bias from time-varying factors, we find that little of the variation in student test scores or attendance is explained by persistent effectiveness differences between principals. Across contexts, the estimated standard deviation of principal value-added is roughly 0.03 student-level standard deviations in math achievement and 0.01 standard deviations in reading.
Novice teachers improve substantially in their first years on the job, but we know remarkably little about the nature of this skill development. Using data from Tennessee, we leverage a feature of the classroom observation protocol that asks school administrators to identify an item on which the teacher should focus their improvement efforts. This “area of refinement” overcomes a key measurement challenge endemic to inferring from classroom observation scores the development of specific teaching skills. We show that administrators disproportionately identify two teaching skills when observing novice teachers: classroom management and presenting content. Struggling with classroom management, in particular, is linked to high rates of novice teacher attrition. Among those who remain, we observe subsequent improvement in these skills.
Heightened concerns about the health of the teaching profession highlight the importance of studying the early teacher pipeline. This exploratory, descriptive paper examines preservice teachers' (PST) expressed motivation for pursuing a teaching career and its relationship with PST characteristics and outcomes. Using data from one of the largest teacher education programs in Texas, we use a natural language processing algorithm to categorize into topical groups roughly 2,800 essay responses to the prompt, "Explain why you decided to become a teacher.'' We identify 11 topics that largely reflect altruistic and intrinsic (though not extrinsic) reasons for teaching. The frequency of motivation topics varied substantially by PST gender, race/ethnicity, and certification area. While topics collectively explained little of the variance in PST outcomes, we found preliminary evidence that intrinsic enjoyment of teaching and prior experiences with adversity predicted higher performance during clinical teaching and lower attrition as a full-time K–12 teacher.
A growing literature uses value-added (VA) models to quantify principals' contributions to improving student outcomes. Principal VA is typically estimated using a connected networks model that includes both principal and school fixed effects (FE) to isolate principal effectiveness from fixed school factors that principals cannot control. While conceptually appealing, high-dimensional FE regression models require sufficient variation to produce accurate VA estimates. Using simulation methods applied to administrative data from Tennessee and New York City, we show that limited mobility of principals among schools yields connected networks that are extremely sparse, where VA estimates are either highly localized or statistically unreliable. Employing a random effects shrinkage estimator, however, can alleviate estimation error to increase the reliability of principal VA.
Strengthening teacher supply is a key policy objective for K–12 public education, but understanding of the early teacher pipeline remains limited. We leverage the universe of applications to a large public university in Texas from 2009–2020 to examine the pipeline into teacher education and employment as a K–12 public school teacher. A unique feature of Texas's centralized higher education application is it solicits potential interest in teacher certification. We document sharply declining interest in teaching over the period. Further, we show that nonwhite, male, and high-achieving students are substantially underrepresented in teacher education. Particularly for race/ethnicity, these disparities are only partially explained by differences in interest at application.
High rates of principal turnover nationally mean that school districts constantly are called on to recruit and select new principals. The importance of a school’s principal makes choosing candidates who will be effective paramount, yet we have little evidence linking information known to school districts at time of selection to principal’s future job performance. Using data from Tennessee, we test the degree to which observable information about novice principals from prior to entry, including qualifications, work history information, and effectiveness in prior roles, predicts practice ratings assigned to them in their initial years in the principalship. We find that educational attainment and years of experience in other jobs hold little predictive power. Performance ratings received as an assistant principal (AP) or teacher, however, do predict principal effectiveness. Moreover, APs who previously worked in schools with highly rated principals are more likely to be effective upon transitioning into the principalship.
Assistant principals are important education personnel, both as essential members of school leadership teams and apprentice principals. However, empirical evidence on their career outcomes remains scarce. Using statewide administrative data from Tennessee and Missouri, we provide the first comprehensive analysis of AP mobility. While prior work focuses only on AP promotions into principal positions, we also account for APs who exit school leadership and transfer to a different school. We find yearly mobility rates of 25–28%, with 10% of APs leaving school leadership, 7.5% changing schools, and 7.5–10% becoming principals. We also document a strong relationship between AP mobility and principal turnover, where higher-performing APs are substantially more likely to replace their departing principal. Principal transitions also appear to increase the likelihood that APs exit school leadership and change schools, highlighting an additional cost of high rates of principal churn.
Using rich longitudinal data from one of the largest teacher education programs in Texas, we examine the measurement of pre-service teacher (PST) quality and its relationship with entry into the K–12 public school teacher workforce. Drawing on rubric-based observations of PSTs during clinical teaching, we find that little of the variation in observation scores is attributable to actual differences between PSTs. Instead, differences in scores largely reflect differences in the rating standards of field supervisors. We also find that men and PSTs of color receive systematically lower scores. Finally, higher-scoring PSTs are slightly more likely to enter the teacher workforce and substantially more likely to be hired at the same school as their clinical teaching placement.
Using statewide data from Tennessee over more than a decade, this paper estimates the job performance returns to principal experience as measured by student, teacher, and principal outcomes. I find that principals improve substantially over time, evidenced by higher student achievement, higher ratings from supervisors, and lower rates of teacher turnover. However, improvement in student achievement as principals gain experience does not carry over when principals change schools. The returns to school-specific experience are largest for principals in high-poverty schools, highlighting the potential benefits of policies to improve the recruitment and retention of high-quality leaders in hard-to-staff environments.
Exploiting variation from principal and teacher transitions over long administrative data panels in Missouri and Tennessee, we estimate the effects of principal race on the hiring and turnover of racially diverse teachers. Evidence from the two states is strikingly similar. Black principals increase the probability that a newly hired teacher is Black by 5–7 percentage points. This result appears to be partially driven by principals hiring from within their networks of educators with whom they have worked before. Black principals also decrease Black teacher mobility, reducing the probability that a Black teacher changes schools by 2–5 percentage points. Increases in Black teacher hiring and reductions in turnover mean that a change from a White to a Black principal increases the fraction of Black teachers working in a school by about 3 percentage points, on average, increasing exposure of students to Black teachers. Further evidence suggests that assignment to a Black teacher increases the math achievement of Black students, though the presence of a Black principal appears to have positive impacts on Black students’ math achievement that is not explained by assignment to Black teachers.