What Counts in Calculating School and District Level Performance Index Scores: A Summary and Analysis of Academic Performance Index Metrics across the 50 States

The purpose of this report is to summarize the key elements of school and district level Performance Index scores (PI scores) for the 50 states and the District of Columbia (D.C.) across the United States. PI scores are partial or overall summative ratings of schools or districts currently used across US state accountability systems to assess organizational performance. In this study, we first extracted 14 elements from 49 PI calculation metrics for states in the U.S and conducted a descriptive analysis to provide an overview of which data elements are used across the different calculation metrics for each state and what role PI scores play in state accountability systems. Second, we categorized the fourteen elements into seven categories proposed by the most recent ESSA regulations (81 FR 34539 §200.14-16, 2016) and examined how each state integrated each element in their PI score calculations. Third, we conducted a multidimensional scaling (MDS) analysis to compare the similarities and differences of PI calculation metrics across the states. The results indicate that there are few commonalities in PI score calculation metrics across the states, as each state has its own methods in addressing the requirements of NCLB and now ESSA. The goal of this report is to inform decisions across states on PI score calculations through summarizing overall ratings and metrics nationally used to hold schools and districts accountable as states move toward implementing the recent Every Child Succeeds Act (ESSA) regulations. Keywords: Accountability, School District, Evaluation, Assessment, Performance Index