Court paves the way for N.Y.C. to release data linking teachers, test scores
The ruling would allow the New York City school district to release teacher data, which factor in students' test scores. If the release goes forward, it will be the largest such case in the US.
The ruling would allow the New York City school district to release performance rankings for more than 12,000 of its teachers to the media outlets that have requested the information.
The local teachers union, which sought to block release of the records, is appealing the decision, but if the information is released, it will be the largest such case in the United States.
The performance ratings are tied to â€śvalue addedâ€ť data that link individual teachers with their studentsâ€™ improvement on tests.
The method is lauded by some as the most objective measure for determining teacher effectiveness and decried by others who see it as riddled with errors. It is at the center of a growing debate about the merit of putting such data in the hands of the public â€“ set off by the Los Angeles Timesâ€™s decision last summer to publish a database of individual teachers based on similar rankings.
â€śThis sort of public naming and shaming is thought of by some as a good way to help parents understand the quality of teachers in their schools,â€ť says Kevin Welner, co-director of the National Education Policy Center at the University of Colorado in Boulder, which on Monday released a policy brief calling into question the degree to which teacher quality can be determined by value-added data. â€śBut unless you make a lot of assumptions and just look at top rank versus bottom rank, [using value-added models to evaluate teachers] is almost like throwing a dart at a dartboard. Thatâ€™s really troubling if youâ€™re talking about a high-profile public announcement of where teachers rank.â€ť
Still, while few believe value-added data should be the only way teachers are evaluated, many researchers point to the information as the most accurate way possible to gauge a teacherâ€™s effects on his or her students. More and more, it is becoming a piece of official teacher evaluations.
In its Race to the Top contest, the Obama administration offered incentives for districts and states to begin tying teacher evaluations to student test scores. In Washington, D.C., the district fired several hundred teachers last year for poor performance, based in part on their studentsâ€™ value-added test scores. In New York, the city doesnâ€™t currently use the data in teacher evaluations, but beginning in 2013, they will count for 25 percent of a teacherâ€™s performance evaluation.
The rankings at issue in this court case â€“ called the teacher data reports (TDRs) â€“ were developed four years ago for more than 12,000 of the cityâ€™s 80,000 public-school teachers as part of a pilot project.
At the time, the district promised to keep those ratings private, but in her ruling, New York State Supreme Court Justice Cynthia Kern said that the promise doesnâ€™t matter.
She emphasized that she was not ruling on whether the teacher data reports should be released, just whether the Department of Educationâ€™s decision to do so was â€śarbitrary and capricious.â€ť
â€śThe unredacted TDRs may be released regardless of whether or to what extent they may be unreliable or otherwise flawed,â€ť Justice Kern wrote.
Indeed, flaws exist with value-added measures, most experts agree â€“ especially when the measures are tied to individual names or not averaged out over several years.
They can change drastically for any given teacher from year to year; they donâ€™t take into account things like chronic absenteeism, learning gains due to summer school, or supplemental teachers; and in some schools with high mobility rates for students, teachers may even be graded on the performance of students he or she never taught, if they changed schools after the teacher was linked to them in the fall.
But even so, say advocates of the data, they often offer the best picture available of the varying effectiveness from teacher to teacher. And depending how the data are released, making them public may serve some goals.
â€śMore-effective teachers are on average about three times more effective than the least effective teachers,â€ť says Jane Hannaway, director of the Education Policy Center at the Urban Institute in Washington. â€śThere are valid issues about how these effective and ineffective teachers are distributed across schools.â€ť
Ms. Hannaway says that she has concerns with the sort of database of individual teachers that the L.A. Times produced, since the data can be misleading at the individual level and the public may not have the tools to understand the context. Also, the ratings constitute just one piece of what a teacher is doing. But comparing school to school, or looking at average scores and their distribution within districts, could provide valuable information, she says, adding, â€śI donâ€™t think thereâ€™s going to be any way to suppress this information.â€ť
Since the L.A. Times released its database, media outlets have asked several other districts around the country for such data, with mixed results. This court case applies only to New York City, but it may be looked at as a model when similar battles come up.
New Yorkâ€™s teachers union, the United Federation of Teachers, has promised to appeal the decision, and the district wonâ€™t release the rankings until after the appeal. UFT president Michael Mulgrew said in a statement that he was â€śdisappointedâ€ť in the ruling. â€śThe reports, which are largely based on discredited state tests, have huge margins of error and are filled with inaccuracies, will only serve to mislead parents looking for real information,â€ť he said.