Test-based accountability: Time to wobble?

Minority and special-ed students made significant gains once states and then No Child Left Behind began holding schools accountable for their performance, argues Bush adviser Sandy Kress in a New York Daily News op-ed. Kress accuses President Obama of going “wobbly” on  accountability.

Under the framework being proposed for the reform of the law, the administration would require that, unless a school is among the very worst in the nation, it would no longer be required to improve even if it continues to fail its black, Hispanic and other disadvantaged kids. Further, in the case of schools that do not improve, special tutoring and public school choice would no longer be required.

In Fact-checking Sandy Kress, Fordham’s Mike Petrilli argues that nearly all the improvement occurred by 2004, less than two years after NCLB was implemented.

For instance, according to the NAEP, the average reading score for Black 9-year olds rose from 186 in 1999 to 204 in 2008–an increase of 18 points. (At 10 points per grade level that comes close enough to the “two grade levels” of progress Kress claims.) Hispanic 9-year olds increased their average reading scores from 213 in 1999 to 234 in 2008–an increase of 21 points. Fourth-grade students with disabilities increased their reading scores from 167 in 2000 to 189 in 2009.

. . . For Black 9-year-olds, 78 percent of the improvement took place in the five years between 1999 and 2004, compared to 22 percent in the four years between 2004 and 2008. For Hispanic students, 81 percent of the gains occurred between 1999 and 2004, compared to 19 percent between 2004 and 2008. For fourth-grade students with disabilities, 91 percent of the gains occurred in just two years: between 2000 and 2002.

While there’s “plausible evidence to credit accountability-based reforms,” writes Petrilli, NCLB can’t claim much credit since it didn’t start till fall of 2002.

Petrilli thinks the states’ accountability measures boosted student achievement in the late 1990s to early 2000s. NCLB jumped on a moving bandwagon. “To me, the evidence shows that NCLB and test-based accountability had their day in the sun, and made a big difference, but now it’s time to try something else if we want to see progress continue.”

Kress responds in an e-mail with more NAEP data:

Let’s deal with the easy part – gains on the Long Term Trend for students with disabilities (SWDs) and English Language Learners (ELLs) from 2004-2008. This is squarely within NCLB time.

9 year old SWDs improved a half grade level (5 points) in reading.

9 year olds ELLs improved almost a grade level (8 points) in reading.

9 year old SWDs improved over a half grade level (6 points) in math.

9 year old ELLs improved 3 points in math.

13 year old SWDs improved 3 points in math.

13 year old ELLs improved over a half grade level (7 points) in math.

13 year old SWDs improved almost a full grade level (9 points) in reading.

13 year old ELLs improved 2 points in reading.

Now, since Mike is enamored of the Main NDE, let’s look at that data:

For 4th grade math, it is true that SWDs had an incredible jump from 2000 to 2003, from 200 to 216. I don’t want to argue this was due to NCLB, but, since there’s almost a full academic year since the summer of 2002 in this data, I would suggest that this bridge period probably shouldn’t be used for a pre and post analysis.

In any event, 4th grade SWDs have gone up 7 points since 2003, which is a gain of over a half a grade level. 4th grade ELLs had that nice pop in 2003, too, but also have grown an additional half grade level since.

It is incontestable that something unusual happened in NAEP testing between the late 1990s and 2002 and 2003, first a drop and then an unusual increase. I can’t explain it, and I suspect Mike can’t either. I invite thoughts from any and all of you on that topic.

Nevertheless, it is heartening to see that 4th grade ELLs have improved over a half grade level in reading since 2002, and SWDs have improved almost a half grade level as well.

The same pattern of a pop in 2003 occurs in 8th grade math with further gains for SWDs and ELLs after 2003. Reading at the 8th grade level is stagnant.

“Consequential accountability, which began in many states in the mid-1990s and was extended and deepened by NCLB, works!” Kress writes. “Any weakening of its pillars threatens the progress we’ve made.”

Racing to the top

The “Race to the Top” — $4.35 billion in federal funding to push education reform — starts today.

States must let student test scores be used to evaluate teachers and principals,  writes Michele McNeil in Education Week. That would force California and New York to change state law to qualify for funds.

This is Education Reform’s Moon Shot, writes Education Secretary Arne Duncan in a Washington Post op-ed. The department’s never had this much money to hand out before. There are 19 points, but four basic ideas are critical:

– To reverse the pervasive dumbing-down of academic standards and assessments by states, Race to the Top winners need to work toward adopting common, internationally benchmarked K-12 standards that prepare students for success in college and careers.

– To close the data gap — which now handcuffs districts from tracking growth in student learning and improving classroom instruction — states will need to monitor advances in student achievement and identify effective instructional practices.

– To boost the quality of teachers and principals, especially in high-poverty schools and hard-to-staff subjects, states and districts should be able to identify effective teachers and principals — and have strategies for rewarding and retaining more top-notch teachers and improving or replacing ones who aren’t up to the job.

– Finally, to turn around the lowest-performing schools, states and districts must be ready to institute far-reaching reforms, from replacing staff and leadership to changing the school culture.

It’s fair to evaluate teachers based on students’ progress, says President Obama in a Washington Post interview.

So what we can say is that if a kid comes in and they gain two grade levels during the course of that single year, even if they’re still a little behind the national average, that tells us that school is doing a good job.

Linking teacher pay to test scores is a big mistake, argues Robert Pondiscio.  Teachers already focus too much on scores and too little on the big picture.

It’s The Carrot That Feels Like a Stick, writes Mike Petrilli on Flypaper. He likes the reform ideas but dislikes the Washington Knows Best tone. If the states are forced to go along, they’ll implement reforms half-heartedly.

This is a draft, not the final proposal, so it’s possible the administration will bend on some of its 19 points.

Eduwonk hopes the department will hold the line, denying grants to states that aren’t serious about change. He notes NEA president Dennis Van Roekel claims to be “absolutely in sync with where they’re going,” except for performance pay, charter schools and linking student and teacher data.  Eduwonk writes:

It’s akin to saying they’re on board with Duncan’s ”moon shot” except for the parts about rockets, rocket fuel, astronauts, engineers, and mission control.

Michael Umphrey wants students and parents to change — or else.

(Obama) could send the school money directly to the parents in the form of vouchers, threatening to cut it off if the kids grades don’t improve. He could turn off cell phone service for kids whose GPA drops below C. He could give each honor student one of those unsold General Motors cars while revoking drivers licenses for any student who gets an F.

Hmmm. Would a GM car be a sufficient motivator?

It’s difficult to figure out how much a teacher or a principal has contributed to students’ learning.  I think we’re in the early stages of figuring this out, not in the so-obvious-everyone-should-do-it stage.