The Determined Pessimism of Rick and Mike

September 23, 2010

(Guest Post by Matthew Ladner)

My friends Mike Petrilli and Rick Hess have been either (a) cautioning people about becoming overly optimistic about Waiting for Superman  and our ability to improve K-12 outcomes or (b) ridiculing the idea completely.

Hmmmm…

Let me begin by saying that I am no starry-eyed naif when it comes to the possible impact of the film. I wrote the other day that I am starting to entertain the idea that it might be a big deal. Union reactionaries do find themselves increasingly isolated in K-12 policy discussions, and many of their catspaws will be turned out of office in November.

Let me say in advance however that the unions are not going anywhere. They still control hundreds of millions of dollars, legions of organized activists and all the lobbyists that they care to employ. I’m not claiming that a tipping point has been achieved and it is all downhill from here for them, merely that they are in for what could prove to be a sizeable rough patch.

Where I seem to differ with Mike and Rick is with their seeming determined pessimism regarding the realm of the possible for improvement. Rick and I appeared on a panel together at the State Policy Network a couple of weeks ago, and discussed the same issue.

Readers of this blog find themselves subjected to my battering away with Florida’s NAEP scores on a regular basis. I won’t bother going into the litany because you already know it, so let’s take a couple of other examples where real reform agendas have been instituted, and what has been going on with their NAEP scores.

I pick a couple because, well, only a few exist. You have to be in a position to roll the establishment to do these things, and keep them rolled. Very few have pulled that off. However, the results are encouraging.

I am encouraged that New York City now outscores some statewide averages on NAEP, despite a student body that is 84 percent minority and 85% FRL eligible. NYC kids scored 217 on 4th grade reading in 2009, only 206 in 2002. That’s a meaningful difference, and should embolden Chancellor Klein.

Likewise, DCPS is still an academic blight, but has made substantial progress since the mid 1990s. When my coauthors and I tracked the learning gains of general education low-income students for the 50 states and DC from 2003 to 2009 in all four main NAEP subjects, Florida came in with the biggest gains and DC came in with the second largest gains. Coincidence? I doubt it- both Florida and DC have engaged in far-reaching reforms.

MA is justifiably proud of having the nation’s highest NAEP scores accompanying their standards-led reforms. It has been mentioned before that the usual suspects fiercely opposed their adoption.

Notice that there is no one path up the mountain here-but there are some common threads to the reforms: testing, accountability, choice. So maybe I’m like Ronald Reagan and I just think that there has got to be a pony somewhere in all that manure. It seems to me, however, that there is a pattern here: in the limited number of instances when jurisdictions take control of policy away from the reactionaries, keep it away from them for a sustained period, and implement reforms that they hate, NAEP scores make substantial improvement.

My own experience in interacting with lawmakers, candidates and philanthropists around the country is that they almost all like substantial improvement in NAEP scores. It doesn’t matter whether they are on the right or left or center. The funny thing is that everyone but those directly benefiting from the status-quo seem to not only want improvement, many of them are willing to fight for it.

So have we “cracked the code.” Yes, as a matter of fact, I think a few places have done so. Yes with fantastic difficulty and always imperiled sustainability. The success of reformers is limited and fragile, but very real. If the third largest state in the union doesn’t represent “results at scale” then what pray tell does? 

We have learned a great deal over the past 20 years. Our decisions are being guided less by theory and more by experience. Less and less this is less about “Assume a can opener” and more and more about “You know, they did something like that in X, let’s see what we can learn about the results.”

If throwing money at schools, lowering class sizes, expanding preschool, open classrooms, whole language or <fill in the blank here> had produced these types of results, this blog would not exist. There would be no need for an education reform cottage industry, and no one would donate to it. They failed. It’s too bad, because I would much rather be spending my life an executive at Rhino Records putting together compliation CD’s of punk rock bands covering all of Dean Martin’s greatest hits. The cover would have a guy in a tux holding up a martini above a violent mosh pit.

A’int Love a Kick in the Head? Oi….let me demonstrate! But I digress…

Our ideas have barely been tried, and very rarely in sustained concert with each other. Unless someone is able to demonstrate the Florida NAEP, the DCPS NAEP, and the Trial Urban District Assessment NAEP for NYC and Miami have all been cooked, the only reasonable conclusion to reach is that unions hate policies that succeed in substantially improving the education of children.

There have been and will continue to be misteps. There will be gains and losses along the way. This is a war, and war is hell. The unions are not going away, but neither are we nor the evidence of our successes. As Dino’s pally Frank used to say, the best is yet to come.


Sweet are the Uses of Adversity

September 23, 2010

(Guest Post by Matthew Ladner)

Jay has lost that loving feeling after the failure of the merit pay plan in Nashville. Mike Antonucci quite rightly points out that “If we want to evaluate teachers on their performance, we should be prepared for performance pay programs to be evaluated on their performance.”

It was worth trying, but it merit pay didn’t work, so should move on to more promising reform strategies, right?

WRONG MOR-TONE!!!!!

What this study seems to show is that the Nashville program didn’t work. That’s valuable information, and we might want to figure out why a program in Little Rock found positive results, while the one in Nashville did not. Inch by inch, we just might figure something out.

Greg and I have each noted in different ways that getting this figured out is a very tricky business. We agree that maximizing competition within the system is key to sorting out the incentives properly. The Nashville study seems to reinforce the view that this about drawing the right people into the teaching profession rather than dangling a carrot out in front of your current teachers. This subject however deserves careful study across multiple programs over a long period of time.

When results by teacher vary so profoundly, it strikes me as inconceivable that we cannot develop a system to treat teachers like professionals. A profession that offers summers off and high job security but has a union negotiated pay scale that incrementally rewards you for getting old doesn’t seem likely to garner as many highly capable people as needed into the profession.

A Nashville pilot program dangling out a $15,000 carrot doesn’t seem likely to get the best and the brightest out of Vanderbilt to forego that MBA and go into teaching. It didn’t seem to motivate the teachers who were already there either.

I don’t know the answers. I do know that we need a lot of people trying a lot of different things and sharing their results and experiences-that’s the primordial soup of innovation. Schools run by the teachers like law firms, parent and student satisfaction measurement models, hybrid model schools with rolling thunder value added assessment systems, and whatever else we can come up with- bring it on.

How about a 33 year old hedge fund manager turning out killer content from a closet? Yes please!

The same logic applies for merit pay- we need experimentation and study. There were many failed attempts to build a plane before the Wright Brothers, and even the Wright Brother plane was more likely to get you killed than fly you to another city, state or country.

We all need to take a deep breath, keep our expectations reasonable, and learn from failures like the Nashville program.


Merit Pay Bust

September 22, 2010

For some time now I have expressed disillusionment with merit pay as an ed reform strategy. In a paper Stuart Buck and I produced last spring for a Harvard conference on performance incentives we wrote:

All of this leads us to measured skepticism about the merit of merit pay, unless coupled with other reforms such as competition between schools. After all, merit pay boils down to an attempt to recreate a market system within a tightly controlled state monopoly. This is an objective fraught with peril. Even if wise and benevolent state actors manage to get the incentives right at a particular moment in time in a particular place, their actions can always be undone by immediate successors. Those successors may well be more influenced by the powerful special interests that want to block merit pay, loosen the standards, or even to call a system “merit pay” while rewarding behavior that has no relation to actual achievement.

Now we have additional reasons for skepticism.  A well-designed random-assignment experiment led by Vanderbilt’s Matt Springer found:

While the general trend in middle school mathematics performance was upward over the period of the project, students of teachers randomly assigned to the treatment group (eligible for bonuses) did not outperform students whose teachers were assigned to the control group (not eligible for bonuses).

Keep in mind that this experiment only tests whether financial incentives increase teacher motivation, resulting in higher student achievement.  It does not address whether merit pay might change the composition of the teacher labor force, attracting and retaining more effective teachers.

Still, color me even more skeptical about the promise of merit pay as an ed reform strategy.  It may well be that the current crop of teachers we have believe that they are doing their best, so offering them money for trying harder doesn’t result in a significant change in effort.  And given the political and organizational barriers to merit pay, I hold out little hope that a well-designed program can be sustained long enough to effect the composition of the teacher labor market.

In the last week, I hope ed reformers have learned that we can’t really improve the school system by maintaining the same centralized system while trying to sneak a reformer into the control-room (a la Michelle Rhee).  And I also hope we’ve learned that we can’t tinker with the incentives within that same centralized system ( a la merit pay).  The key to effective reform is decentralization of control via school choice, including charters, vouchers, tax credits, weighted student funding, etc…
(edited for typos)

You Heard It Here First!

September 22, 2010

“Why Hitler Lost the War”

(Guest post by Greg Forster)

Reviewing Oprah’s segment on Waiting for SupermanJay Matt [oops] just announced that the war of ideas is over and the unions have lost.

Hmm, where have I heard that before? Oh, yeah, that’s right – I’ve been saying it for a year and a half.

Permission to come aboard, granted!

The unions are primed for a major defeat. If you listen carefully, you can actually hear the voice-over from Mortal Kombat crying out “FINISH HIM!”

What the movement needs now is a fearless, dynamic organizational leader with a smart plan to get a truly universal voucher program (no more watering it down) enacted in a state in the next, say, three years, and who’s determined to spend the next three years doing nothing but putting that plan into action. There are states where that can happen. But it won’t happen unless somebody picks up the ball.

Or am I just waiting for Superman?


Oprah on Waiting for Superman

September 21, 2010

(Guest Post by Matthew Ladner)

HT: Whitney Tilson

Are the stars lining up against the teacher union reactionaries? Four years ago, Oprah felt the need to allow the Savage Inequalities guy babble out his cartoon for purposes of cover, but she didn’t bother with any of that this time.  I’m starting to entertain the notion that Waiting for Superman might be a very big deal. The unions have lost the war of ideas, this film powerfully makes that point in an incredibly poignant fashion, and many union puppets will be looking for a new line of work in a few weeks.


Nominees for the 2010 Al Copeland Humanitarian Award

September 21, 2010

It’s time again to consider nominees for the Al Copeland Humanitarian Award.  The award is meant to honor a person who has made a significant contribution to improving the human condition.

The criteria of the Al Copeland Humanitarian Award can be summarized by quoting our original blog post in which we sang the praises of Al Copeland and all that he did for humanity:

Al Copeland may not have done the most to benefit humanity, but he certainly did more than many people who receive such awards.  Chicago gave Bill Ayers their Citizen of the Year award in 1997.  And the Nobel Peace Prize has too often gone to a motley crew including unrepentant terrorist, Yassir Arafat, and fictional autobiography writer, Rigoberta Menchu.   Local humanitarian awards tend to go to hack politicians or community activists.  From all these award recipients you might think that a humanitarian was someone who stopped throwing bombs… or who you hoped would picket, tax, regulate, or imprison someone else.

Al Copeland never threatened to bomb, picket, tax, regulate, or imprison anyone.  By that standard alone he would be much more of a humanitarian.  But Al Copeland did even more — he gave us spicy chicken.”

Last year’s winner was Debrilla M. Ratchford, who significantly improved the human condition by inventing the rollerbag, beating out Steve Henson, who gave us ranch dressing,  Fasi Zaka, who ridiculed the Taliban,  Ralp Teetor, who invented cruise control, and Mary Quant, who popularized the miniskirt.

This year I would like to nominate The Most Interesting Man in the World.

The Most Interesting Man has improved the human condition by modeling “the good life.”  In an age that lionizes anti-heroes, slackers, and losers, it is nice to be reminded of what masculine virtue can look like (even if Harvey Mansfield would find that redundant).

Yes, The Most Interesting Man is fictional, but the award is for a “person,” which I believe could include a fictional person.  In the past we have focused on entrepreneurs as nominees for the Al Copeland Humanitarian Award, with the purpose of emphasizing how inventors and business people can improve the human condition much more than the politicians and activists who more typically receive such awards.

But I think we should expand our set to include the idea of a person.  The creation of that idea — whoever developed the ad campaign — could be at least as important for improving the human condition as the creation of a business or product.

The floor is now open for other nominations.


Would You Want These People Making Ed Policy?

September 19, 2010


New Heritage Brief on the Racial Achievement Gap

September 18, 2010

 

(Guest Post by Matthew Ladner)

Back in 1997, Professor Lawrence Stedman wrote:

Twelfth-grade black students are performing at the level of middle school white students. These students are about to graduate, yet they lag four or more years behind in every area including math, science, writing, history, and geography. Latino seniors do somewhat better than 8th-grade white students in math and writing but, in other areas, are also four years behind white 12th graders…. Schools and society remains divided into two different worlds, one black, one white, separate and unequal.

Thirteen years later, sadly not much has changed with the national numbers, but some states have proven that far-reaching policy changes can reduce achievement gaps.

Lindsey Burke and I sing a new duet celebrating Florida’s reduction of the racial achievement gap  in a new Heritage brief.  Let’s just say the evidence from Florida is fairly compelling:

From the brief:

If trends since 1998 were to hold nationally, it would be about 33 years before we could expect Hispanics to close the gap with their white peers. In Florida, however, black students could catch up in half that time, and Hispanics could exceed the national average for white students as early as 2011.

This is just the sort of progress that the “Broader-Bolder” crowd would like us to believe is not possible without a vast expansion of the welfare state.

OOOOOOOOPS! Do you think we’re stupid Hans? It is accountability with teeth, real transparency and expanded parental choice that is making this happen. Cue the slo-mo fall scene-and please try not to make too big of a mess on the sidewalk.

 


Foundation for Excellence in Education Video

September 15, 2010

BOOOOOOOOOOM!!!!!!


Heroic Reformer Theory Fails

September 15, 2010

Yesterday’s defeat of Adrian Fenty in DC and the likely ouster of heroic school reform superintendent, Michelle Rhee, should remind all of us of the very real limits of the heroic reformer theory of school reform.  That theory holds that we just need to place the right people in positions of power in the school system and then support their heroic efforts with supplemental funding and political support.

The main problem with maintaining centralized government control over schooling and just changing who controls that centralized system is that the forces of the status quo have enormous incentives and even stronger ability to recapture control even if they temporarily lose it.

Rhee was probably pushing for the many good reforms, but the more she pushed for them the more incentive the edublob had to win the next election, remove her from office, and undo her efforts.  And eventually they did.

Happily, DC is also decentralizing control over the school system, especially with its large and growing charter sector.  Whoever is in charge of the  DC public school district, that person will be in charge of a shrinking organization.  The right way to reform DC is to make it easy for everyone who wants to leave a failing school to do so.  That can’t be as easily reversed as changing the person who is charge of a centralized system.