It’s Not All About Poor Kids

September 27, 2011

Education reform has really focused on improving the quality of education for our most disadvantaged students.  This focus is not entirely without reason, since large, urban school districts serving low-income students are clearly dysfunctional.

But this nearly exclusive focus on improving the education of the poor has concealed the sub-par education being provided in many of our most affluent school districts.  As the new article Josh McGee and I wrote for Education Next shows, suburban public school districts may look good when compared against their urban neighbors, but when compared with students in 25 other developed countries many affluent suburbs barely keep pace.  That is, our best is often mediocre.

If the children of affluent suburbanites want to maintain their parents’ high standard of living, they need to be performing near the top relative to student overseas with whom they now have to compete for high-paying jobs in an increasingly globalized economy.  Doing better than the kids in big city school districts should provide suburbanites with little comfort.

But this is precisely the comparison we encourage suburbanites to make.  State accountability testing shows suburban districts doing better than the rest of the state, which consists largely of big urban districts.  Policymakers and reformers talk endlessly about the “achievement gap,” highlighting how much worse low-income and minority students are doing.  As Rick Hess recently noted, “our achievement gap mania” has stifled the innovation we need to improve education across the board.

It’s an old saying in public policy that “programs for the poor are poor programs.”  The same is true in education.  If we focus exclusively on improving the education in big cities we fail to engender the support education reform needs from suburban elites if it is to be successful.  As long as suburbanites think that education reform is something for those poor kids in large urban districts, they will never fully commit to the kind and scale of reform that is really needed to improve things in big cities as well as everywhere else.  They’re afraid to muck up what they think is a successful education system for their own children.

As our new Education Next piece shows, this suburban complacency is not well-founded.  Suburbanites need education reform for the sake of their own children and not just for the poor kids in the big cities.  If suburban elites commit to education reform for their own children,we may finally get improvement for low-income kids in the cities as well.

Student achievement in virtually every one of the nearly 14,000 public school districts in the United States compared to students overseas can be found at The Global Report Card’s interactive web site.  With the support of the George W. Bush Institute, we’ve been able to provide this information so that everyone can look up their own and other districts to see that the need for education reform is not confined to big cities.


Global Report Card Released Tomorrow

September 26, 2011

Keep your eyes out for tomorrow’s release of the Global Report Card.  This is a project conducted by Josh McGee and me in which we measure student achievement in virtually every school district in the U.S. against the performance of students in an international comparison group consisting of 25 developed countries. The project is sponsored by the George W. Bush Institute.

There will be an interactive web site containing all of the results.  And Josh and I have an article discussing some important findings from the Global Report Card that will go up on the Education Next web site tomorrow (www.educationnext.org ).

Also watch for Laura Bush on the Today Show tomorrow as part of NBC’s Education Nation .


The Race is On: Indiana is the new Florida, but who will be the next Indiana?

September 22, 2011

(Guest Post by Matthew Ladner)

The 2011 legislative sessions set a new standard for K-12 reform, can 2012 hope to compare? The logical response would be something along the lines of “not bloody likely.” The electoral calendar, the fact that many of the reform states are likely to be distracted by policy implementation, and the fact that the molasses states and likely to stay in their torpor all point to a diminished of expectations for next year.

Taking a step back from questions of the pace of reform, it makes for good bloggy fun to speculate where large breakthroughs might occur.

Looking regionally, Big 10 country clearly led the way last year. Indiana engaged in incredible soup to nuts reform, with big reform undertakings in Ohio, Wisconsin and even (gasp) Illinois with tenure reform. The Minnesota legislature passed transformative reforms, but settled for some incremental steps this year. Big things are under discussion in Michigan. Iowa is discussing reform, while Pennsylvania seems to be searching for their sea legs, which I expect them to find.

By comparison to the Big Ten, the South seems stuck in neutral, outside of Florida, Louisiana and Oklahoma. Texas and North Carolina used to be reform leaders, but they faded after plucking the low-hanging fruit of reform (standardized testing). North Carolina shows some signs of rousing. Tennessee has entered into a serious discussion about reform. Reform is on like Donkey Kong in Oklahoma- special needs vouchers followed by school grading and 3rd grade retention and a tuition tax credit program.

The Northeast features some interesting dynamics in Maine, and fascinating struggle between Democrats for Education Reform and the AFT in New York. Lots of small rural schools in the northeast will eventually benefit from digital learning.

When you look out West, you see a clueless giant surrounded by more nimble neighbors. All three states bordering California-Arizona, Nevada and Oregon -have taken steps to enact reform. Yes- even Oregon! Governors Sandoval of Nevada and Martinez of New Mexico have brought a new energy to reform discussions in their states. Arizona, Utah and New Mexico have adopted A-F school grading, with Utah also passing a far-reaching digital learning bill.

Florida enacted comprehensive reform in 1999. Indiana did it in 2011.  Which states will be next? I could tell you, but then I might have to kill you. Feel free to speculate in the comments section.


Arne Duncan, Suuuuuuuuuper Geeeeeeenius!

August 12, 2011

(Guest post by Greg Forster)

Before he goes ahead with the plan to set himself up as America’s first one-man legislature, Arne Duncan might want to read this detailed, devastating takedown by Rick Hess.

This is pretty much what I was trying to get at in the comments earlier this week, except a whole lot better both on substance and humor value. I couldn’t stop laughing, and I also couldn’t stop crying.

(Although I do think I should get points for working in an Iron Chefs reference.)

If Duncan doesn’t pick up the clue Rick is putting out on the table for him, here’s how his tenure might be remembered:

 


Command v. Choice Part II: Trust and Teamwork

July 27, 2011

(Guest post by Greg Forster) 

Jay P. Greene’s Blog Presents: 

Ineffective Teambuilding Techniques!

Group Religious Instruction

“Tryouts”

Mandatory Employee Leave Policy 

See Part I.

The existing school system persistently fails to pick up and reproduce best practices. Reformers have identified no end of good ideas that hold a lot of promise – provided you can get schools to try them. But no matter how good the ideas are, no matter how many high quality models you build and demonstrate, other schools never seem to pick them up and adopt them.

Therefore fixing schools will require the exercise of power. Somehow we have to get people to do things they currently find unpersuasive or excessively painful.

But people don’t like to be made to do things. They want to live in the way that seems right to them. And this is a legitimate desire – we can’t “live in the truth” if we have to live in ways that we experience as inauthentic. The more we have to do things that we don’t believe in because others, who have power, force us to to them, the more inauthentic our lives become. This makes us miserable, destroys motivation and idealism, shuts down the entrepreneurial drive for improvement, and breeds resentment.

That last item on the list can’t be stressed too strongly. Command and control is not only destructive in many other ways, it also fails to accomplish its explicit goals, because people who are subjected to it quickly develop a strong sense that cheating the system is okay, even virtuous, since the system itself is evil.

Reforms only work if you have three things. First you need a good idea – the reform itself. Next you need people who are capable of carrying it out – hence the rise of teacher quality as a focus of reform. But there’s a third thing you need, and this is why command-based approaches never work: you need an institutional culture in which reform is viewed as legitimate, necessary and empowering.

In any organization, institutional effectiveness is driven by trust and teamwork. To the extent that people are merely obeying rules, chasing carrots or avoiding sticks, effectiveness collapses. Effective institutions are ones that succeed in 1) cultivating trust and teamwork – for real, not the phony kind you get by making people do ropes courses and stuff; and 2) harnessing the trust and teamwork of the organization for effectiveness.

That second point is key. The trust and teamwork of an organization can be oriented toward goals other than the proper goal of the institution. They can even be oriented against the proper goal of the institution – as in Atlanta, where the whole system mobilized in a high-trust, intensive team project to cheat on accountability testing.

But trust and teamwork can only be mobilized for the right goals when people sincerely believe in the goals. The processes – and reforms – necessary to achieve those goals need to be understood and experienced as legitimate. Reform can’t just be imposed by power; it needs to become part of people’s truth.

Forgetting this fact, and actively corrupting the social processes that people rely on for truth, is the great temptation that always comes with power. The Gates Foundation, having succumbed to this temptation, is now embarking on what looks to be a wasted, deeply counterproductive decade or so (depending on how long it takes them to come to themselves) of command-and-control based reform.

So how can we accomplish reform in a way that is both humane and effective?

Let’s go back to the original reason we need power: “Somehow we have to get people to do things they currently find unpersuasive or excessively painful.” Emphasis added!

People need to be persuaded to adopt reform as part of their truth – something they experience as legitimate, necessary, and empowering.

“But wait!” I hear you cry. “That’s what we’ve been trying for decades, and it hasn’t worked!”

That’s right, so let’s ask why it hasn’t worked. I mean, isn’t it a little odd that 1) the system is so overwhelmingly dysfunctional that it’s destroying millions of children’s lives, 2) the people in the system are normal people, not psychotic or anything, people who by all accounts care about children’s education at least as much as the average person if not, you know, a lot more, and yet 3) the people in the system can’t be brought by any means to see reform as necessary?

What is it about the system as currently constituted that ensures reform is never embraced as something legitimate, necessary and empowering?

The system is moribund because it is a monopoly. When any institution has a captive client base, support for innovation vanishes. Reform requires people and institutions to do uncomfortable new things. Thus it won’t happen unless people are even more uncomfortable with the status quo than they are with change. So we need institutional structures that make the need for change seem plausible and legitimate. A captive client base ensures that such structures never emerge. An urgent need for change never seems really plausibile. An institution with captive clients can – or at least it will always feel like it can – continue to function, more or less as it always has, indefinitely. So why change, when change is uncomfortable, even painful?

This is why even small reforms that seem like they would be easy to implement have consistently failed to scale, and the attempt to impose such reforms through national command structures will fail even more spectacularly. Institutional culture in the existing system is hostile not just to this or that reform, but to reform as such, because it excludes the only institutional basis for making the need for change seem plausible and legitimate: the prospect of losing the client base.

This is what school choice advocates are talking about when they talk about the value of competition. “Competition” does not mean a cutthroat, ethics-free environment where individuals and institutions seek their own good at the expense of the good of others. Rather, competition is the life-giving force that drives institutions to become their best and continuously innovate, because it is the only way to hold institutions accountable for performance in a way that is both productive (because it aligns the measurement of institutional performance with people’s needs) and humane (because it creates accountability in a decentralized way rather than through a command-and-control power structure).

Where real competition is present, the cutthroats and self-servers are generally the first to fail. It is the individuals and institutions that focus on serving the needs of others who find success.

This is why big corporations, Wall Street firms, etc. are always opposed to free competition and are always seeking partnerships with government to undermine and eliminate it. They want to be able to use their dominant position to extract wealth without being accountable to serve anyone else’s needs.

This is the most important reason school choice has consistently improved educational outcomes for both the students who use it and for students in public schools. Studies of school choice programs consistently find that students using choice have better outcomes, and also that public schools improve in response to the presence of school choice. The explanation is simple: school choice puts parents back in charge of education, freeing the captive client base and creating an institutional environment in schools that makes the need for change seem plausible and legitimate.

Educators experience the urgency of the need for change when families not being served can leave for other schools – and they will never experience it any other way. Discomfort with change is also reduced for parents, because school choice restores their control over their children’s education.

This is not to say that power plays no role. The school choice movement needs power to break the union deathgrip on education policy and implement a real (i.e. universal) school choice program. And of course that means we need to be on our guard against the temptation to corrupt the knowledge process – to make power more important than truth, to say things that aren’t true but will help us get power. And power will continue to play a role, not only in continuing to defend real choice once it’s implemented, but also to enforce the rules of participation (to punish cheating, etc.).

But choice is the approach that is able to take both power and truth seriously. Command and choice are the two great methods of changing institutions. Command puts power in the driver’s seat, and sometimes (e.g. when punishing crimes) that’s necessary. Choice tends more in the direction of favoring truth over power.

I know which path I’m betting on. And so, I guess, does Gates. May the best man win.


Command v. Choice, Part I: Truth and Power

July 26, 2011

Vaclav Klaus and Vaclav Havel

(Guest post by Greg Forster)

Jay is causing quite a stir with his two-part deconstruction of the Gates Foundation. To those who may be upset, let me say the following two things.

First: Jay’s posts will have no important impact – unless they’re true.

Second: That fact itself demonstrates why the Gates command-and-control approach to education reform is bound to fail.

As Jay points out in his two posts, the Gates effort has undermined the intellectual integrity of many people associated with it. Why? The immediate answer is simple. The Gates strategy is a power agenda. And as Jay and I have both had occasion to point out, power agendas seek to subvert “science” in order to create the impression that their policies are scientifically supported. Other knowledge systems are equally vulnerable, but in our society “science” is the only knowledge system whose validity and importance is recognized by virtually everyone; hence science is the key target for corruption.

Don’t get me wrong; power, considered simply by itself, is good. It’s better to have it than not have it. You can’t get much good done without it. But all good things come with natural temptations and dangers, and one of the natural temptations and dangers that always – always – comes with power is the constant threat to subvert knowledge.

I don’t know their hearts, but I’ll bet the Gates people are not bad people, as people go. They just aren’t awake to, and taking steps to check, this natural danger. They’re not aware of what they’re doing and don’t recognize the process of intellectual corruption for what it is even when it’s held up to their faces – because that failure of recognition is itself the natural attendant danger of power.

But this just leads us to a deeper question. Why do power agendas always display this tendency to corrupt knowledge systems? Why does Gates invest hundreds of millions of dollars in research when it’s clear they already know what they want to be true and aren’t interested in following the evidence? And why does it spend hundreds of millions more subverting the individuals and organizations who talk about education research? Why does Gates care what a bunch of bloggers think? What explains this enormous investment?

Because truth has a power of its own. People want to believe what’s true. Even wicked people who deliberately decieve others for the sake of power would not be willing to be decieved themselves for the sake of power. Every human being has a desire to know truth and live in accordance with that knowledge. To be sure, other desires compete with this desire and often win out over it. But the desire is always there and can always be harnessed as a force for social change – that is, for power. So the people who care about power always have to worry about the people who care about truth.

This dynamic is as old as time. From Plato to Paul, from Martin Luther to Martin Luther King, people who care about truth more than they care about power have been a threat to those who care more about power than they do about truth.

And the reverse is also true, as can be surmised from the response of the powerful to the four people I’ve just named. Asked what he would do to help win support from the pope for the Russian war effort against Germany, Stalin snorted, “The pope? How many divisions has he got?” In a more reflective hour, however, he spoke with more shrewdness: “Ideas are more powerful than guns. We would not let our enemies have guns, why should we let them have ideas?”

Mind you, though, the trouble is not entirely on the side of the “power people.” We “truth people” have our own, equally dangerous dysfunctions. We know that the social systems of power are a threat to the social systems of knowledge production, so our natural instinct in many cases is to fear power. We build high ivory towers and steer clear of the world of power. And by doing so we render ourselves not only irrelevant and irresponsible, but even irrational – because our isolation from “the real world” leaves us extremely vulnerable to falling for spurious ideologies that flatter our prejudices.

For example.

The natural and intrinsic dangers of the life devoted to truth are themselves just as much a threat to the process of knowledge production as the natural and intrinsic dangers of the life devoted to power.

In spite of the natural rivalry between truth and power, or perhaps because of it, people who have gone all the way to the two extremes – those who care only about power and those who care only about truth – often make alliance with one another. The power people provide subsidies that allow the truth people to spend all day in their offices thinking, computing, writing, talking, and doing everything they like to do; in exchange, the truth people anoint the power people as legitimate. Everyone gets what he wants – except for the other 99% of us, who get screwed.

The answer to this dilemma, of course, is that we have to care about both truth and power. Not to care about truth is dishonest. Not to care about power is irresponsible. Both are self-destructive. (Not to mention other-destructive!)

In reality, however, human beings are rarely so balanced. All virtues come in matched pairs of opposites (e.g. courage and moderation, candor and tact) and each person tends to care more about one necessary virtue than its opposite. That’s why people need social systems in which the legitimacy of opposing virtues is respected and processed in a way that doesn’t subordinate the one to the other.

As a little vignette to illustrate this, consider the roles played by Vaclav Havel and Vaclav Klaus in Czech liberation. Under the Czechoslovak tyranny, Havel lived underground, writing tracts and plays and organizing a network of dissident intellectuals. He had no use for the regime’s systems of power, except as targets – and slow, fat targets they were for a powerful genius like his. Havel’s greatest non-fiction work may be his book-length essay “The Power of the Powerless,” in which he argues that truth is the power of the powerless because all people desire ” to live in the truth.” Unchecked power forces people to live a lie, and the more they have to live a lie the stronger the desire to live in the truth grows. When that desire grows stronger than the desire to live quietly, the power of the powerless becomes greater than the power of the powerful.

In 1989, Havel’s circle of dissidents triggered the crisis that brought down the regime. Protestors gathered in Wenceslas Square for days, then weeks, in defiance of machine-gun toting thugs who might gun them all down at any moment. Havel addressed the crowd daily, and was in little danger because wherever he went, throngs of ordinary people spontaneously surrounded him in an effort to shield him from snipers. “You have to kill us all” was the implicit message of the protestors – and the regime broke. Havel’s game plan, Havel’s leadership, Havel’s hour.

Klaus, on the other hand, was an economist for the state bank under the Czechosolvak tyranny. He was not a supporter of the regime, but he apparently saw nothing inconsistent between that and a banking career within the system. He joined the resistance movement early during the revolution of 1989, and before long he drew a large following of support backing him as a leader – two facts that indicate, I think, that he had legitimacy as a reformer.

Havel and his circle, however, couldn’t stand him. More important, they didn’t trust him. They still don’t. To this day, Klaus is dogged by whispers about all the nasty things he must have been doing to keep his position in the state bank, while people like Havel were going to jail for the sake of truth. And it’s not like there’s not some reasonableness to that disposition.

But the bottom line was that Havel didn’t know how to run a country, and Klaus did. In 1989-1991 those two facts rapidly became clear to a large number of people. Havel and his circle had founded Civic Forum as an umbrella party for the resistance movement, and after the regime collapsed it was the “national unity party” under which the new democracy was governed. A year after the revolution, to the surprise and disgust of the Havel circle, the national party deputies elected Klaus to chair the party. Before long an anti-Klaus faction walked out of the party and founded a new one, completing the transition to a system of electoral party competition. Havel, as president of the new nation, stood formally apart from these events, but everyone knew where his sympathies lay.

With the separation of the Czech Republic from Slovakia in 1992, Klaus became its prime minister. From then until Havel’s retirement in 2003, Klaus ran the government and Havel served as head of state. And a bang-up job they both did of it, too – Klaus’ political, economic and administrative leadership brought about a peaceful and successful transition from state ownership and command-and-control to prosperity and personal freedom, while Havel articulated for his nation a renewed understanding of the political community that grounded it in the humane and civil virtues of freedom and personal responsibility. Neither of those feats could have succeeded without the other.

Havel (truth) and Klaus (power) naturally dislike and distrust each other. But the Czech resistance after 1989 and the Czech government in the two succeeding decades made room for them both – Klaus became president after Havel’s retirement from office, while Havel has continued to write and speak. As a result, the Velvet Revolution and the subsequent history of the Czech Republic stand as miraculous modern models of peace, prosperity, order and justice.

So what would an education policy that took seriously both truth and power look like? Stay tuned for Part II.

(You can tell I’m smarter than Jay because I use Roman numerals for my serialized posts.)


Testing, Cheating, Culture and Corruption

July 21, 2011

(Guest post by Greg Forster)

Matt draws our attention to some of the broader issues raised by the APS scandal. Cheating is not just about cheating.

Here’s another one of those broader issues I think we should take note of. To call this “cheating” is really inadequate. This was a whole institutional culture in which cheating had become not just acceptable, but normal. This was way beyond teachers subtly indicating the correct answers (such as through tone of voice) or deliberately seating bad students next to good ones (so they could copy). Those things happened, but much more happened.

Teachers had “cheating parties” in which they sat around erasing and remarking student answer sheets. There was one guy whose job was to open test booklets, copy the contents, reseal them (using a lighter to melt the plastic back into place) and then distribute the contents to everybody. This was a huge, pervasive, known-to-everybody cheating system.

And cheating was not just normal but mandatory. Hark ye, my bretheren, unto the Atlanta Journal-Constitution:

For teachers, a culture of fear ensured the deception would continue.

“APS is run like the mob,” one teacher told investigators, saying she cheated because she feared retaliation if she didn’t.

Cheat – or else!

What’s going on here? This is not just the undifferentiated “corruption of human nature.” This is a very specific dynamic of institutional culture. This is a system whose organizational culture responded to NCLB by systematically embracing cheating at all levels, even to the extent of viewing non-cheaters (i.e. honest teachers) as threats to the integrity of the system.

We should think carefully about how that kind of thing happens. There is one hypothesis that sticks out to me as clearly plausible: This happened because the testing requirements of NCLB were percieved as evil, tyrannical and a threat to the integrity of education. Personnel at all levels actually viewed cheating as morally virtuous because it was necessary to protect an essential good (education) from being undermined by vicious oppressors with evil agendas. And given widespread teacher cynicism about the value of standardized tests as a metric of learning, in their perception nothing valuable was lost in the process.

This is about more than cheating. This is a wakeup call to our thinking about how reform works.

I have always been in favor of the aspect of NCLB that uses tests to create transparency. Remember, before NCLB you didn’t even have all states participating in NAEP. Anyone want to go back to that? No? Well, then, let’s not throw the baby out with the bathwater.

However, it is now pretty clear that NCLB does not work as an accountability tool. Might the systemic, institutional extent of the cheating in APS help explain why? Teachers and administrators don’t percieve the tests as legitimate – they see them as inaccurate metrics being imposed by evil oppressors as tools of exploitation – and thus don’t respond to them in positive ways. (On net, that is. Bad responses cancel out good ones.)

Contrast that with the use of testing for accountability in two other contexts. Jeb Bush’s A+ accountabiliy testing system in Florida did produce positive results. Could that be because Florida had spent years at the bottom of the national listings for education and was sick of it, and had spent years trying to improve through the tried and true ideas of the unions and was sick of failing, and was thus more open to new directions? In the context of this openness, Jeb Bush’s leadership, and his partnership with the right stakeholders, framed the reforms in a way that caused them to be experienced as legitimate at the school level.

Even more impressive, consider the use of testing in innovative charter schools like KIPP. Remember that David Brooks column blasting Ravitch? Brooks identifies what he calls “a core tension,” namely: “Teaching is humane. Testing is mechanistic.”

However, in schools where the entire institutional culture has been reinvented from the ground up around personal relationships between teacher and student that are centered around leadership, mentorship and accountability, testing isn’t experienced as mechanistic at all. Where the students really see the teachers caring about them, and vice versa, standardized testing is accepted as a tool that empowers this relationship:

The schools that best represent the reform movement, like the KIPP academies or the Harlem Success schools, put tremendous emphasis on testing. But these schools are also the places where students are most likely to participate in chess and dance. They are the places where they are mostlikely to read Shakespeare and argue about philosophy and physics. In these places, tests are not the end. They are a lever to begin the process of change…

Ravitch thinks the solution is to get rid of the tests. But that way just leads to lethargy and perpetual mediocrity. The real answer is to keep the tests and the accountability but make sure every school has a clear sense of mission, an outstanding principal and an invigorating moral culture that hits you when you walk in the door.

I think this means it’s essential that the use of tests for accountability purposes must be implemented only in contexts of institutional culture where they will be experienced as legitimate – and the degree to which the tests are used must be controlled by the degree to which the institutional culture permits this experiential legitimacy.

In some cases (as with Jeb in Florida) that could be accomplished statewide. In others it can’t. Sometimes it will have to be districts, or a network of charter schools. In many contexts it won’t work at any level. It certainly won’t work nationally, since the institutional context of the federal role in education could never permit this kind of thing to develop in a way that would be seen as legitimate.

How, then, do we drive accountability? Choice and competition, obviously. And guess what? Once schools face the disruptive threat of choice, they will be more likely to start using tests for accountability voluntarily – because they want to survive and they’ll be ready to reconsider their options.

You know, it strikes me that this principle might have application to other issues besides accountability testing. In general, the higher you go up the ladder of power – from school to district, from district to state, and from state to national – the less likely you will really be implementing your reform, and the more likely you will just be playing power games, and be seen to be playing power games, and thus cause those below you on the ladder to respond by playing power games of their own. As in Atlanta.


Arne Duncan on Atlanta Cheating Scandal

July 21, 2011

(Guest Post by Matthew Ladner)

Political scientist Donald Campbell postulated that “The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.” The Army of Angry Teachers has seized upon the Atlanta cheating scandal as proof that the whole process of testing and transparency is destructive and ought to be done away with.

Arne Duncan weighs in on the Atlanta cheating scandal as a part of a roundtable at the WaPo. Duncan provides a bit of much-needed perspective on the problems of testing, noting that although the Atlanta scandal is the worst uncovered, that it involves 44 schools out of thousands in Georgia.

Secretary Duncan goes on to acknowledge a number of problems in state academic testing, including the far larger problem of states dummying down their cut scores in order to proclaim improvement.

One elephant in the room: test security. It isn’t difficult to infer that while the state of Georgia performed erasure analysis on the tests (thus uncovering the cheating) that they failed to let it be known that they would be doing so on a large-scale (and thus failed to deter the cheaters, who thought they could get away with it). States need to not only employ these techniques, they need to employ them as deterrents.

People are quite clever, however, and constantly develop new ways to cheat if provided incentives to do so. It seems possible that a system of third-party administration of tests will need to be developed as we attach greater consequences to test scores, including school ratings and merit bonuses. This could be a simple as the way you took the SAT test, or it could have a more high-tech look to it.

Another Campbell’s Law problem that strikes me as more serious than systematic answer changing by staff is the practice of teaching to test items. I fear that this is quite widespread, although it is difficult to quantify. The idea behind the standards movement is to teach to a set of academic standards, and to use testing to measure success. If teachers instead teach to a set of test items then the whole process can devolve into a farce.

A skillfully managed system of student testing can and has played a leading role in improving student outcomes. It’s difficult to pull off, and easy to foul up. We should be concerned about staff led cheating. We should be even more concerned about low cut scores, item exposure and test study guides.

 

 

 


Technology and School Choice: The False Dichotomy

July 18, 2011

(Guest post by Greg Forster)

Terry Moe has a great article in today’s Journal about how entrepreneurial innovation taking advantage of new technology is putting the teacher’s unions on the road to oblivion. It’s a great article, except that it draws one false dichotomy.

Fans of JPGB know that we do love us some high-tech transformation of schooling around here. Matt has been on this beat for a long time, and hardly a week goes by that he doesn’t update us on the latest victory of “the cool kids” over “edu-reactionaries” in the reinvention of the school. But he doesn’t own that turf entirely; I made this the theme of my contribution to Freedom and School Choice (as did Matt, of course).

The problem is that Moe insists high-tech transformation of schooling, and the destruction of union control it entails, is absolutely, positively a separate phenomenon from the wave of school reform victories this year:

This has been a horrible year for teachers unions…But the unions’ hegemony is not going to end soon. All of their big political losses have come at the hands of oversized Republican majorities. Eventually Democrats will regain control, and many of the recent reforms may be undone. The financial crisis will pass, too, taking pressure off states and giving Republicans less political cover…

Over the long haul, however, the unions are in grave trouble—for reasons that have little to do with the tribulations of this year…The first is that they are losing their grip on the Democratic base…Then there’s a crucial dynamic outside of politics: the revolution in information technology.

Really? The victories of 2011 – “the year of school choice” – aren’t in the same category with the long-term path to oblivion the unions are on? On the contrary, 2011 is the year of school choice precisely because it has become obvious that the unions are on track for oblivion, for the reasons Moe identifies.

Moe’s argument relies on the assumption that when Republicans are in power, they always make dramatic and innovative school reform policies their #1 priority.

Sorry  . . . lost my train of thought I was laughing so hard . . . let me pick myself up off the floor . . . there, now where was I? Oh, yes.

The GOP hasn’t touched real school reforms with a hundred-foot pole in years. Why did it all of a sudden embrace real reform this year?

Could it be because…

  1. …the unions are losing their grip on the Democratic base, meaning squishy Republicans don’t have to worry about being demonized as right-wing loonies simply for embracing real reform, and…
  2. …the revolution in information technology has made it obvious to MSM and other key cultural gatekeepers that the unions are the reactionaries, once again reassuring squishy Republicans they won’t be demonized for embracing real reform?

Obviously the financial crisis was also a factor here, as Moe rightly points out. But is that really an immediate-term phenomenon, bound to disappear next week? What really counts is whether the nation feels so rich it can afford to ignore ballooning school costs. Technically the recession ended two years ago and we’ve been in “recovery” for two years. How’s that feeling? Do we feel rich and luxurious again? Are we on track to restore a widespread national sense of inevitable prosperity by 2012? By 2014? By 2020?

Bottom line, the unions losing Democratic support and taking their stand in opposition to entrepreneurial change was the crucial, indispensable precondition for this year’s wave of school reform success.

Oh, and guess what? Sustaining those policies, especially school choice, will be the only way this wave of advancing technology will produce the results Moe is expecting. Only school choice can prevent the blob from neutralizing any reform you throw at it. If the techno-innovators turn their back on choice and competition, they’ll be dead meat. (For more on that topic, see the aforementioned chapter by your humble servant in Freedom and School Choice.)


Louisiana Board: 46% of Schools earned D or F grades

June 16, 2011

(Guest Post by Matthew Ladner)

The Baton Rouge Advocate reports that the Louisiana Board of Elementary and Secondary Education discussed an analysis showing that the A-F grading system adopted in that state would find 46% of schools either D or F rated. The story makes clear that it could be higher next year. If the system had been used this year, the grade distribution would have looked like:

  • A — 75 schools.
  • B — 236 schools.
  • C — 375 schools.
  • D — 513 schools.
  • F — 81 schools.

Louisiana had the lowest 4th grade reading scores in the nation of any state in 2009, and has been either near or at the bottom for a long time. A majority, 51% of Louisiana 4th graders scored “Below Basic” on 4th grade reading- making them functionally illiterate. Twice as many Ds as Bs sounds about right, maybe a little low.

The details of the Louisiana grading system differ from Florida. Schools will earn + and/or – along with their letter grades depending upon whether growth targets are met, and factors such as attendance influence the letter grades.  With that noted, the chart that Louisianans should tatoo on to their foreheads until the gales of controversy blow over is below:

In the first year of the Florida grading system, 677 schools graded out D or F while only 515 schools earned A or B grades. The year before, in 1998, Florida’s 4th Grade NAEP reading scores were 5th from the bottom, so this was truth in advertising. On four separate occasions, policymakers raised the standards to receive an A or B grade, but you can see the trend for yourself: now there are more than 10 times the number of A/B grades as D/F.

Sidebar: I often get asked on the road why the total number of schools goes up so much in this chart. The number of charter schools took off, Florida experienced a good deal of population growth, but probably the biggest factor is the shrinkage of the C category, which is offstage in this chart.

NAEP serves as a source of external validation for this progress, and the rigor of the FCAT exam has remained steady against NAEP.

Arizona, Indiana, Oklahoma, New Mexico and Utah have all adopted A-F school grades in the last two years, following the lead of Florida and New York City. Additional states have been/are still considering adopting the policy.

School grading is a tough love policy. It’s a lot easier to throw extra money at schools, call yourself the “education governor” and kick the can down the road. School grading  can work, and in fact has worked in Florida and New York City, but it could also easily fail if policymakers lose their nerve in the face of opposition. It requires an attitude similar to Churchill’s, who in his first Cabinet meeting as Prime Minister pronounced that he had nothing to offer but “blood, toil, sweat and tears.”

There is nothing magical about the Florida policies: they require moral courage, hard work, perseverance and patience to show results. Floridians rallied around their underperforming schools, ignored the howls of the reactionaries, rolled up their sleeves to get the job done.

Louisana spends $10,082 per year per child in the public school system, but fails to teach half their students how to read. Lock and load, Louisiana- it’s time to rise to the challenge.