Only Mostly Dead

November 17, 2008

princessbride11

Reliance on markets and the idea of limited government are not quite dead — only mostly dead.  They (mostly) died on October 3, 2008 when Congress passed the ginormous (giant + enormous) bailout bill, greatly expanding the scope and authority of the federal government to own stakes in businesses and financial assets.  And if you are looking for accomplices in the (mostly) murder of market-reliance and limited government, you should probably investigate the DC based “market-oriented” think tanks.

George Will correctly warns that this expansion of government by the partial nationalization of large sections of our economy is unlikley to be either temporary or benign.  (Now he tells us!)

The way back from (mostly) death for supporters of markets and limited government is to undo the bailout as quickly as possible.  Let businesses that made unwise decisions go into bankruptcy (I’m looking at you, GM).  Let their assets be reorganized by their credit-holders so that they move forward with a more efficient structure and more competent management.  Unless people experience the consequences of their mistakes, they can never learn from those mistakes and do better in the future.

I made this exact argument in defense of allowing companies to fail on September 18Mike Petrilli made the same argument on the same day.  But we’re just a bunch of lowly education analysts.  Where were all of the limited government Republicans?  Where were the market-oriented think tanks?

Let’s take a look at the period between September 15 and September 22 to see what the national, market-oriented think tanks had to say.  Remember that this was the pivotal week that began the (mostly) death-rattles for limited government and market-reliance.  Lehman Brothers was allowed to go bankrupt on September 15, but AIG received its first $85 billion bailout offer on September 16The first proposed $700 billion bailout was circulated around midnight on September 20

This was the time when the folks at think tanks could have been standing athwart big government yelling STOP!  They could have bolstered anti-bailout Republicans in Congress, steered the McCain campaign against the bailout (which would have been risky but probably a better hail Mary pass than picking Palin as VP), and they could have laid the foundations for a future defense of markets and limited government.

For the most part, the “market-oriented” national think tanks failed to yell STOP.  In the culminating act of complicity with big-government conservatism, they rationalized and defended a large government intervention in the economy.

Here is what people affiliated with AEI wrote during that period:

Glenn Hubbard called for a Resolution Trust approach of a bailout on both September 15 and September 19, advocating “putting in place a clean-up agency like the 1930s’ Homeowner’sLoan Corp. or the 1980s’ Resolution Trust Corp. would help…. The fiscal costs of inaction would be significant, both in lost tax receipts and in larger ‘crisis’ bailouts down the road.”  This Resolution Trust idea was the foundation for the $700 billion bailout plan of September 20.

Lawrence Lindsey called for a lifting of any cap on depositor insurance at banks on September 17 and then on September 21 endorsed the idea that the government had to provide credit to distressed financial institutions: “But by far the most inevitable economic development will be an expansion of the balance sheets of the government and its central bank.  When credit bubbles burst an enormous hole is formed in private-sector balance sheets…. Government, and only government, inevitably fits the bill as it can both tax and print the resources it needs.”  More support for the bailout.

Vincent Reinhart urged the administration to have “backbone” and resist more bailouts on September 16, but by September 22 he wrote in the New York Times: “The Congress should authorize the Treasury to purchase asset-backed securities in the secondary market and mortgages through auctions. For assets where it might not have all the information it needs, the Treasury could demand a slice of equity in the selling firm as well.”  More support for the bailout.

Alex Pollock wrote on September 17: “When government financial officers–like Treasury secretaries, finance ministers and central-bank chairmen–stand at the edge of the cliff of market panic and stare down into the abyss of potential financial chaos, they always decide upon government intervention.  This is true of all governments in all countries in all times. Nobody is willing to take the chance of going down in history as the one who stood there and did nothing in the face of a financial collapse and debt deflation. Put in their place, you would make the same decision, and so would I.”  More support for bailout.

Desmond Lachman wrote on September 17: “If Main Street is to be spared the painful economic consequences of a financial market meltdown on Wall Street, policymakers have little alternative but to resort to unorthodox interventionist policies to put a floor under the housing market and to prop up the banks with taxpayers’ money.”  More support for the bailout.

Newt Gingrich, writing on September 21, took a very skeptical position on the bailout.  But David Frum strongly went in the other direction, writing on September 22: “What should a free-market believer think about the plan for a government bailout of the U.S. mortgage market? Try this analogy: You have a white carpet in your upstairs hall. The normal rule is that nobody can wear shoes on the carpet. But the house is on fire–and the baby is upstairs. Will you tell the arriving fire department to wait and kick their boots off before dousing the flames?”  Notice that in this analogy, reliance on markets and belief in limited government are just the aesthetic nicety of clean carpets, not the principles that lay the foundations for the house or materials that resist fire.

It’s true that some of these folks called for “smarter regulation” (don’t make me get all Dr. Evil on them!) and advised about how best to conduct a bailout. But the bottom line is that 6 out of 7 AEI fellows who wrote during the pivotal week of September15-22 came out in support of a government bailout, with the 7th expressing skepticism but not outright opposition.

What about The Heritage Foundation?  They supported the bailout.

They issued four policy briefs during the week Sept 15-22.  The pieces all had the same basic message in support of a bailout: “Congress needs to act carefully but quickly in passing this legislation, knowing that it can correct any flaws when it reconvenes next year. Quick action is needed because financial markets remain deeply stressed, and the stress continues to spread to the rest of the economy.”

And what about the Manhattan Institute? They didn’t support the bailout.

Nicole Gelinas expressed even more doubts about the bailout than Newt Gingrich.  Writing in the NY Post she said, “Thing is, it’s not clear this is a solution. There’s no guarantee that even this much cash can buy us out of a systemic financial crisis. Even if it does, we probably face years of necessary financial and economic readjustment.”  And on September 26, just outside of the time period we are examining, she began to actively oppose the bailout, worrying that it might actually delay recovery.

And how about Cato? They also didn’t support the bailout.

Cato behaved more in-line with expectations than AEI or Heritage.  A September 15 piece by James Dorn was typical:“When the US Treasury is raided to defend the government’s credibility to guarantee GSE debt, it may calm markets for a time. Yet, in the long run, the drifts towards socialism and increased government borrowing requirements discourage foreign investment, decrease private saving, increase interest rates and slow US growth. That is a high price to pay for ‘stability.'”

For those of you keeping score, AEI and Heritage were actively in support of a large government intervention in the economy.  The Manhattan Institute and Cato were not.  But AEI is by far the most active and influential market-oriented think tank on this matter, so their support was crucial in shaping events and contributing to the (mostly) death of limited government and market ideas. The Manhattan Institute had only one expert on economic affairs active during the period I examined.  AEI had seven.  I believe that Heritage has, by far, the largest operating budget of any of these think tanks ($39 million as of 2006).  That is more than three times as large as the Manhattan Institute’s $12 million annual budget.

Donors pay for those seven AEI fellows and provide Heritage with its ginmormous budget.  If those donors really do wish to support huge expansions in government involvement in the economy, then I guess they are giving to the right organizations.


The Stupidity of “Smart”

November 17, 2008

The next time I hear someone call for “smart” regulation, “smart” growth, “smart” boards, or “smart” anything I’m going to have to pull a Dr. Evil and get them to zip it — zip it good. 

Appending “smart” before something for which you are advocating is not only a very worn and tired tactic, it is also — for lack of a better word — stupid.  It’s stupid because simply labeling something as smart does not make it so.  Even worse, adding the label “smart” is intentionally ambiguous, allowing the audience to imagine that the “smart” adjective includes whatever people prefer and excludes whatever they oppose, even though everyone is imagining a different set of what is included or excluded by “smart.” 

A lot of normally smart and good people have fallen into the “smart” rhetorical ditch.  Mike Petrilli over at Flypaper was rightly opposing efforts to re-regulate education when he urged: “But the answer is not a return to old-fashioned regulation, but a move to smart regulation.”  That’s like fingernails scratching a smart board.

And sometimes the addition of “smart” negates the  noun it is modifying in an Orwellian fashion.  So, “smart” growth really seems to mean no growth or at least highly restricted growth.  That’s a fine position to take, but it is just bullying to imply that all other positions are not “smart.”  Rather than bullying others and disguising what one is really advocating with the “smart” trick, people should just come out and say what they prefer. 

Mike Petrilli prefers less regulation in education.  The proper term for that view is de-regulation, not smart regulation.  Saying de-regulation at least specifies the direction in which he thinks policy should go, while advocating for “smart” regulation reveals nothing about the preferred direction.  That doesn’t mean he favors the elimination of all regulation.  It’s just that in general he prefers less.  And he makes some effort to tell us what kinds of regulations he would like to eliminate and which should remain.

I agree with him.  But I have one regulation to propose.  Let’s stop talking about “smart” regulation. Or, if we have to develop vapid and deceptive marketing slogans for our proposals, I suggested that we follow the spirit of DJ Super-Awesome and let’s replace “smart” with “super-awesome.”  If we start talking about “super-awesome regulation” the stupidity of “smart” will be more obvious.


Ohio Charters Save Money for Public Schools and Taxpayers

November 14, 2008

(Guest post by Greg Forster)

It’s raining studies! After this one and then this one comes a study out today from Matthew Carr and Beth Lear of the Buckeye Institute. It’s a fiscal analysis of how charter schools impact the finances of regular public schools in Ohio’s “Big 8” cities.

When a student leaves a regular public school for a charter school (or a private school for that matter), the district loses the state revenue stream associated with that student, but it gains on the local revenue side because local revenues don’t go down, allowing the district to take that student’s share of local funds and redirect it to funding the education of the students who remain behind. The net fiscal impact depends on which is bigger, the state revenue stream per student or the local property taxes per student.

Carr and Lear find that in Ohio’s Big 8, the regular public schools are fiscal winners when students leave for charter schools. The biggest savings are in Cincinnati, where the net gain is $4,030 per student; the lowest is in Canton, where the net gain is $918 per student.

Charters in Ohio’s Big 8 also keep overall educational costs down by providing a better education (as Carr’s previous work in Ohio has shown) for less money per student.


Dallas ISD Caught Faking SS Numbers – And Keeps Doing It

November 14, 2008

scot_free_mug

HT Scot Free

(Guest post by Greg Forster)

The Dallas Morning News is reporting that Dallas ISD was caught making up Social Security numbers for illegal immigrants in order to get them on the payroll quickly, especially as bilingual ed teachers.

Specifically, they were caught in 2004. And told by the state that it was illegal. And naughty. And they should stop.

And they’re still doing it right now.

But remember, public schools are transparent and accountable to the community, while private schools are unregulated and dangerous, and don’t have strong civic values!

Like most websites, the Dallas Morning News site automatically provides links to related stories. Here’s what comes up as related to this one:

“Unused Workbooks Are Tossed Out at Dallas School, Violating Policy”

“Dallas ISD Announces $64M Budget Shortfall”

Maybe they could make up that shortfall if they hired some of the geniuses here in Wisconsin who invested all the school funds in shady securities. None of them is going to face any kind of disciplinary or legal ramifications for their malfeasance with public funds, so there’ll be no smudges on those resumes that might make it hard for another school system to hire them and benefit from their services.


Pass the Clicker — The Frog Prince (Muppet)

November 14, 2008

I know it’s cliche to say it, but… there was a time when the entire family could enjoy a TV show together.  Don’t get me wrong.  There’s a lot of great stuff on TV these days.  I enjoy South Park as much as — well, maybe much more than most people.  But I certainly don’t want my kids to watch it with me.  And my kids enjoy The Wizards of Waverly Place, but I have a hard time sitting through more than a few minutes of it.  It’s not that it’s so bad.  It just clearly isn’t made for people my age.

But back before there was micro media, like South Park on Comedy Central geared toward adults and Wizards on Disney Channel geared toward tweens, there was such a thing as mass media — TV that had to appeal to a wide range of ages and types of audiences.  Appealing to such a diverse audience is a hard thing to do well, which is part of why so many old TV shows were so lousy. 

But Jim Henson was a master at creating entertainment for people of all ages.  The Muppet Show and movies are just loads of fun for people young and old.  I confess that I still enjoy seeing Henson’s old bits from Sesame Street.  It’s great stuff.

Pretty much everyone knows the Muppet TV series and movies, but earlier in his career Jim Henson made a series of fairy tales called Tales from Muppetland, with which I imagine fewer of you are familiar.  The best story from this series was The Frog Prince.  It retells the classic story, but adds all of the fun of the muppets, Jim Henson, Frank Oz, and crew. 

There’s lots of singing, oodles of slapstick humor, a hilariously funny evil witch and sidekick ogre, a buffoon king, and a beautiful princess.  One of the best aspects of the muppet telling of this story is that the princess also lives under a terrible curse where she says everything wackbards, I mean, backwards.  She actually is saying Spoonerisms

My favorite part is when the princess and the enchanted frog sing a duet in Spoonerisms.  She sings, “Ny mineteen, ny mineteen, by mirthday’s dotay” and Robin, the cursed frog, echoes in translation, “I’m nineteen, I’m nineteen, my birthday’s today.”

As it turns out, the entire muppet Frog Prince is available on YouTube broken into 6 segments, each 10 minutes long.  I also believe that it is available on DVD and video.  Here’s part 1:

And here is part 2:

So, next time you want to all sit down as a family and watch something, or just when you grow tired of the non-stop hipness of MTV, crudeness of Comedy Central, and schmaltziness of the Disney Channel, check out the muppet’s Frog Prince.


Pass the Popcorn: You Know His Name

November 14, 2008

silhouette-roulette

HT Web Design Library

(Guest post by Greg Forster)

After the U.S. entered World War II in 1941, it was formally at war with Germany, but American attention was primarily focused on the Pacific theater. This was only natural given that the impetus for our engagement was Pearl Harbor, but another contributing factor was widespread anti-British sentiment among American elites. This animus against Britain had been one of the key causes of America’s prewar isolationism, and Churchill worried that he would have difficulty drawing the U.S. into full engagement in the European theater.

Casting about for some way to counteract this problem, Churchill lit on the idea of rounding up some charming and sophisticated English gentlemen – some of whom weren’t previously contributing much to the war effort, or anything else for that matter – and sending them to Washington on a combined charm offensive/intelligence gathering mission. Led by Roald Dahl (yes, that Roald Dahl) their job, recently recounted in Jennet Conant’s The Irregulars, was to wine and dine the American elites in order to 1) improve their impression of Englishmen and 2) keep their ears open for any useful rumors. Whether the Charge of the Aristo Brigade accomplished much for the war effort is doubtful, but there is at least one respect in which the program had a major impact on world history.

One of the men sent to Washington on this “espionage as aristocratic glamorfest” mission was Ian Fleming. The rest is history.

In his paean to Fleming, Mark Steyn observes that all the basic elements that make Bond what he is were present right from the beginning in the first book, Casino Royale – and that the 2006 “reinvention” of the Bond movie franchise in the film version of Casino Royale consists in the filmmakers having done away with all the cornball stuff that the earlier movies had added to that basic foundation over the years, allowing the core Bond to shine through. As the title song says, “The coldest blood runs through my veins/You know my name.”

Now, from what we can tell in the previews of the new film, it appears that Marc Forster (no relation, alas) is adding another innovation to his vision of Bond – storylines that span multiple movies. Bond has had recurrent villains before, of course, but never an ongoing storyline. The rise of epic storylines has recently done wonders for network television, after having been pioneered on high-quality niche shows like Farscape and Buffy the Vampire Slayer. And at about the same time network TV was noticing the narrative power of season-long story arcs, The Lord of the Rings proved that movie audiences were open to ongoing storylines across multiple movies. Now Forster wants to take things to the next level and try doing it with movies that aren’t growing out of a preestablished book series (like The Lord of the Rings) where the epic story arc is already well established and has a fan base. It’s daunting, but it’s the next natural step to take.

And where better to try it than with James Bond? Nobody realized it until now – well, nobody but Marc Forster and the rest of his creative team – but with hindsight, the franchise has always been begging for this. And nowadays, when it’s so much harder than it used to be to get audiences to see espionage as material for epic drama, it’s a genius move. I can’t seem to find it now, but one clever fan put together a desktop image for the new movie consisting of flames formed into a ghostly image of Vesper Lynd, with the tagline “payback’s a bitch.” (If you get the reference, you’re a true Bond fan.) Bond has pursued villains, even Blofeld himself, out of vengence for a girl before, but making that the whole ongoing reason for his neverending war with SPECTRE is absoultely brilliant. 

Though of course it hasn’t been called SPECTRE for a long time now, due to an inconclusive legal battle 47 years ago (no kidding) over the rights to the movie Thunderball – ironically, one of the worst Bond films ever made. Or perhaps it’s more karmic than ironic: when the producers allowed Bond to become nothing more to them than an excuse to make money, they incurred divine wrath, manifested in the loss of the SPECTRE name.

When I was a teenager, I played the official James Bond role playing game and they called the criminal conspiracy TAROT, and each of the organization’s divisions was named after a Tarot card. (I forget what TAROT stood for.) In the video game based on From Russia With Love a few years ago they were calling it Octopus. In the new movie it’s now called Quantum. But we all know it’s really SPECTRE.

The producers waiting for resolution of this same legal battle is also the reason there were no Bond films between License to Kill (1989) and Goldeneye (1995). And it wasn’t until 2001 that the rights to the James Bond character were unambiguously settled on one rightsholder. But they still only got the character – the other material from Thunderball, such as SPECTRE, is still too radioactive to touch.

Shudder to think that about half the country wants the judges to rule us, even though the judges can’t even look after James Bond properly. I mean, if they can’t be bothered to provide a clear resolution of a conflict when something as important as James Bond is on the line, why are we surprised that they have trouble deciding whether or not it makes sense to require American servicemen to die for the sake of a paperwork error?

In this edition of Pass the Popcorn I forego the traditional review of the franchise from its origin to the present day, not only because the task is too great for me, but also because I’ve already offered a unified field theorem of the Bond franchise and there’s no need to reinvent the wheel.

Expectations for Quantum of Solace are, of course, enormous. That’s more or less inevitable when you make a sequel to a groundbreaking film. So, my fellow Bond fans, the name of the game now is anticipation control. The great secret to movies is to just go in and enjoy what’s there, if there’s anything at all to be enjoyed. Critical evaluation can come later. It’s hard enough to do when expectations are low, as the critical response to Speed Racer showed. It’s all the harder when expectations are high.

Alas, I won’t be able to see it opening weekend. But it looks like I can probably contrive to see it next weekend. Until then: arm yourself, because no one else here will save you.


Charter School Students More Likely to Graduate High School, Attend College

November 13, 2008

The National Center for the Study of Privatization in Education at Columbia University’s Teachers College has posted a new study on charter schools by Kevin Booker (Mathematica), Tim Sass (Florida State), Brian Gill (Mathematica), and Ron Zimmer (Rand).  The researchers look at whether attending a charter high school in Chicago and Florida increases the likelihood that students would graduate high school and go on to college.  The short answer is that it does.

The paper’s abstract states:

“We find that charter high schools in Florida and in Chicago have substantial positive effects on both high school completion and college attendance. Controlling for observed student characteristics and test scores, univariate probit estimates indicate that among students who attended a charter middle school, those who went on to attend a charter high school were 7 to 15 percentage points more likely to earn a standard diploma than students who transitioned to a traditional public high school. Similarly, those attending a charter high school were 8 to 10 percentage points more likely to attend college. Using the proximity of charters and other types of high schools as exogenous instruments for charter high school attendance, we find even stronger effects in bivariate probit models of charter attendance and educational attainment. While large, our estimates are in line with previous studies of the impact of Catholic high schools on educational attainment.”

But I can already hear doubters wondering how you could compare students in charter schools to other students when the kinds of students who self-select into charter schools could be very different from those who do not. 

But never fear.  These researchers are pretty bright and they worried about this problem as well.  So they came up with three novel strategies to address the possibility of selection bias.  First they try the usual (and not entirely persuasive) technique of controlling statistically for any observed differences between the charter and non-charter students, including race/ethnicity, gender, disability status, family income, and — most importantly — 8th grade student test scores. 

But what about the unobserved (and uncontrollable) qualities of students who choose charters?  Well, their second technique to address potential selection bias is that they compare students who were all in charter schools in 8th grade.  The treatment group went on to a charter high school while the control group went to a traditional public high school.  Since both groups began as charter-choosers, the unobserved qualities of people who choose charters should be present in both groups.  As the authors describe it, “If there are unmeasured student/family characteristics that lead to the selection of charter high schools, these unmeasured characteristics ought to also lead to the choice of a charter school at the middle school level.”

But wait, they did one more thing that really nails the potential problem of selection bias.  They took advantage of the fact that not all students who attend charter middle schools live within a reasonable distance of charter high schools (especially in Florida) to create an “exogeneous” instrument for predicting whether students would attend a charter high school.  That is, they could obtain an unbiased estimate of attending charter high school based on geographic distances and then use that unbiased estimate of charter attendance to obtain an unbiased estimate of the effect of attending a charter high school on graduation and college-attendance.  If you don’t trust me that this technique works to correct for selection bias, you can trust the Nobel prize in economics, which was awarded to James Heckman at the University of Chicago for having developed this technique.

This study comes on the heels of positive results from Caroline Hoxby’s random-assignment evaluation of charter schools in New York City.  Random-assignment corrects for potential selection bias because the students accepted into the charter schools by lottery.  Only chance distinguishes the students in the treatment group (charters) from those in the control group (traditional public).  Hoxby’s analysis finds:

“What is the main result or the bottom line for the grade 3-8 tests? New York City’s charter schools raise their third through eighth graders’ math scores by 0.09 standard deviations for every year they spend in the school. Remember, these gains are in addition to whatever gains the students would have been expected to make in the traditional public schools, had they been lotteried-out. This result is statistically significant with a high level of confidence. (The p-value, shown in parentheses, is less than 0.001.) That means that we are very confident, more than 99% confident, that the effects of New York City’s charter schools on math achievement are not zero or negative…. New York City’s Charter Schools raise their third through eighth graders’ reading scores by 0.04 standard deviations for every year they spend in the school. Remember, these gains are in addition to whatever gains the students would have been expected to make in the traditional public schools, had they been lotteried-out. This result is statistically significant with a high level of confidence. (The p-value, shown in parentheses, is 0.016.) That means that we are very confident (98% confident) that the effects of New York City’s Charter Schools on reading achievement are not zero or negative…. What is a standard deviation? A standard deviation or “effect size” is a conventional way of expressing test scores that works for all tests. If students’ scores rise by one standard deviation, it is a large change in achievement. On most tests it corresponds to more than a grade’s worth of learning and more than a performance level.”

So we now have some very well-designed studies to address selection concerns and they are finding significant benefits from attending charter schools.


Grading New York

November 13, 2008

(Guest post by Greg Forster)

Our old friend and colleague Marcus Winters has just released a study on New York City’s school grading program:

In 2006-07, New York City, the largest school district in the United States, decided it would follow several other school systems in adopting a progress report program. Under its program, the city grades schools from A to F according to an accumulating point system based on the weighted average of measurements of school environment, students’ performance, and students’ academic progress.

The implementation of these progress reports has not been without controversy. While many argue that they inform parents about public school quality and encourage schools to improve, others contend that grades lower morale at low-performing schools. To date there has been too little empirical information about the program’s effectiveness to settle these questions.

Schools that recieve D and F grades repeatedly are subject to takeover by the city. A previous study (Rockoff and Turner 2008) found positive results from the program but lacked student-level data. Marcus’s study has got student-level data, regression discontinuity – the whole smash. Tale of the tape:

Students in schools earning an F grade made overall improvements in math the following year, though these improvements occurred primarily among fifth-graders.

Students in F-graded schools did no better or worse in English than students in schools that were not graded F.

Whatever problems NCLB may have, school accountability does work in places where state and local government have the political will to do it seriously. Even in places where the problems seem intractible, like New York City.

EMTs are standing by in case certain people’s heads explode.


The Proficiency Illusion

November 13, 2008

(Guest Post by Matthew Ladner)

I had a chance to see John Cronin from the Northwest Evaluation Association present on the Fordham Foundation’s study The Proficiency Illusion at the Arizona Education Research Organization conference last week. It was more than interesting enough to have me check out the study. From the forward by Checker and Mike:

Standards-based education reform is in deeper trouble than we knew, both the Washington-driven, No Child Left Behind version and the older versions that most states undertook for themselves in the years since A Nation at Risk (1983) and the Charlottesville education summit (1989). It’s in trouble for multiple reasons. Foremost among these: on the whole, states do a bad job of setting (and maintaining) the standards that
matter most—those that define student proficiency for purposes of NCLB and states’ own results-based accountability systems.

In short, the accountability and standards reform strategy has morphed into a pig’s breakfast. We’ve all known for some time that most states have failed to set globally competitive standards, and have monkeyed about with their cut scores. One of the revelations of the Proficiency Illusion (to me) is that many states have proficiency standards lacking internal consistency. For example, some states have incredibly low cut scores in the elementary grades, only to amp them way up in 8th grade. Parents will receive multiple notices saying that their child is “at grade level” only to shocked to learn later that they are well short.

Other types of problems exist as well. Two years ago at the same AERO conference, I saw a presentation showing that Arizona writing AIMS test had bell curves that stacked on top of each other rather than being horizontally linked across grades. In short, it was impossible to tell whether 4th graders were writing any better than 7th graders with the state exam.

Cronin’s presentation contained other insights- including just how arbitrary AYP can be. It depends hugely on the N requirement for subgroups state by state- some schools wind up with lots of subgroups and some don’t. This means that some relatively high performing schools miss AYP. In fact, Cronin demonstrated what I take to be a fairly common scenario where middle schools miss AYP but in which they perform at a higher level than all of the public school transfer options in the vicinity.

Checker and Mike go on to argue for national standards as a solution to these problems, but concede that it doesn’t seem likely. My modest suggestion on this front would be to adopt the A-Plus plan, and as states sought alternatives to AYP, to have the US Department require the creation of internally consistent standards as a starting point for negotiations. Given that the states would be able to determine their own set of sanctions (or lack thereof) I can’t see why an increase in rigor would be outside the realm of these discussions for states with absurdly easy to pass tests.

Deeply wedded to inconsistent standards? Fine- have fun with AYP and the 2014 train wreck.

In other words, if the feds would abandon Utopian nonsense like 2014 and the high quality teacher provision, they might be able to play a productive role in providing technical guidance and nudging states into better directions with their testing programs.

I am not a fan of NCLB, but even I will concede that it has to date had a net positive impact increasing transparency in public schooling. This will be lost, however, if the 2014 problem isn’t addressed, or if we go down the absurd road of portfolio assessments, and I do view transparency as vitally important.

The Proficiency Illusion shows us that much of the data we’ve been getting from state testing programs isn’t nearly as useful or reliable as imagined. This is a problem, and it must be addressed.

 


More Quantification of Greatness

November 12, 2008

(Guest post by Greg Forster)

I was so excited by my effort at quantifying greatness yesterday – well, okay, I was testing Alex Beam’s assertion that Great Books tend to be prohibitively long – anyway, I was so excited I couldn’t resist counting the pages in the Great Books I had at home to add to the data set I acquired in my office yesterday.

I had thought that the books at home would be shorter since I keep some of them there for regular reading, and the ones I read regularly tend to be shorter (for obvious reasons). I forgot, however, that some of them I keep there simply because I don’t read them very often at all, and those books tend to be longer (for obvious reasons). The books in my office represent the middle of the spectrum in terms of how often I read them.

Anyway, here’s what I came up with at home. Remember, our test case is Beam’s book, a history of the Great Books movement that claims Great Books are too long to be easily accessible and that clocks in at 245 pages:

Machiavelli, The Prince: 78 pages

Havel, The Power of the Powerless: 87 pages

Lewis, Mere Christianity: 113 pages

Mill, On Liberty: 113 pages

Bunyan, The Pilgrim’s Progress*: 154 pages

Orwell, 1984: 240 pages

Chesteron, The Everlasting Man: 254 pages

Aristotle, Rhetoric: 257 pages

Dante, Inferno: 260 pages

Swift, Gulliver’s Travels: 293 pages

Augustine, Confessions: 305 pages

Pascal, Reflections: 329 pages

Marsilius of Padua, Defender of the Peace: 432 pages

Kant, Critique of Pure Reason: 628 pages

Smith, The Wealth of Nations: 1,028 pages

*I include only the original Pilgrim’s Progress, not the “second part” that he wrote years later.

Again, Beam is clearly on the shorter side of the halfway mark, but the original finding is confirmed: the broad generalization that Great Books are prohibitively long has been falsified.

Moreover, the distribution of page lengths isn’t a bell curve. It’s clustered – and Beam’s book is right smack dab in the biggest cluster:

great-book-page-lengths

Coming next: a comprehensive set of metrics that quantifies all the qualities that make a book “great,” thus allowing greatness to be expressed mathematically – just like Dr. J. Evans Prichard, Ph.D. did for poetry in Dead Poets Society.