The Devil’s in the Implementation

May 13, 2008

What went wrong with Reading First?  Don’t blame the evaluation.  Its regression discontinuity design approximates a random assignment experiment — the gold standard of research designs.  It allows us to know with confidence the effect of Reading First on the marginal adopter’s reading achievement.  We can’t assess the effect of Reading First on the first adopters or those who were rated as most in need, but a broadly useful program should have effects beyond those most eager or most desperate.  Reid Lyon is correct in noting that the evaluation did not address everything that we want to know.  And it is always possible that the program needs more time to show results.  But so far we have a null result.

We’re left with two possible explanations.  Either Reading First is conceptually mistaken or it was improperly implemented.  We have good reason to believe that it is the latter.  The science behind Reading First is pretty solid.  A greater emphasis on phonics seems to have a particularly beneficial effect on students from disadvantaged backgrounds. 

Reading First is probably the right idea but as with almost every instructional reform the devil is in the implementation.  The problem is that educators have few incentives to embrace and properly apply new instructional ideas.  It’s not that educators are uninterested in improving instructional approaches.  The problem is that they have often developed approaches from their own experience and training that they think works and are very skeptical of the latest great thing thrown their way.  Any theory of reform that is based on the assumption that educators are eagerly awaiting being informed of what works and will gladly do it once they are told is incredibly naive. 

Even if we could find the right techniques, the difficulty is in getting educators to adopt it and implement it properly.  This is so difficult because teachers don’t experience any meaningful consequences if they properly implement an instructional reform or if they don’t.  And since most teachers have developed routines with which they are comfortable and that they believe are effective, getting them to do something else without any real carrots or sticks is like getting children to eat spinach merely by suggesting it.  You can tell them that it’s really good for them, but they’d rather stick with the familiar mac and cheese.

The evaluation helps confirm that the problem was in implementation.  The differences between the treatment and control groups in time spent on phonics were very small.  And the treatment group was doing far less than the program has planned.  Similar problems have plagues other instructional reforms.  For example, see Mathematica’s evaluation of technology in the classroom, where usage of the technology by the treatment groups was only marginally greater than the control group.  Or see SRI’s evaluation of Following the Leaders, where the treatment group similarly barely used the intervention.  It should come as no surprise that the medicine doesn’t work if people won’t take their pills.

The solution that is usually offered when educators fail to implement an instructional reform is that we need to improve professional development so that they learn better how wonderful the intervention is and why/how they should use it.  Call it education disease — the solution to all problems is more education.  It’s an infinite regress.

Instead the obvious solution is that we have to address the incentives that educators have to adopt and properly implement effective instructional reforms.  Either the direct incentives of accountability with real consequences for teachers (like merit pay or job security) or the indirect incentives of market-based reforms (like school choice) would sharpen educators’ efforts in this regard.

This is why instructional reforms and incentive reforms have to go hand-in-hand.  Educators need to have effective ideas of what to do and they have to have the proper incentives to adopt and implement those effective ideas.  That’s also why pitting instructional reform against incentive reform makes no sense.  We need both.


Buzzword Bingo

May 12, 2008

Too much of what is in education journals is drivel.  But to disguise that nonsense and obscure how “research” resources and time are wasted, the field has developed important-sounding jargon.  Anyone who uses fancy terms, like “neoliberal,” “epistemological pathways,” and “discourses,” has to know something.  Right?

So, I am proposing a little game of Buzzword Bingo.  In the table below are actual terms taken from leading education journal article titles. 

Here’s how you play.  The first person to spell Bingo by making a vertical, horizontal, or diagonal line by finding those terms in education journals wins!  Just send an email or post a comment with citations to where you found the words.  The prize is the respect of all that you managed to sift through a bunch of education journal articles.

  B I N G O
B  neoliberal epistemological pathways  discourses dialectic meganarratives
I neotracking  sociocultural  haptic modality  counter-    narratives
N  detracking constructivism FREE multimodality   narratives
G  queering authentic learning ocularcentrism  ethnographic   mindfulness
O  deconstruct  sociohistorical essenitalism socio-political phonocentrism

While collecting these terms I’ve learned a handy rule of thumb for interpreting education jargon.  If something starts with “neo” it is bad.  If it starts with “post” it is good.  For example, “liberal” would normally be fine.  But make it “neoliberal” and then it is bad.  Neoconservative is also bad, but so was plain old “conservative.”

Even though the prefix “post” has a meaning similar to “neo,” it has a totally different effect within the world of education buzzword bingo.  For example, “materialism” is bad, but “post-materialism” is good.  “Modernity” is good.  “Post-modernity” is even better.

I think the idea is that “neo” suggests a rehashing of an old, failed concept.  “Post” means moving beyond and improving upon the old.  So I would have to guess that “neotracking” is bad, just a rehashing of old tracking ideas.  “Post-tracking” would be good —  moving beyond the old idea of tracking.

Here’s another simple trick. Just add “socio” to any word.  It doesn’t seem to add much meaning, but it does sound impressive.  I know that we’ve had socioeconomic for a long time, but now we have sociocultural, sociohistorical, and socio-political.  I’m thinking about introducing socio-social.  Or how about socio-materialism?  Socio-modernity?  Socio-narratives?  Once you start you see how easy it really is!

Now you can invent your own jargon at home!  Enjoy!

UPDATE

We have a winner!  Congratulations to Matt Ladner for managing to find:  meganarratives, counter-narratives, narratives, mindfulness, and phonocentrism in education publications.  I would say that now he can get a PhD but he already has one.

Another reader suggested that we change the name of the game to Lingo Bingo.  I don’t know.  It’s a tough choice between rhyming and alliteration.

Also, can someone come up with the best word for something bigger than meganarratives?  Mega is the prefix that means “million.”  A billion would be giga, so how about giganarratives?  This is almost as much fun as adding socio to words.  How about socio-giganarratives?


Get Lost 3

May 9, 2008

 

This third installment of our end-of-week Lost discussion marks the end of the third week since this blog started. 

Before getting to Lost, let me review the blog’s performance to date.  Since the first post on April 19 and the first public announcement of its creation on April 21, this blog has been viewed more than 9,200 times.  That works out to more than 480 times per day, including weekends, since the announcement. 

At least 39 other blogs have linked to this one. There have been a total of 39 posts, excluding this one, and a total of 171 comments. 

Thanks to Larry Bernstein, Greg Forster, Matthew Ladner, Dan Lips, Reid Lyon, and Ryan Marsh for their posts.  Greg and Matt are regular contributors and have done a remarkable job of providing informative and provocative material.  Reid Lyon has agreed to join the group of regular contributors, with his posts appearing on Tuesdays.  Greg normally appears (at a minimum) on Wednesdays and Matt on Fridays.  Thanks to all of these posters as well as the contributors of the 171 comments and the numerous links.  I really meant the “with help from some friends” subtitle.

And now back to our show — Lost.  I retract almost everything I said last week (who says that I never change my position?).  If the plot has strayed into the supernatural from the merely paranormal or sci-fi, I don’t mind.  The plot twists and mysteries are only getting better.

The most interesting development in the most recent episode (to my mind) was the idea of people being “chosen” by the island to protect it.  Clearly Ben was once special, receiving communications in the form of dreams, visiting with Jacob, being immune from illness, having control over events, etc…  But now Locke is the chosen one.  And we see that there is a process involving Richard and Abaddon to identify, recruit, and perhaps manipulate these chosen future leaders.  It’s not clear if Richard, Abaddon, Dharma, and Widmore are all on the same team, were once together but have since split, or have always been working against each other.  At least we now know that Richard does not age.

My guess is that Widmore was once the one chosen by the island but Ben succeeded him, which is why Widmore says Ben stole everything.  And I would further guess that Aaron is the next chosen one.  It seems that the chosen one has to be raised apart from his parents, as was the case for Ben and Locke.  Perhaps this is why Claire has been separated from Aaron — to prepare him for his role.  And perhaps the psychic warned Claire that she had to raise the baby herself to prevent Aaron from assuming his chosen role.


Arabian Gulf Money and US Universities (Continued)

May 7, 2008

As I established in my last post, gifts and contracts from Arabian Gulf countries (Bahrain, Kuwait, Oman, Qatar, Saudi Arabia, and the United Arab Emirates) are a large portion of all foreign funds given to US universities.  And those countries give much more relative to the size of their economies than do almost all other countries.

Before discussing where that money is going and what it means, I should state my preferences upfront.  To the extent that Arabian Gulf money in US universities is reducing criticism of those regimes and increasing criticism of the US and Israel, I think that is a negative development.  Gulf countries, principally Saudi Arabia, are currently governed by fundamentally illiberal regimes that are relatively oppressive toward political, religious, and cultural dissent within their countries.  They also promote a foreign policy agenda that is antithetical to desirable US values and interests.  And while the US and Israel are certainly worthy of criticism, they are generally forces for good in that they offer relative freedom within their countries and generally promote positive values outside.  To dwell on the errors of the US and Israel while neglecting the abuses of Arab states is an inversion of moral priorities. 

I understand a full defense of these views would require a longer argument and am prepared to offer one at a later time.  For our purposes, I assume (and think most readers would agree) that promoting more criticism of the US and Israel while suppressing criticism of Arab states is a bad thing.

 So where does Arabian Gulf money go in US higher education?  Most of what is reported is categorized as “contracts,” not gifts.  Of the almost $322 million from Gulf states, nearly $234 million is labeled as contracts.  The contracts appear mostly to be for the purchase of support and research related to Arabian Gulf oil production.  For example, $111 million of the $234 million in contracts went to Carnegie Mellon University from the Supreme Council for Information and Technology in Qatar.  Another $19 million went to the Colorado School of Mines from the  Adu Dhabi National Oil Company.  There may be political effects of these contracts, but they appear to be largely related to economic activities.

That leaves a little more than $88 million in total gifts (not contracts) from Arabian Gulf donors since 1995 that have gone to 14 US universities.

Recipients of Arabian Gulf Gifts Since 1995
   
American University (The) $500,000
Boston University $1,500,237
Columbia University $500,000
Cornell University $10,900,000
George Washington University $11,953,519
Georgetown University $16,232,667
Harvard University $11,871,563
Howard University $250,000
MIT $10,000,000
Michigan State University $926,740
Rice University $2,750,000
Texas A&M University $1,498,671
Tufts University $1,000,000
University of Arkansas $18,312,524
   
Total $88,195,921

 While $88 million feels like a lot of money, it is an extremely small portion of university endowments.  According to the National Association of College and University Business Officers, the 785 higher education institutions they surveyed had a total of $524 billion in endowments as of fiscal 2007.  That makes the Arabian Gulf contributions .02% of the total.  Even at the 14 receiving universities listed above, the Arabian Gulf money is a small portion of their individual endowments.  For example, at Georgetown the reported gift constitutes 1.5% of their endowment.  At the University of Arkansas, where I am a professor but not a beneficiary, the Saudi gift is little more than 2% of the endowment.  Nowhere else is the gift amount in excess of 2% of endowment.

The income generated from these gifts is an even smaller portion of the annual operating budgets of these institutions.  Normally less than 5% of endowment gifts can be spent annually, meaning that $88 million dollars would generate less than $4.4 million in money that could be spent each year.  At George Washington University the FY 2008 budget calls for $553 million in revenue, while the almost $12 million Arabian Gulf in gifts should produce roughly $600K, or .1% of annual revenue.  At Columbia University the FY 2006 budget reports almost $2.7 billion in revenue, while Arabian Gulf gifts would produce roughly $25,000 of that, which is basically rounding error.

While the Arabian Gulf countries are dispropotionately large foreign donors to US universities, the size of their gifts pales in comparison to the total endowments or annual budgets of these institutions.  American universities may be cheap dates, willing to do quite a lot for that marginal dollar, but they aren’t that cheap.  It’s unlikely that Arabian Gulf money is buying a significant change in the priorities of the universities to which they are donating. 

It’s true that the 14 recipient universities include a disproportionate number of academics who are willing to offer apologies for Arab atrocities while inflating US and Israeli misdeeds.  For those who would rely on David Horowitz’s list of the 101 most dangerous professors as a guide (and I am in no position to endorse or refute his list), 16 are housed in these 14 universities.  Given that there are almost 1,000 colleges and universities in the US, having almost one-sixth of the “dangerous professors” at these 14 universities is a fairly high concentration. 

Arabian Gulf money tends to go where there are professors friendly to their world view.  The money may give those professors a larger megaphone, but for the most part they were already at these institutions and their views were unchanged by receiving the gift.  So, Arabian Gulf money is unlikely to be buying much of the priorities of universities or the views of the recipient professors.

But before we breath a sigh of relief, we need to consider the scale of these gifts relative to pre-existing funding in Middle Eastern Studies.  Having $4.4 million to spend each year may not be a large amount of money to US universities, but it is quite a lot of money within the relatively limited world of Middle Eastern Studies.  People wishing to have productive careers in that field may alter the emphasis of their work in the hopes of attracting another $18 million gift.  And the power of recipients of these gifts to reward like-minded friends and punish critics is enhanced.  This all helps populate Middle Eastern Studies programs and the State Department and CIA, which hire their graduates, with people inclined toward a Gulf Arab view.

Martin Kramer articulated the problem: “Of course, this is why we can’t ever expect to get the straight story on Saudi Arabia, Wahhabism and oil from people who operate within Middle Eastern studies. If you want a fabulously wealthy Saudi royal to drop out of the sky in his private jet and leave a few million, you had better watch what you say — which means you had better say nothing.” 

But if the problem is that prospective (not established) Middle East experts can be bought on the cheap, an obvious solution presents itself.  People who think there should be more criticism of Saudi Arabia and less of the US and Israel should make their own gifts to universities.  Countering $88 million over a dozen years from the Gulf Arabs shouldn’t be beyond the collective financial reach of supporters of US and Israeli world views.

Of course, working out the details with universities can be a tricky business for people wishing to promote greater emphasis on certain issues, but there are organizations that can help facilitate that process.  For example, the Veritas Fund for Higher Education Reform, run by my friend David DesRosiers, works with donors to ensure that their intent is followed.

And people can only effectively counter Arabian Gulf influence if they are aware of how much money is being given and to where it is going.  Toward that end, Stanley Kurtz has called for legislation that would enhance the transparency of foreign donations while worrying that the existing information, on which I base my analysis, may be incomplete.

In sum, the problem of Arabian Gulf influence in US higher education is real, but can effectively be countered and contained by those with opposing views.


Arabian Gulf Money and US Universities

May 6, 2008

A number of observers have noted some large gifts originating from Saudi Arabia and other Arabian Gulf countries to US universities.  The purpose of this post is to put in perspective how large those gifts are.  In subsequent posts I’ll discuss where the money is going and what it may mean.

The motivation for this post comes from Stanley Kurtz, who has a piece over at National Review Online with a list of gifts and contracts from foreign sources to U.S. universities.  Kurtz rightly emphasizes: “To treat all or even most foreign gifts to American colleges or universities as somehow nefarious would be a serious mistake. America’s institutions of higher education — with their superb programs in science, medicine, and engineering — rightly benefit from the largesse of America’s foreign friends and allies, many of whom have benefited directly from the technical expertise developed in these institutions.”

But he continues: “On the other hand, there are reasonable grounds to fear that some foreign donations may purchase undue influence over the way in which highly controversial subjects are treated in American lecture halls.”

I would add a further caveat that gifts to universities rarely, if ever, lead professors to alter the views they hold.  The slogan, “follow the money,” is a gross oversimplification of how academia works.  While one can’t simply buy ideas in academia, it is important to examine donations as an indicator of priorities in those institutions.  The money doesn’t buy ideas, but it can buy emphasis on some issues and some types of academics over others.

That being said, Arabian Gulf money is clearly a significant issue in higher education.  According to the federal filings Kurtz reproduces, Arabian Gulf gifts and contracts to US universities have exceeded $321 million since 1995.  That’s more than 16% of all reported gifts and contracts from foreign sources. 

To put the magnitude of those gifts in perspective, the Arabian Gulf states from which the money came have economies that represent less than 2% of global GDP (excluding the US).  So, their share of foreign gifts to US universities is eight times as large as their foreign share of global wealth production.  The Arabian Gulf states are exceptionally interested in US higher education.  The breakdown by country can be seen in the table below: 

Gifts and Contracts from Arabian Gulf States to U.S. Universities Since 1995
       
  Gifts and Contracts % of Total Foreign Gifts Share of Global GDP (ex US)
BAHRAIN $8,199,058 0.42% 0.05%
KUWAIT $7,639,854 0.39% 0.27%
OMAN $9,046,801 0.46% 0.12%
QATAR $151,702,156 7.75% 0.13%
SAUDI ARABIA $92,972,720 4.75% 1.10%
UAE $52,058,098 2.66% 0.28%
       
Total Gulf States $321,618,687 16.44% 1.95%

How do these figures compare with gifts and contracts from other foreign sources to US universities?  If we look at donations from the 10 largest trading partners with the US (excluding Saudi Arabia, which ranks 9th), we see that they are roughly proportionate to their share of global GDP.

Gifts and Contracts from Top Trading Partners (ex Saudis) to U.S. Universities Since 1995
       
  Gifts and Contracts % of Total Foreign Gifts Share of Global GDP (ex US)
 Canada  $73,418,414 3.75% 2.45%
 Mexico  $21,272,215 1.09% 2.60%
 China  $53,266,855 2.72% 13.55%
Japan $257,196,140 13.15% 8.36%
Germany $207,624,660 10.61% 5.45%
 United Kingdom  $163,232,433 8.34% 4.13%
 Korea, South  $42,893,079 2.19% 2.32%
 France  $62,638,953 3.20% 3.98%
 Netherlands  $34,800,500 1.78% 1.23%
       
Total $916,343,249 46.84% 44.09%

The highest ratio of share of foreign gifts to share of GDP is 2 to 1 among these major trading partners.  Certainly none of these countries gives at a rate that is 8 times out of proportion with its wealth. (Although as South Park would say, we have to watch those Canadians, with their floppy heads and pointy eyes.)

Tune in here for a discussion of why the Arabian Gulf states may have such a strong interest in US universities and what it may all mean.

This Piece Continues Here.


Odds and Ends

May 3, 2008

Florida just passed an expansion of its tax-credit funded scholarship program (read: vouchers).  You can see the bill here.  So much for vouchers being politically dead.

Also here is a neat new study in Education Next by William Howell and Marty West that finds that Americans seriously under-estimate how much is spent per pupil in K-12 public education as well as how much teachers are paid. 


More Special Ed Voucher Study

May 3, 2008

I’ll be on C-SPAN with Marcus Winters Monday morning at 9 am ET to discuss our new study on special education vouchers.  The show is Washington Journal, which has a call-in format.  We look forward to hearing from you!

You can find links to the study and some op-eds in the announcement below:

New Report by Jay Greene and Marcus Winters
 Manhattan Institute senior fellows Jay P. Greene and Marcus Winters have released a new report entitled, “The Effect of Special Education Vouchers on Public School Achievement: Evidence from Florida’s McKay Scholarship Program.” The authors conclude that the McKay program has had a positive effect on the quality of education that public schools provide to disabled students.
To read the report, click here.


WASHINGTON TIMES SERIES:Winters and Greene have been featured in a three part series for The Washington Times, read their articles below.The Politics of Special-Ed Vouchers Jay P. Greene and Marcus Winters, Washington Times,05-01-08
Vouchers for special-ed students Jay P. Greene and Marcus A. Winters, Washington Times, 04-30-08
Vouchers and Special Education Marcus A. Winters and Jay P. Greene, Washington Times, 04-29-08


OP-ED:
A Special-Ed Fix, Jay P. Greene and Marcus A. Winters, New York Post, 04-30-08
INTERVIEW:
An Interview with Marcus Winters: Special Education Vouchers, EdNews.org, 4-30-08       

UPDATE

Here’s another op-ed in an Arizona newspaper.


Get Lost 2

May 2, 2008

And now for another installment in our weekly Lost discussion. (If you don’t care about Lost, just skip to the other posts).

A central theme in Lost has been the ambiguity about whether events occur as a matter of luck or as the result of a supernatural plan.  It’s true that it would have to be incredible luck, but up until the most recent episode everything (or almost everything) could be explained without resorting to the supernatural.

Now the ambiguity is dissolving and it is becoming very clear that supernatural explanations are required.  The most obvious sign of this is the introduction of dead people as characters who talk to multiple people, carry things, etc…  In other words, we can no longer hold onto the possibility that the appearance of a dead person is simply the delusion of a single living person.  The show has largely foreclosed the possibility of psychological explanations.

I think this takes some of the fun out of the show since a central mystery is being resolved.  It’s true that we still have to discover the nature and purpose of these supernatural forces, but that’s a much less interesting puzzle.  Once we get into the supernatural, the rules could be whatever they want them to be.


More Political Donations from Academia

May 2, 2008

A little more detail on the data I gathered for my earlier post about political contributions from university employees…

The dollars involved are not trivial.  From the top ten ranked universities I examined, more than $2.2 million was donated to candidates and supporting organizations during the 2008 election cycle alone.  Harvard led the pack with more than a half million dollars in contributions.  The results for all ten are here:

Political Contributions During 2008 Election Cycle
  Dollars Number of Donations
Princeton $151,433 208
Harvard $502,234 539
Yale $218,656 258
Stanford $292,660 461
Penn $197,038 273
Cal Tech $28,581 41
MIT $17,430 31
Duke $139,236 239
Columbia $397,231 510
Chicago $293,580 414
     
Total $2,238,079 2974

Reading First Disappoints

May 1, 2008

A new study released today by the U.S. Department of Education finds that Reading First, the phonics based federally-funded reading program, failed to yield improvements in reading comprehension.  The study doesn’t demonstrate that it is ineffective to emphasize phonics; only that it was ineffective to adopt this particular program.  That could be because there are problems with the design or implementation of Reading First.  Or it could be because the control group was also receiving phonics instruction without the particular elements of Reading First.  And it is possible that phonics is less effective than some people thought.

Whatever the explanation, this well-designed study undermines confidence that instructional reform, like Reading First, can alone transform the educational system