The Rorschach inkblot test is a psychology test that was used to assess personality and emotions. The way in which people saw ambiguous images, like the one above, was supposed to say something about who they really were.
The same is true for the interpretations being applied to the results of the 2007 TIMSS (Trends in International Mathematics and Science Study) released today.
Over at Flypaper, Mike Petrilli interprets the gains the US has made in math but not science as suggesting that accountability testing is shifting resources toward math and away from science: “The lesson is that what gets tested gets taught. Under the No Child Left Behind act, and state accountability systems before that, elementary schools have been held accountable for boosting performance in math and reading. There is evidence that American elementary schools are spending less time teaching science, and this is showing up in the international testing data.”
And Mike interprets the relatively good results that Minnesota had (yes, MN took the test as if it were a country) as supporting rigorous standards: “There’s also good news out of Minnesota today, which has made dramatic gains since adopting new, more rigorous math standards.”
But also at Flypaper, Diane Ravtich offers different interpretations. She sees the gains even in math results as “actually small, only four points.” She also declines to credit NCLB for any of those gains, even as a perverse result of resource shifting away from science. She notes that gains were at least as large in the US during the period prior to implementation of NCLB. And on the topic of Minnesota she takes issue with Mikes explanation for success: “Minnesota showed dramatic gains on TIMSS not because of ‘new, more rigorous standards,’ but because of that state’s decision to implement a coherent grade-by-grade curriculum in mathematics.” Umm, I would explain the difference but I got so bored trying to distinguish standards from curriculum that I dozed off for a bit.
Rather than focusing on the gains (or lack of gains) made by the US relative to itself in the past, Mark Schneider at Education Week focuses on the comparison between the US and other countries. He notes that while the US looks relatively strong on the TIMSS, that is distorted by the large number of “low-performing countries in the calculation of the international average [including Jordan, Romania, Morocco, and South Africa that] drives down that average, improving the relative performance of our students.”
He further notes that we fare worse on the PISA, which reports results from the 30 OECD countries who are our major trading partners and economic competitors: “We do better in TIMSS than we do on PISA, but this is a function of the countries that participate in each, and we should not let the relatively good TIMSS results lull us into a false sense of complacency. Even in the relatively easier playing field of TIMSS, we are lagging far too many countries in overall math performance and in the performance of our best students.”
And at Huffington Post Gerald Bracey was able to offer his reaction to the results last week, before they were released. He wrote: “It might be good to keep a few things in mind when considering the data:
1. The Institute for Management Development rates the U. S. #1 in global competitiveness.
2. The World Economic Forum ranks the U. S. #1 in global competitiveness.
4. “The fact is that test-score comparisons tell us little about the quality of education in any country.” (Iris Rotberg, Education Week June 11, 2008).
5. ‘That the U. S., the world’s top economic performing country, was found to have schooling attainments that are only middling casts fundamental doubts on the value, and approach, of these surveys…’”
Bracey also said that our students could beat up the students in other countries with higher TIMSS scores. (Actually, I made that last bit up.)
To summarize, Mike Petrilli sees evidence supporting his past concerns about the narrowing of the curriculum and the need for rigorous standards. Diane Ravitch sees no evidence to alter her negative view of NCLB. Mark Schneider, the former head of the National Center for Education Statistics, sees the need to review more testing. And Gerald Bracey doesn’t even have to see the results to know that our education system is doing a great job. And when I look at the inkblot I see a pudgy guy with a beard and male-patterned baldness laughing.
(edited for clarity)