Indiana Might Be the Next Florida

February 21, 2010

Matt has written numerous times on the remarkable progress that has been made in Florida, see for example here.  Forces are gathering in Indiana that suggests they may be next to try to full court press of Florida reforms.  The governor, the state superintendent, the Indianapolis newspaper,  and a bipartisan coalition of state legislators on the education committee seem poised to pursue some significant reforms.

First up on their agenda is passage of a bill to end the social promotion of 3rd graders who are unable to read at a basic level.  Patricia Levesque and I each have op-eds in the Indy Star on this topic , with a favorable introduction from the editor.

Check it out.


The Irony of Social Promotion

January 9, 2009

In the current issue of the Economics of Education Review, Marcus Winters and I have an article about the use of exemptions to Florida’s test-based promotion policy.  Under Florida’s policy students need to perform above a certain level on the 3rd grade reading test to automatically be promoted to 4th grade.  If  students score below that level they can still be promoted if they are granted one of various exemptions.  Some of those exemptions are objectively measured, like scoring well on an alternative test or having certain special ed or English Language Learning classifications.  But other exemptions are more subjectively determined, like having a portfolio of work worthy of being promoted.

Marcus and I looked at who received those exemptions and whether being exempted was beneficial.  We found that African-American and Hispanic students were less likely to receive exemptions and get promoted, controlling for other factors.  That is, minority students with the same test scores and economic status were less likely to be exempted from retention if they fell below the testing threshold.  The test-based policy is not racially biased, since all students who lack the academic skills to pass the test may be retained.  The bias is introduced in who gets exempted from that test-based policy.

And the irony of it all is that failing to receive an exemption actually benefited those minority students academically.  That is, students who were denied the exemption and repeated third grade outperformed their promoted colleagues on achievement tests two years later.  The retained students had more academic skill at the end of 4th grade than their comparable promoted peers at the end of 5th grade — despite being exposed to one less grade of curriculum. 

Minority students denied the exemptions may have been the vicitms of discrimination, but they ended-up making greater academic progress as a result.  Receiving those exemptions wasn’t doing many of the other students any favors.

The St. Pete Times has an article on the study today and had a blog post recently.


The Year That Was

December 15, 2008

It’s getting to be that time when people make lists of good and bad things that happened during the preceding year.  Here’s mine from an interview with Michael F. Shaughnessy of EducationNews.org:

What were the 5 most important developments during 2008 that contributed to reform of K-12 education?

 1)     Barack Obama strongly endorsed the idea that expanding choice and competition is an important part of improving public schools.  He limited his support to expanding choice and competition through the introduction of more charter schools, but the theory is not fundamentally different than doing the same with vouchers.  Whether Obama follows through on this campaign position or not, it is now clear that it is considered politically desirable among both Democrats and Republicans to support choice and competition.  Holdouts from this view, including the teacher unions on the left and curriculum-focused reformers on the right, are being increasingly marginalized.

2)     Sarah Palin, in her only major policy speech, pushed the idea of special education vouchers.  Like Obama embracing choice and competition, Palin embracing special ed vouchers is a symbol of the political attractiveness of the policy.  Special ed voucher programs already exist in Florida, Georgia, Ohio, Utah, and Arizona (pending the resolution of a court case).  I’d expect the idea to spread to several more states in the next four years regardless of Sarah Palin’s political prospects.

3)     Reform ideas, including choice, merit pay, curbing teacher tenure, and promoting alternative certification, are gaining mainstream acceptance in the Democratic Party largely thanks to the efforts of Democrats for Education Reform.  An important indication of this political shift was an event at the Democratic National Convention organized by the Democrats for Education Reform at which an audience of about 500 cheered speakers denouncing the teacher unions and embracing reform ideas. The Democratic supporters of reform largely (but not exclusively) consist of urban minority leaders, including Michelle Rhee, Joel Klein, Adrian Fenty, Cory Booker, Kevin Chavous, Al Sharpton, and Marion Barry.  Go ahead and make all the Sharpton and Barry jokes you like, but this (mostly) minority defection of urban Democrats from union orthodoxy is like a political earthquake that will have important implications for future reform politics.  And it’s true that some conservatives have begun backtracking on reform ideas, including Sol Stern, Diane Ravitch, and depending on the day of the week, Checker Finn and Mike Petrilli.  But if the reform movement has traded some conservatives for the new generation of minority Democratic leadership, I think we’ve come out ahead.

4)     We saw a string of new or expanded school choice programs in 2008.  Georgia adopted a universal tax-credit supported voucher program.  Louisiana adopted a voucher program for New Orleans as well as a personal tax deduction for private school tuition.  Florida expanded and decreased burdensome regulation on its tax-credit supported voucher program.  And Utah increased and secured a source of funding for its special ed voucher program.  For a movement declared dead more times than Generalissimo Francisco Franco, school choice continues to grow.

5)     I’ll take the privilege of the final development to brag about the launch of the new doctoral program in education policy in the Department of Education Reform at the University of Arkansas.  It may not have been among the 5 most important developments in the whole country, but it was a big development in my little world.  With the first cohort of students starting in the Fall of 2009 (supported by a pool of generous fellowships) and a collection of outstanding faculty, we have the potential to significantly increase the number of reform-oriented researchers in academia, think-tanks, and foundations.

What were the 5 most important developments during 2008 that hindered reform of K-12 education?

1)     The reform movement lost two great champions this year with the passing of John Brandl and J. Patrick Rooney.  Brandl, who had been the Democratic leader of Minnesota’s state senate and Dean of the University of Minnesota’s Hubert Humphrey School of Public Policy, contributed significantly to the argument that choice was not only efficient, but also enhanced opportunities for the disadvantaged.  He helped create the state’s pioneering charter school law and other choice programs.  Brandl also served as mentor to many of today’s leading choice researchers.  Rooney, who had always been active in the civil rights movement, personally sponsored scholarships for disadvantaged students to attend private schools.  His privately financed program became a model for publicly funded voucher and tax-credit supported scholarship programs.

2)     In 2008 we saw a number of “implementation” problems undermine otherwise promising reform initiatives.  For example, Georgia adoption a social promotion policy that required students to pass a test or follow a formal exemption policy to be promoted in certain grades.  My research with Marcus Winters on a similar policy in Florida suggested that it would improve student achievement.   But in several districts around Georgia more than 90% of students were promoted without passing the test and without following the formal exemption procedure.  They simply disregarded the law on a large scale with no consequences for any district or school employee.  Another promising idea undermined by implementation was Reading First. There is a lot of rigorous science to support a phonics-based reading approach, but getting public schools to do it well is a completely different matter.  Implementation also appears to have done-in a promising teacher mentoring program.  I could go on, but the point is that there is no shortage of clever reform practices out there.  The problem is that without addressing the lack of proper incentives in the public education system to improve, we regularly see these clever practices fall flat. We need incentive-based reforms along with reform of educational practices.

3)     Earlier this year an Arizona court struck down voucher programs for students with disabilities and students in foster care on the grounds that the state constitution forbids aid to private schools.  This month defenders of the program argued on appeal to the state Supreme Court that the program aids students, not schools.  And the state already sends disabled students to private schools when it is determined that the public schools are unable to provide adequate services.  That practice may also be in jeopardy, even though it is actually required by federal law (IDEA).  Who knows how this will all be resolved, since courts can adopt any interpretation they like, reasonable or unreasonable.  But court action has prevented these beneficial programs from operating and threatens to kill them.

4)     A Florida court struck down the ability of a state commission to approve charter schools.  If upheld by the (notorious) Florida Supreme Court, only school districts could approve charters and existing charters approved by the state commission may have to be closed.  Giving districts the exclusive power to grant charters essentially allows the districts to decide with whom they will have to compete.  It’s like giving McDonalds the exclusive power to approve the opening of all new restaurants.  The state Supreme Court used the same narrow interpretation of clauses in the state constitution to strike down the Opportunity Scholarship voucher program, so the prospects for a vibrant and competitive charter sector in Florida are not good.

5)     And finally the most disappointing development of 2008 is that we spent another half trillion dollars on public education without significantly altering the dysfunctional system that fails to teach a quarter of 8th grade students to read at a basic level or get them to graduate from high school.  Results for minority students are significantly worse.  The economic bailout may be a $700 billion enterprise, but the public school system spends almost that much each and every year.  Every year that we spend that money without fundamentally altering how we operate public education is another fortune wasted and another year lost for millions of students.

(Note: corrected spelling of Marion Barry’s name)


PJM on Candidates’ Education Flip-Flops

November 3, 2008

(Guest post by Greg Forster)

Over the weekend Pajamas Media carried my column on how Obama and Palin have flip-flopped on education:

Suppose I told you Candidate A has supported rigorous academic standards, has stood up to the teachers’ unions — even been booed by them at their convention — and proclaimed the free-market principles that schools should compete for students and better teachers should get higher salaries. On the other hand, Candidate B says that competition hurts schools, that kids should be taught a radical left-wing civics curriculum, that we should throw more money at teachers’ unions — excuse me, at schools — and that rigorous academic standards should be replaced with the unions’ old lower-the-bar favorite, “portfolio assessment.”

Candidate A is Barack Obama. So is Candidate B.

Meanwhile, Candidate C has made an alliance with the teachers’ unions, opposed school choice, thrown money at the unions — excuse me, at schools — and even helped undermine a badly needed reform of bloated union pensions. On the other hand, Candidate D has broken with the teachers’ unions, demanded that schools should have to compete for students, and endorsed the most radical federal education reform agenda ever proposed by a national candidate, including a national school choice program for all disabled students.

Candidate C is Sarah Palin. So is Candidate D.

Important disclaimer:

None of this implies anything about the overall merits of any of these candidates. One can love a candidate overall while hating his or her stand on education, and vice versa.


AJC Op-Ed

July 13, 2008

I have an op-ed in today’s Atlanta Journal Constitution on the social promotion issue in Georgia.


Eduwonkette and Eduwonk Aren’t Edumarried?

July 8, 2008

The New York Sun had a nice profile yesterday of Eduwonkette.  Well, it’s not exactly a profile because Eduwonkette writes anonymously.  In the article some folks complain that her anonymity is a problem: “A co-director of the Education Sector think tank, Andrew Rotherham, suggested on his blog Eduwonk that Eduwonkette might be unfairly pretending to be unbiased because she has ‘skin in the game… It’s this issue of you got all this information to readers, without a vital piece of information for them to put it in context.'”

I think Andy’s mistaken on this. (Did they have some kind of edu-break-up?)  The issue is not who Eduonkette is, but whether she is right or not.  Knowing who she is does not make her evidence or arguments any more or less compelling.  I wish we all spent a whole lot less time analyzing people’s motives and a whole lot more time on their evidence and arguments. 

The only major problem with anonymity is lack of responsibility for being wrong.  There is a reputational price for making bad arguments or getting the evidence wrong that Eduwonkette avoids paying professionally — although she does pay a reputational price to the name brand of Eduwonkette.

Speaking of being wrong, Eduwonkette knocks the study Marcus Winters, Julie Trivitt, and I released today through the Manhattan Institute.  She complains: “It may be an elegantly executed study, or it may be a terrible study. The trouble is that based on the embargoed version released to the press, on which many a news article will appear today, it’s impossible to tell. There is a technical appendix, but that wasn’t provided up front to the press with the glossy embargoed study. Though the embargo has been lifted now and the report is publicly available, the technical appendix is not.”

This isn’t correct.  Embargoed copies of the study were provided to reporters upon their request.  If they requested the technical report, they could get that.  Both were available well in advance to reporters so that they could take time to read it and circulate it to other experts before writing a story.  Both the study and the technical report were made publicly available today (although there seems to be a glitch with the link to the technical report that should be fixed within hours).  The technical report can be found here.

And while we are on the subject of Eduwonkette being wrong, her attacks on test-based promotion policies are overdone.  The Jacob and Lefgren paper does raise concerns, but there is more positive evidence from the experience in Florida.  As I wrote in a previous post: “In a study I did with Marcus Winters that was published in Education Finance and Policy, we found that retained students significantly outperformed their comparable peers over the next two years.  In another study we published in the Economics of Education Review, we found that schools were not effective at identifying which students should be exempted from this test-based promotion policy and appeared to discriminate in applying these exemptions.  That is, white students were more likely to be exempted by school officials in Florida from being retained, but those students suffered academically by being exempted.”

Our results may actually be consistent with what Jacob and Lefgren find.  We find academic benefits for students retained in third grade.  They find: “that grade retention leads to a modest increase in the probability of dropping out for older students, but has no significant effect on younger students.”  It could be that test-based promotion is more beneficial when done with younger students.  It could also be that the policy has positive effects on achievement with some cost to graduation. 

And particularly severe problems with the integrity of test results used for promotion decisions in Chicago may limit the ability to generalize from Chicago’s experience.  In Chicago it may have been easier to move retained students forward by cheating on the next test than actually teaching them the basic skills they need to succeed in the next grade.

Besides, I’m sure that Edwuonkette wouldn’t put too much stock in Jacob and Lefgren’s non-peer-reviewed paper released straight to the public.  I’m sure she would be consistent in her view that: “By the time the study’s main findings already have been widely disseminated, some sucker with expertise in regression discontinuity may find a mistake while combing through that appendix, one that could alter the results of the study. But the news cycle will have moved on by then. Good luck interesting a reporter in that story… So as much as I like to kvetch about peer review and the pain and suffering it inflicts, it makes educational research better. It catches many problems and errors before studies go prime time, even if it doesn’t always work perfectly.”  

Or do these standards only apply to studies whose findings she doesn’t like?   If Eduwonkette isn’t careful she might get a reputation.


Anti-Social Promotion

June 30, 2008

Georgia joined several other major school systems, including Florida, Texas, New York City, and Chicago, when its legislature mandated that student promotion to the next grade be linked to performance on standardized tests.  All failing students in certain grades must re-take the test, according to state law.  Students failing twice can be promoted anyway if the parents, principal, and teachers review the student’s other work and agree that promotion would be beneficial, but it is clear that this should be the exception, not the rule. 

But according to a report in yesterday’s Atlanta Journal Constitution, “school districts are promoting the vast majority of [failing] students anyway… In 2007, for instance, 92 percent of the nearly 9,500 eighth-graders who couldn’t pass the math CRCT were promoted.”    In Clayton County 97 percent of students who failed the re-test to get promoted or simply didn’t take the re-test were promoted to the next grade.  When asked about why these students were promoted, the District issued a statement that said, “the philosophy of prior administrators was to promote students who failed and provide them remediation.”

Oh.  I see.  The law says that students unable to pass the state’s test ought to be retained but Clayton County school officials had a different philosophy.  Their philosophy was that they don’t have to follow the law. 

Districts weren’t simply exploiting the loophole of promoting students by consent of parents, teachers, and principals.  Districts were directly violating the law by promoting students who did not even take the re-test, which is clearly mandated for all students before promotion by alternative means can be considered.  As the AJC writes, “About one in five students missed the retest after failing a high-stakes CRCT in 2006 and 2007.  Eighty percent were promoted anyway.”

Non-compliance by public school officials with legal mandates is an enormous obstacle to education reform.  Even if one thinks that this particular mandate on social promotion is mis-guided, the frequency with which school officials feel free to flout legally mandated attempts at reform undermines the potential for any reform strategy.

In an earlier study I led on NCLB’s choice provisions, I found that the requirement that chronically failing schools inform parents that they had the option to transfer to other schools was undermined by the failure of schools to inform parents of that option.  (The study was published in the Georgetown Journal of Law and Public Policy, but an earlier free version of it can be found here.)

Problems with implementation have also been central themes in the discussions on this blog on Response to Intervention, Reading First, more Reading First, and more Reading First. Until we develop the political will to actually enforce the reforms we do adopt, we shouldn’t expect much from them.

In addition, the evidence from Florida suggests that limiting social promotion by linking testing to retention is actually a very beneficial reform.  In a study I did with Marcus Winters that was published in Education Finance and Policy, we found that retained students significantly outperformed their comparable peers over the next two years.  In another study we published in the Economics of Education Review, we found that schools were not effective at identifying which students should be exempted from this test-based promotion policy and appeared to discriminate in applying these exemptions.  That is, white students were more likely to be exempted by school officials in Florida from being retained, but those students suffered academically by being exempted.

But the more important point is that each school district, school, or teacher cannot decide whether to comply with the law or not.  These are public schools and the public, through their elected representatives, is entitled to set policies that govern how those schools will operate.


Dr. Winters, I Presume

April 28, 2008

Marcus A. Winters, the first graduate student supported by the Department of Education Reform at the University of Arkansas, has completed the requirements to receive a doctorate in economics. 

His dissertation consists of three pieces, as is standard in economics.  One of those pieces is on the effects of test-based grade retention (limiting social promotion) on subsequent student achievement in Florida.  A version of that research has been published in the journal Education Finance and Policy

Next time you see Dr. Winters, be sure to congratulate him.  You’ll probably find him on the streets of New York, as he is currently a senior fellow at the Manhattan Institute.

Speaking of which, Marcus — I mean — Dr. Winters and I will be releasing tomorrow a new study on the effects of special education vouchers in Florida on the academic achievement of disabled students who remain in public schools.  You can tune in here tomorrow to find the study and other commentary.