NAEP Cohort Gains for Students with Disabilities, 2011 to 2015

March 22, 2017

(Guest Post by Matthew Ladner)

Which states had the most success teaching math and reading to their students between grades 4 and 8 on the most recent NAEP exams?

Quick (really boring) caveat section- tracking NAEP cohort gains gets more inexact due to the larger standard error of estimate when examining subgroup scores- which exists in both the 4th and 8th grade scores. Accordingly, don’t get too excited if your arch-rival Idaho edges you out by a point, because if we knew a true population score rather than sampled estimate it could easily be the other way around. It is more appropriate to look to see whether the state nearest and dearest to your heart landed near the top, or near the bottom of the list than to obsess about their ranking. Moreover, given the possible role sampling error, it is probably best to consider looking at the math and reading scores together. If a state rocks one of the tests and performs not so great on the other, you may have gotten a lucky sampling error bounce on one test, or a bad bounce on the other, or maybe your state is just better at teaching one of these subjects than the other. You would have to consult other sources of data to figure that out. Conversely, if a state does well on both reading and math it is unlikely that sampling error is driving the result in both cases, assuming randomly distributed error.

Ok so on with the show:

Top ranked Hawaii had gains more than twice as large as bottom ranked Maryland. Note that both of the bottom states (MD and KY) have a noted prior history of high exclusion rates for special needs children in NAEP. If they excluded a high percentage of kids in 2011 4th grade testing but not in 2015 8th grade testing, an appearance of catastrophe could sneak in. I am happy to note that my patch of cactus lies near the top. What about math?

Note that the overall gains for math are smaller than for reading. Also Hawaii is again at the top, and Arizona is near the top. Again Maryland appears to have taught a little more than one year’s worth of math to special needs students in four years, but I suspect that strange things are afoot at the MD Circle K on that one. I could dig into NAEP pdf files to check on exclusion rates but alas it is time for me to get out of my pajamas, so I will leave that to whatever you call people from Maryland. Marylanders?

Leave a Comment » | NAEP | Tagged: | Permalink
Posted by matthewladner

2011 NAEP Guide Where to Avoid Being Reincarnated as a Student with a Disability

November 2, 2011

(Guest Post by Matthew Ladner)

I’m back from SLC, where I had the honor of serving as the opening act to Indiana Superintendent of Public Instruction Tony Bennett. Getting back to the mad science of exploring the 2011 NAEP, and keeping with a sudden OCD fear that I have developed over the possibility of being reincarnated, I present to you the states you want to avoid and those you want to pray to be born into in the next go-around if you happen to be born as a child with a learning disability, and you would like to learn how to read by the 4th grade.

So, whatever you do, try to load the dice to stay out of Washington DC, Hawaii, South Carolina, Alaska and Arizona if you think you might be coming back as a child with a disability.

Conversely, you’ve hit the relative jackpot if you land in Maryland, Massachusetts, Kentucky,New Jersey or Florida.

Seriously DC? 153?!? A mere 60+ point difference between next door neighbor Maryland?

My Cosmic Awareness/Spidey Sense just told me that you were just thinking “yeah, but hey no fair, because Maryland is far wealthier than DC.”

Except, well, it doesn’t really matter so much in terms of the gap. Below you will see a chart for Free and Reduced Lunch Eligible students with disabilities. The top 5 get shuffled a bit, but there is still an appalling gap between DC and the top performing states.

So as you make your reincarnation plans, just remember to stay away from DC, whereas if you have the misfortune of being born with a disability the chances of being academically warehoused seem to approach a near certainty.

Sadly, DC has plenty of company at the bottom.

9 Comments | myth of helplessness | Tagged: , | Permalink
Posted by matthewladner