Comments, observations and thoughts from two bloggers on applied statistics, higher education and epidemiology. Joseph is an associate professor. Mark is a professional statistician and former math teacher.
Thursday, January 20, 2011
Contractually obligated to mention Canada again
If we had a properly functioning debate on education reform in this country, movement advocates would expect to be presented with counter-arguments; they would even anticipate them. New examples would be sought out, positions would be refined and the intellectual framework of the reform movement would be stronger for it.
But we don't have a properly functioning debate. Hell, we don't really have a debate at all. Instead, we have a situation where advocates can talk about Singapore without anyone bringing up Canada, or about PISA without anyone bringing up TIMSS, or about lottery-based analyses without anyone bringing up peer effects (or placebo effects or volunteer effects or treatment/selection interaction or...). Instead of being challenged and having to prove themselves, these claims go directly into the conventional wisdom pile where they are accepted by smart, otherwise well-informed people like Seyward Darby, Ray Fisman and Jonathan Chait.
This is not likely to end well.
* For the distinction between advocating for reform and advocating for the reform movement, see here.
In good company
Have you ever been called 'fascinating' before? It sort of turns a fellow's head.
Mark
p.s. This would still be a cool list even if we weren't on it.
Achilles and the Tortoise, the CBO and the GOP
I really need to get to bed.
Wednesday, January 19, 2011
The Self-esteem gap
We've lost our competitive spirit. We've become so obsessed with making kids feel good about themselves that we've lost sight of building the skills they need to actually be good at things.This is an old and much loved refrain in the reform movement, but when you look closely and take the time to disaggregate the data the argument completely collapses. The problem is that the culture of esteem-building Rhee describes is essentially a suburban phenomena. In poor neighborhoods, the situation is exactly the opposite:
I can see it in my own household. I have two girls, 8 and 12, and they play soccer. And I can tell you that they suck at soccer! They take after their mother in athletic ability. But if you were to see their rooms, they're adorned with ribbons, medals and trophies. You'd think I was raising the next Mia Hamm.
I routinely try to tell my kids that their soccer skills are lacking and that if they want to be better, they have to practice hard. I also communicate to them that all the practice in the world won't guarantee that they'll ever be great at soccer. It's tough to square this though, with the trophies. And that's part of the issue. We've managed to build a sense of complacency with our children.
Take as a counterpoint South Korea, where my family is originally from. In Korea, they have this culture that focuses on always becoming better. Students are ranked one through 40 in their class and everyone knows where they stand. The adults are honest with kids about what they're not good at and how far they have to go until they are number one. Can you imagine if we suggested anything close to that here? There would be anarchy.
Hart and Risley also found that, in the first four years after birth, the average child from a professional family receives 560,000 more instances of encouraging feedback than discouraging feedback; a working- class child receives merely 100,000 more encouragements than discouragements; a welfare child receives 125,000 more discouragements than encouragements.Other words, our best performing schools are filled with kids who, according to Rhee, should be complacent and lacking competitive spirit while most of the kids in our worst performing schools have received little of the empty praise that so concerns her.
Perhaps we should worry less about the exaggerated self opinions of students and more about that of our pundits and commentators.
Department of better late than never
Most of the major claims in the president's speech were either based on highly selective reading of the data or were simply wrong.
This brings us to one of the strangest aspects of the education debate: the way it makes smart, conscientious people act grossly out of character. Consider this representative example from FactCheck:
But the claim that "our high school dropout rate has tripled in the past thirty years"? That’s not even in the ballpark. According to the Department of Education’s National Center for Education Statistics, the "status dropout rate" – defined as the percentage of people between ages 16 and 24 who are not in school and do not have high school diplomas or GEDs – was 9.3 percent in 2006. In 1976, 30 years before that, it was 14.1. That’s actually a 34 percent decrease in the high school dropout rate.
Of course, dropout rates are notoriously hard to measure and compare. For instance, while NCES shows a status dropout rate of 9.3 in 2006, the high school completion rate for that year was only 74.8 percent. Why the discrepancy? Instead of counting people of a certain age with a diploma or equivalency certificate, this figure compares the number of high school freshman in a certain year to the number receiving a high school diploma four years later. Those who take more than four years to finish aren’t counted, nor are students who get GEDs instead of diplomas. But using this calculation still doesn’t back up Obama’s claim. The dropout rate – that is, the discrepancy between incoming freshmen and graduates – would have been 25.2 percent in the 2006-2007 school year. The rate in 1976-1977 was 25.6 percent.
Even pessimistic accounts don’t show a tripled dropout rate. According to a report by the Educational Testing Service, titled "One Third of a Nation" after the number of students they say are high school dropouts, high school completion rates peaked at 77.1 percent in 1969 and dropped to 69.9 percent in 2000. (NCES shows higher numbers in both years.);That would put dropout rates at 22.9 and 30.1 percent respectively – a 30 percent increase over 31 years. As many sixth-graders could tell you, tripling would mean a 200 percent increase.
So where did Obama’s figure come from? A White House spokesman pointed us to a report by the College Board, which said: "The rate at which American students disappear from school between grades nine and 12 has tripled in the last 30 years." But the College Board’s report included a mistake, which it later corrected: The rate really refers to what happened between grades nine and 10. More important, however, it is not really a "dropout rate." The College Board report in turn cites a 2004 study by the National Board on Educational Testing and Public Policy, which actually shows a tripling of the attrition rate between grades nine and 10, not the dropout rate. In other words, the difference between the number of students enrolled in grade nine in one year and the number enrolled in grade 10 the next year has increased threefold. At the same time, there has been a corresponding threefold increase in grade nine enrollments relative to grade eight. The report shows more ninth-graders failing that grade, not dropping out.
Given that the reform movement has been railing against social promotion for years, it's hard to argue that an increase in students held back is a cause for alarm.
The spam filter on Blogger... what's the word?...
It seems to have a problem with long comments so if you write a comment and it doesn't appear, please follow up with a short note and Joseph or I will check the filter.
Sorry for the inconvenience.
Tuesday, January 18, 2011
Jonathan Chait disapproves of a liberal journalist's flip-flop on unions
New York has a mordantly funny piece about the effort by staffers at Harper's to unionize. The saga begins with gross mismanagement by owner Rick MacArthur, spurring the staff to organize. Then the left-wing MacArthur started to act a lot like a union-crushing boss.I have a bit more sympathy for MacArthur. He's in a difficult situation trying to save a tremendously worthwhile institution. I tend to be very union-friendly but the situation can get murky when the business in question really is struggling to survive, not just making a play for sympathy. Given that my only source of information is the gossipy and badly written New York piece, it's difficult to assign much blame.
Besides, it's not like he attacked a fundamental role of unions like the right to protect their employees from unfair termination.
Mortgage Questions
McArdle: “Let’s turn it around,” I asked. “What if the bank decided that it wanted to exercise the same sort of option?…What if the bank foreclosed on your house, even though you made the payments, because it figured it could make more money taking the house and selling it?” (Not a likely scenario, I know, but a useful thought experiment.).
Response:
Banks exercise the same sort of option all the time when they resell mortgages (and hopefully notes!) from one entity to another entity. That’s the problem we have right now, that this reselling option banks use was so sloppy it’s tearing up the economy.
This is why if you are the type of person who thinks markets self-regulate through consumer demand and reputation there’s a major problem, as consumers have no choice over their mortgage servicer. If you don’t like your servicer, and refinance your mortgage with another bank, that bank can still sell off your mortgage and you can still end up serviced by the same institution.
I never quite thought of the decision to resell mortgages in this light, but this is a remarkably good point. It's not quite the same scenario as "seize the house" (which I think was the actual tactic that McArdle had in mind) but it certainly does put the decision to resell mortgages in perspective.
In a more pragmatic light, the decision to try and do regulation by reputation (long a bad idea) has even less relevance in the modern world. First of all, job tenures at banks may be quite short so the people making decisions that undermine a firms reputation may be elsewhere at the end of this period. Second, firms themselves often vanish or are absorbed by other firms (consider Washington Mutual as an example). These features of the modern corporate environment make it difficult to use a reputation based system as the primary check on the system.
This is not to say that homeowners who are in default should be given free houses (I'd think that was obviously an incorrect conclusion) but rather that we should give the regulatory structure of banks some serious thought.
Monday, January 17, 2011
The Golden Globes as a collective action problem
I suspect that most of the industry would like to see the Golden Globes go away but here's where the collective action problem comes in. If everyone who disapproved would stop covering or attending the event, they could probably kill it in a year or two (I'm counting being bumped to E! as virtual death), but even the Globes' harshest critics haven't been able to go cold turkey. As long as the show is there, all the incentives on the individual level are lined up to keep the show going. The journalist who refuses to write about the nominations or the ceremony loses ground to competitors. The nominated star who boycotts the awards passes up publicity and may be seen as difficult to work with (a label that can devastate an actor's career).
There's something refreshingly trivial about Hollywood versus the Golden Globes, but it does raise an interesting point: just how embarrassing does a situation have to be for an industry to find a solution to a collective action problem? Apparently it need to be worse than having the host of a prime-time network awards show opening with jokes about the fact that the nominations are fixed.
School segregation
American schools are more segregated by race and class today than they were on the day Martin Luther King, Jr. was killed, 43 years ago. The average white child in America attends a school that is 77 percent white, and where just 32 percent of the student body lives in poverty. The average black child attends a school that is 59 percent poor but only 29 percent white. The typical Latino kid is similarly segregated; his school is 57 percent poor and 27 percent white.
There are clearly some places that our current educational system could stand to be reformed. I would rather focus on issues like segregation and access rather than whether removing tenure would be a panacea.
h/t Tyler Cowen of Marginal Revolution
Sunday, January 16, 2011
Academics
My vote for the strangest part of the book is the paragraph in which the authors describe a "workingman" who "jumped on a subway track to rescue a child who tripped and fell." The workingman didn't think; he just did it. The authors posit that professors on that same platform would not have jumped on the track to save the child:
"We wonder if, had some professors been on the platform, would they have paused to ponder how John Stuart Mill might have parsed the choices?"
I wonder if that is a sane thing to wonder. Of course the professors would save the child. What better way to combine broader impacts, a synergistic activity, and outreach?
and
Similarly, what is your evidence for your contention that professors don't work as much as they say they do? This seems to be it: "A story is told of a classroom where all the students were busy scribbling as the professor droned on. All, that is, but one, a young woman in the back row, who wrote down nary a word. How so? She had with her the notes that her mother had taken for that class during her own student days." That's the evidence? A possibly apocryphal story?
and
For example, your book starts with the story of a candidate who, in his interview for a faculty position, makes it clear that he is not interested in teaching and is only interested in research. The fact that he was not hired indicates to me that the system worked well, yet you used this anecdote to illustrate your hypothesis that professors don't care about teaching and try to do as little of it as possible.
There are a lot more really good examples in this text, these were just my favorites. It is definitely worth an afternoon read.
Saturday, January 15, 2011
Joe Gores wrote the best chimpanzee sex scene you'll ever read
And damn, the man could write.
Continued (battery issues)
My first exposure to Gores was the short story "The Second Coming" about two hipsters who volunteer as witnesses to an execution, just for kicks. It was published in 1966 in a now forgotten men's magazine and was, in its way, as unlikely as that chapter in Menaced Assassin. There was no mystery -- the accused was guilty -- and no violence except for that mandated by the state, but like the chapter in Menaced Assassin, it will stay with you.
Friday, January 14, 2011
When relative rates are misleading
To me these effects are hard to interpret in terms of relative growth rates given that rich areas of the country remained richer (on average) than the poor areas of the country. Let us consider a thought experiment to see what I mean by the problem of relative rates.
One region, call it sunbelt, has income of $1,000 per capita and this income increases by $20 (2% growth per year).
Another region, call it rustbelt, has an income of $500 per capita which increases by $15 (3% growth per year).
Clearly the rustbelt region has better growth (in % terms) but has a lower growth in absolute wealth. Now let us presume that the absolute growth rates remained constant over a decade.
At the end, despite always having lower growth, sunbelt has $1,200 in income while rustbelt has $650 per capita. The relative difference is smaller (as 650 > 50% of 1200) but, in absolute terms, the people in sunbelt now make $550 per year more than the people in the rustbelt.
Are we sure that % growth rates are always the best metric of economic progress?
Thursday, January 13, 2011
Quality journalism -- only available for a limited time
"The Invention of Money" from This American Life