Comments, observations and thoughts from two bloggers on applied statistics, higher education and epidemiology. Joseph is an associate professor. Mark is a professional statistician and former math teacher.
Wednesday, June 29, 2011
If you're serious about education reform...
From Mike Konczal:
Thursday, June 23, 2011
Adoption studies as Rorschach test
On Mr. Mankiw’s specific point, though, not all economists have the same view of the research on parents that he does. Bruce Sacerdote at Dartmouth has done one of the most-cited studies, and it finds that parents can make an enormous difference. From the abstract:I look at this and see a cautionary tale about the perils of drawing inferences from non-representative samples, but I'm a statistician and that's how we see most things.
I analyze a new set of data on Korean American adoptees who were quasi-randomly assigned to adoptive families. I find large effects on adoptees’ education, income and health from assignment to parents with more education and from assignment to smaller families. Parental education and family size are significantly more correlated with adoptee outcomes than are parental income or neighborhood characteristics. Outcomes such as drinking, smoking and the selectivity of college attended are more determined by nurture than is educational attainment.
Another data dump
Felix Salmon points out another one of those things that make me nervous about the NYT.
Salmon also directs us to another great piece from the New Yorker.
Jonathan Chait has some smart things to say about the asymmetry of the political debate.
(Blogger's spell check just stopped working. The rest of the post may be a challenging read.)
Motorola's example doesn't really generalize. GE's run was better explained by other factors. Are there any Six Sigma success stories that don't fall in these two categories?
Dana Goldstein continues to bring objectivity and balance to the education debate.
Tuesday, June 21, 2011
more thoughts on geoengineering
When you have a plan that covers ocean acidification, maybe you can talk me out of supporting a carbon tax.
Ocean life on the brink of mass extinctions: study
OSLO (Reuters) – Life in the oceans is at imminent risk of the worst spate of extinctions in millions of years due to threats such as climate change and over-fishing, a study showed on Tuesday.
Time was running short to counter hazards such as a collapse of coral reefs or a spread of low-oxygen "dead zones," according to the study led by the International Programme on the State of the Ocean (IPSO).
"We now face losing marine species and entire marine ecosystems, such as coral reefs, within a single generation," according to the study by 27 experts to be presented to the United Nations.
"Unless action is taken now, the consequences of our activities are at a high risk of causing, through the combined effects of climate change, over-exploitation, pollution and habitat loss, the next globally significant extinction event in the ocean," it said.
Scientists list five mass extinctions over 600 million years -- most recently when the dinosaurs vanished 65 million years ago, apparently after an asteroid struck. Among others, the Permian period abruptly ended 250 million years ago.
"The findings are shocking," Alex Rogers, scientific director of IPSO, wrote of the conclusions from a 2011 workshop of ocean experts staged by IPSO and the International Union for Conservation of Nature (IUCN) at Oxford University.
Fish are the main source of protein for a fifth of the world's population and the seas cycle oxygen and help absorb carbon dioxide, the main greenhouse gas from human activities.
Jelle Bijma, of the Alfred Wegener Institute, said the seas faced a "deadly trio" of threats of higher temperatures, acidification and lack of oxygen, known as anoxia, that had featured in several past mass extinctions.
A build-up of carbon dioxide, blamed by the U.N. panel of climate scientists on human use of fossil fuels, is heating the planet. Absorbed into the oceans, it causes acidification, while run-off of fertilizers and pollution stokes anoxia.
Extraordinary interview with Eric Sterling
Though we generally don't think about it in these terms, the war on drugs should be part of the education debate. The communities on the wrong side of the achievement gap are also the ones that have paid the price for congress's pathetic need to sound tough a quarter century ago. Here's a representative sample:
STERLING: The amounts ended up being very, very small, instead of a high-level quantity...CONAN: Because the idea of the law, originally, was to go after kingpins.
STERLING: Exactly. We - the Justice Department had very broad discretion, and we recognized that the federal should be focused on the highest-level traffickers. The first proposal that we had used data that the DEA had suggested in terms of how they evaluate, internally, their highest-level traffickers. Those numbers were objectionable to a congressman from Louisville, Kentucky, who said: We'll never use this law in Louisville. And unfortunately, no one, given the speed of this, said: But congressman, Louisville is not Holly - Miami. It's not the center of the drug trade. Nobody goes to Louisville to do a major cocaine deal. Of course, we don't need it.
Monday, June 20, 2011
Now their feelings are hurt
If you want a great example of the kind of mean things that people are saying about Groupon in the run-up to its IPO, you could do a lot worse than Rocky Agrawal’s TechCrunch essay entitled “Why Groupon Is Poised For Collapse”. It’s a great example of overstretch and dubious logic, with a couple of moments of brilliance and genuine insight thrown in at the same time. Groupon, of course, being in its quiet period, can’t react. Except, it just can’t help itself, and has put up a whiny post, supposedly authored by the company cat, about how unfair the whole situation is.After reading the post in question, 'whiny' is probably the first adjective that will come to your mind as well. It's easy to understand how Mason, Lefkofsky and company might feel wounded. A few months ago, between the investor buzz and love letters from the Wall Street Journal, the people at Groupon could easily assume that they had a world full of friends. Now everyone's pointing out problems in your business model and asking why your marketing techniques seem twenty years out of date.The fact is that when Groupon made the decision to go public, it invited exactly this kind of attention — both before the IPO and forever more. When Groupon was private, no one really knew anything about its financials, and CEO Andrew Mason could happily declare that he’d much rather talk about building miniature dollhouses. Once it’s public, however, he’ll have a fiduciary responsibility to his shareholders, and will have to answer such questions at length. Will that make him happier than answering such questions with a death-ray stare? I doubt it, to be honest. Revenues and business models and profits and forecasts are serious things, and you can’t kid around with shareholders in the same way you can with journalists.
In other words, Mason will have to go from saying nothing, which can be fun, to saying something, which almost certainly won’t be. Rather than moan about his inability to say anything in the quiet period, he should enjoy it while it lasts. From now on in, the boring financial questions are going to be unavoidable — from analysts, from journalists, from shareholders, even probably from merchants and customers who wonder whether Groupon’s profitability is a sign that they’re being ripped off.
If your BS detector isn't going off, you need to check your battery
Take, for example, their positive review of this Economist piece on IBM's hundredth birthday. Here's the key observation from the Economist:
IBM’s secret is that it is built around an idea that transcends any particular product or technology. Its strategy is to package technology for use by businesses. At first this meant making punch-card tabulators, but IBM moved on to magnetic-tape systems, mainframes, PCs, and most recently services and consulting. Building a company around an idea, rather than a specific technology, makes it easier to adapt when industry “platform shifts” occur.The article, which goes on to argue that Apple, Amazon and Facebook live up to this while Dell, Cisco and Microsoft do not, is a nearly perfect example of perhaps the most popular genre of business writing, the secret of success story.
True, IBM’s longevity is also due, in part, to dumb luck. It almost came unstuck early on because its bosses were hesitant to abandon punch cards. And it had a near-death experience in 1993 before Lou Gerstner realised that the best way to package technology for use by businesses was to focus on services. An elegant organising idea is no use if a company cannot come up with good products or services, or if it has clueless bosses. But on the basis of this simple formula—that a company should focus on an idea, rather than a technology—which of today’s young tech giants look best placed to live to 100?
Here's the template:
1. Come up with a positive-sounding platitude like "successful businesses are obsessed with quality" or "a company should focus on an idea, rather than a technology";
2. Make a short list of companies that are currently hot. You may also choose to make a list of not-hot companies for the purpose of contrast. It is not necessary for the hot companies actually to be more successful;
3. Claim that your platitude explains the success or failure of these companies. This will usually entail stepping over some rather deep holes. For example, the Economist explains IBM's 100 year run with an insight* the company's management supposedly had in 1993. (If you have the nagging feeling that you've heard this basic argument before, you're probably right).
In real life, it's next to impossible to find a secret-to-success that is both widely applicable and pretty. This isn't to say that you can't learn something useful by studying successful companies, but those lessons tend to be complicated and difficult to apply in other settings. When you do find one that is simple and general, it's usual something like 'you can overcharge customers if you keep your pricing opaque.'
Somehow, though, "you can fool some of the people enough of the time" doesn't have the inspirational quality for a good business slogan.
* If at all possible, work a visionary CEO's brilliant insight into the story somewhere.
Some confusion with the concept of future tense
Even as it issued the disclaimer that its report was not intended to be predictive, McKinsey linked to the report with the following teaser in its new statement: "The shift away from employer-provided health insurance will be vastly greater than expected and will make sense for many companies and lower-income workers alike."
Weekend Blogging -- Free TV edition
ThisTV has caught on to the fact that the most interesting films are often on the far ends of the spectrum and has responded with a wonderful mixture of art house and grind house. Among the former, you can see films like Persona, the Music Lovers and Paths of Glory. Among the latter you'll find American International quickies and action pictures with titles like Pray for Death. You can even find films that fit into both categories like Corman's Poe films or Milius' Dillinger.
Sunday, June 19, 2011
"Just when I thought I was out... they pull me back in." -- another Groupon post (merchant relations edition)
For the latest nail in this coffin, Felix Salmon sends us to this extraordinary post by Benjamin Edelman and Paul Kominers:
Voucher services typically seek to cast themselves as mere marketing vendors that are not responsible for the conduct of the corresponding merchants. For example, Groupon’s Terms of Sale claim that “The Merchant, not Groupon, is the seller of the Voucher and the goods and services and is solely responsible for redeeming any Voucher you purchase.” On this view, a voucher service avoids liability for merchants’ shortfalls.
But a voucher service is the merchant of record for the charge to the customer’s credit card. As the entity officially responsible for charging the consumer, the voucher service thus faces increased responsibility to see that the consumer receives what was promised. Furthermore, the voucher service, not the merchant, writes the promotional text touting the merchant’s offering. As Rakesh Agrawal points out, Groupon’s financial disclosures even count the entirety of the consumer’s purchase price as revenue to Groupon. In this context, a consumer naturally looks to a voucher service for assistance if a merchant fails to perform. We think it is probably an unfair and deceptive practice, under the FTC Act and state equivalents, for voucher vendors to attempt to disclaim liability in such circumstances.
More generally, we are struck by Groupon’s attempts to push all responsibility to merchants. On every relevant question — discounting alcohol, honoring expiration dates, providing cashback — Groupon’s historic contract and current Merchant Terms of Service claim merchants are responsible. In our view, this approach invites confusion and non-compliance. Voucher services are far better positioned than merchants to determine what the legal system requires: Voucher services can research regulations centrally, once for each state in which they operate, then notify affiliated merchants of applicable requirements. In contrast, Groupon’s current approach asks each individual merchant to conduct its own research. If merchants actually conducted such research, it would be duplicative and potentially wasteful — thousands of small businesses re-researching the same questions. But in fact merchants typically ignore the questions, rationally concluding that these questions are too difficult for them to address on their own. Thus, by pushing merchants do to the work individually, voucher services virtually assure that the work is not done at all.
Importantly, the legal and regulatory questions flagged in this article are questions that arise distinctively in the context of discount vouchers: a merchant would never confront such questions were it not for discount vouchers. Having created the transactions giving rise to this regulatory complexity, we think discount voucher services should be expected to achieve compliance.
Wednesday, June 15, 2011
So much for maintaining a light tone over the weekend
Americans are living longer, but not in every corner of the country. A new study shows that in hundreds of U.S. counties — mostly in the South — life expectancy has fallen.The researchers believe problems like smoking and obesity are partly to blame.
"There are enormous variations within the country" said Dr. Christopher Murray, a University of Washington researcher. He's a study author and an editor of the online journal, Population Health Metrics, which released the study Wednesday.
Overall, life expectancy in the U.S. is at an all-time high. The Centers for Disease Control and Prevention recently estimated that a baby born in 2009 could expect to live 78 years and 2 months.
The CDC doesn't calculate estimates by county; Murray's research covers 2000 through 2007 when U.S. life expectancy grew a year to nearly 78.
A federal expert in these kinds of statistics said Murray's methods were sound, but the findings aren't terribly surprising.
The U.S. estimate actually dropped from 2004 to 2005, noted Bob Anderson of the CDC's National Center for Health Statistics. Given that downward blip — and the fact that statistics fluctuate more when you're dealing with smaller populations __ it's not unexpected to see some declines at the local level, he said.
The study found that life expectancy for women fell significantly in 702 of the nation's more than 3,100 counties. The largest declines — by nearly 2 years — were in Mississippi's Madison County, near Jackson, and the adjacent Hughes and Okfuskee counties in eastern Oklahoma.
"How To Party Your Way Into a Multi-Million Dollar Facebook Job" -- the sad state of business journalism
If you want Facebook to spend millions of dollars hiring you, it helps to be a talented engineer, as the New York Times today [18 May 2011] suggests. But it also helps to carouse with Facebook honchos, invite them to your dad's Mediterranean party palace, and get them introduced to your father's venture capital pals, like Sam Lessin did.Lessin is the poster boy for today's Times story on Facebook "talent acquisitions." Facebook spent several million dollars to buy Lessin's drop.io, only to shut it down and put Lessin to work on internal projects. To the Times, Lessin is an example of how "the best talent" fetches tons of money these days. "Engineers are worth half a million to one million," a Facebook executive told the paper.
We'll let you in on a few things the Times left out: Lessin is not an engineer, but a Harvard social studies major and a former Bain consultant. His file-sharing startup drop.io was an also-ran competitor to the much more popular Dropbox, and was funded by a chum from Lessin's very rich childhood. Lessin's wealthy investment banker dad provided Facebook founder Mark Zuckerberg crucial access to venture capitalists in Facebook's early days. And Lessin had made a habit of wining and dining with Facebook executives for years before he finally scored a deal, including at a famous party he threw at his father's vacation home in Cyprus with girlfriend and Wall Street Journal tech reporter Jessica Vascellaro. (Lessin is well connected in media, too.) . . .
To get the full impact, you have to read the original New York Times piece by Miguel Helft. It's an almost perfect example modern business reporting, gushing and wide-eyed, eager to repeat conventional narratives about the next big thing, and showing no interest in digging for the truth.
Let's start with the credibility of the story. While computer science may well be the top deck of the Titanic in this economy, has the industry really been driven to cannibalization by the dearth of talented people? There are certainly plenty of people in related fields with overlapping skill sets who are looking for work and there's no sign that the companies like Facebook are making a big push to mine these rich pools of labor. Nor have I seen any extraordinary efforts to go beyond the standard recruiting practices in comp sci departments.
How about self-interest? From a PR standpoint, this is the kind of story these companies want told. It depicts the people behind these companies as strong and decisive, the kind of leaders you'd want when you expect to encounter a large number of Gordian Knots. When the NYT quotes Zuckerberg saying “Someone who is exceptional in their role is not just a little better than someone who is pretty good. They are 100 times better,” they are helping him build a do-what-it-takes-to-be-the-best image.
The dude-throws-awesome-parties criteria for hiring tends to undermine that image, as does the quid pro quo aspect of Facebook's deals with Lessin's father.
Of course, there's more at stake here than corporate vanity. Tech companies have spent a great deal of time and money trying to persuade Congress that the country must increase the number of H-1Bs we issue in order to have a viable Tech industry. Without getting into the merits of the case (for that you can check out my reply to Noah Smith on the subject), this article proves once again that one easily impressed NYT reporter is worth any number of highly paid K Street lobbyists.
The New York Times is still, for many people, the paper. I've argued before that I didn't feel the paper deserved its reputation, that you can find better journalism and better newspapers out there, but there's no denying that the paper does have a tremendous brand. People believe things they read in the New York Times. It would be nice if the paper looked at this as an obligation to live up to rather than laurels to rest on.
Tuesday, June 14, 2011
More bad statistics from Freakonomics
Freakonomics Radio is not helping Marketplace's average.
Dubner: Let me let you hear from a different economist, his name is Bruce Sacerdote, he's at Dartmouth. He wanted to know how much this kind of activist-parenting -- if you want to call it that -- actually pays off. And one way to measure this, especially if you're talking about educational achievement -- which is what parents probably care about the most -- is to look at adoption studies, where you can actually measure the impact that a family, that the parents, will have on a kid.
Ryssdal: So what's his thesis, that kids adopted into, I guess, high-education homes will be more likely to go to college, is that the deal?
Dubner: Exactly right. If parents are so important, then parents can take an adopted kid who might otherwise not have gone to college, and that kid will become college material. So Sacerdote sliced and diced a lot of good data and he did find parental influence.
Bruce Sacerdote: But it's not quite as big as I expected to find.
Ryssdal: All right, so quantify for me: how big is not so big?
Dubner: If you're a child who's adopted into a high-education family -- that is where the parents both went to college -- you are about 16 percentage points more likely to go to college than a kid who gets adopted into a low-education family. So that sounds pretty good, OK?
Until you compare that to the rate for biological kids from high-education families, who are about 75 percentage points more likely to go to college than biological kids from low-education families. So on the one hand, this is a little dispiriting for parents. We don't seem to have as much influence as we might think. On the other hand, in a weird way, it kind of takes some of the pressure off, right? At least it did for Bruce Sacerdote.
Sacerdote: This notion that genes are really important and that kids are hard-wired to do certain things, I think understanding that did help me relax and not worry so much that I was going "screw them up" in some terrible way.
One of the concerns I have about sending an economist to do a statistician's job is that economists, by training, have a tendency to make things simpler.* This works reasonably well in economics where the problems are generally too complex to tackle without making some simplifying assumptions about linearity and additive effects and independence and where (perhaps more importantly) the economists have a pretty good idea of which corners can be safely cut. Unfortunately, when they move outside of familiar ground, you often get something like this.
Unless something important has been left out (always a possibility when something is presented to a general audience), Sacerdote has made the common but serious mistake of treating a select group as a random sample. People who choose to adopt are not a random sample of parents, particularly given the difficulties in the process, and those who do self-select have to go a difficult approval process.
Think for a moment about how unrepresentative the resulting sample is. Now consider traits that are likely to be correlated to both parents' and children's education levels and which the process is likely to select for or select out. Here are a few that come immediately to mind:
Teen parenthood;
Unplanned parenthood;
Poverty;
Drug abuse;
Career level (high income may not be a requirement but financial stability is and these days that represents a significant career accomplishment);
Encouragement and support**;
Educational expectations for their children (I can't imagine that all that many prospective parents who don't give a damn about their kid's education make it to the end of the process).
The genetic component of this question is confounded with all these things and more. As a result, (at least as presented here) Sacerdote actually succeeds in proving the opposite of his conclusion. His example doesn't show what, if any, role genetics plays in how likely a kid is to go to college. That 75 could be mainly the result of poverty (which is highly correlated to parent's education levels). I'm not saying that it is but there is no way of ruling out that and other explanations.
What Sacerdote has shown is that even when you control not only for genetics but also for most obvious environmental factors, you still got a 16 point bump just from having adoptive parents who both went to college. Under any circumstances this would be a substantial improvement but in the context of this natural experiment it's huge.
At the risk of over-sharpening the blade, we have here a natural experiment that shows nothing about the role of genetics in academic achievement. What it does show is that even when you greatly reduce most of the obvious parenting-related environmental sources of variability, you still get a substantial effect from the remaining factors. A highly respected researcher then uses this example to argue publicly that genetic factors far outweigh the impact of parenting.
We really need to do something about Freakonomics.
(I'm also not comfortable with the way Sacerdote gives a percentage difference rather than the ranges but that's a subject for another post)
* There are, of course exceptions. Most notably Nate Silver.
** I'm pretty sure in most low education adoptive homes you won't see this relationship:
Hart and Risley also found that, in the first four years after birth, the average child from a professional family receives 560,000 more instances of encouraging feedback than discouraging feedback; a working- class child receives merely 100,000 more encouragements than discouragements; a welfare child receives 125,000 more discouragements than encouragements.