Rob Schmitz: If you walk down the street in Shanghai, it's hard to miss the advertisements for college placement agencies. In big bold letters, they promise -- some even guarantee -- your child's admission to an American university. The price: $5,000, $6,000, sometimes $7,000.Jiang Xueqin is a well-known education reformer in China. He also heads the International division at Peking University High School -- one of China's best high schools. He has followed college placement agencies for years. He says this is how many of them deliver on their admission promises: they falsify students application materials.
A report by consulting firm Zinch China seems to confirm this. Zinch advises American colleges and universities on recruiting Chinese students. The firm interviewed agents and admissions consultants, as well as more than 200 Beijing students headed to U.S. schools. Zinch estimates 90 percent of these students submitted false recommendation letters; 70 percent had other people write their personal essays, and half of them submitted forged high school transcripts.Jiang Xueqin: There's a lot of pressure on the agencies to write the application essays, to fake transcripts, to fake recommendation letters. This is just general business practice in China to falsify a lot of documentation.
Comments, observations and thoughts from two bloggers on applied statistics, higher education and epidemiology. Joseph is an associate professor. Mark is a professional statistician and former math teacher.
Wednesday, November 9, 2011
Old story, different hemisphere
Werner Herzog, LA, and structural employment in hot jazz
"We [Herzog and his wife] have to move into the city with the most substance in the United States, cultural substance."This jibes with something I've noticed since moving to LA and falling in (through no fault of my own) with the hot jazz scene in town. There are some extraordinary musicians around here, the kind who develop international followings and get glowing notices in the New York Times.
"And that wasn't New York..."
"New York is more on the receiving end, it's more on the consuming end. ... Los Angeles, this is a place where things get done."
LA has a wealth of musical talent, but if those musicians want any wealth for themselves they have to head east. Because, though you might argue that the West Coast has the best musicians, the East Coast unquestionably has the best fans, at least when it comes to ponying up. In NYC these musician actually make good money; in LA you can often find them working for kind words and Pez.
If you're looking for creative energy, I'm with Herzog -- you can't do better than LA. If you're looking for a market for all that creativity, you might want to try the other coast.
Tuesday, November 8, 2011
But some of my best friends are administrators
For all their admirable traits, we have to acknowledge the world administrators live in: they are generally at least one step removed from the classroom and regular contact with students; their jobs are highly paid and highly political with badly aligned incentives and considerable temptations to abuse the system. Movement reformers like Jonathan Chait have convinced themselves that a major key (perhaps the key) to improving education is removing checks on administrators' power and upping rewards for manipulating the system. I'm just pointing out that some administrators need less power and fewer temptations.
I haven't taken a cheap shot at an administrator for a while
* think this is hyperbole? Listen to the episode.
Speaking of curriculum -- Armenian edition
Armenia’s public schools started mandatory chess classes for every second, third and fourth grader in the former Soviet republic this year. Twice a week, seven- to ten-year-old Armenians are getting a half hour of instruction in chess basics, with the goal of being able to play a competent game by the end of fourth grade.
One of those schools is Public School 81 where Grigor Martikian is drilling 20 second graders on how to move the bishop. He positions a bishop into the corner of a large model board in front of the class.
The students follow along on chess mats on their desks.
Edouard Aroustian and Seta Kevorkian are both seven and have learned a new checkmate move. When I ask them if they know about Armenia’s national chess team, they nod and smile.
That team was the pride of Armenia this past summer, when it won the World Chess Team Championship in Ningbo, China. Armenians treat chess champions like star athletes. Chess is one of the most popular games here and there are 32 grandmasters in a population of about 3 million.
If only I could talk them into trying octagonal games...
Monday, November 7, 2011
At least we aren't giving them antidepressants
Babies have been crying and spitting up since time immemorial. But these days many parents ask: Isn't there a drug for that?
"Parents come in often demanding medication," says Eric Hassall, a pediatric gastroenterologist at Sutter Pacific Medical Foundation in San Francisco.
Prescriptions for acid-suppressing medicines for infants have increased dramatically. Hassall says some parents have picked up on the idea that heavily advertised medicines for reflux in adults can help fussy babies who spit up a lot.
He documented a 16-fold increase in prescriptions of one proton pump inhibitor, or PPI, Prevacid, which comes in a child-friendly formulation. A Food and Drug Administration review also found an 11-fold increase in number of new prescriptions dispensed between 2002 and 2009.
These medicines aren't approved for infants with reflux, or GERD. Still, some doctors have been prescribing them off-label anyway. Doctors generally agree this practice is OK when babies really need the medicine, such as when they're spitting up so much that they're not gaining weight.
One of the risks of living is dying
I can hear the howls of protest already. But here’s the example I always go to: the number one killer of children in the US is car accidents. But we don’t ever consider stopping driving. I know that every time I put my kids in a car, I’m significantly increasing the chance that they could die. But I (and pretty much all of you) believe that the benefit to our lives from cars outweighs the increased risk of death in our children. Let me put it another way. We all accept that it’s worth a number of children dying so that we can all get around more easily.
One of the great challenges that we face as a society is how to balance risks and benefits. I am becoming increasingly convinced that people are simply poor at making these trade-offs. This is especially true given that the risk of death is 100%. In a real sense we all end up dying. The goal, instead, seems to be to make the time that we have as good as possible. A theory of the joint maximization of lifespan and happiness seems to be the best way to go.
Given that, I think Dr Carroll's point is quite sound: we take risks all of the time in order to make life worth living. The trick is to quantify which risks are worthwhile, conditional on the absolute level of risk.
Wednesday, November 2, 2011
The worst example of curriculum dead wood?
The example that really stuck with me was synthetic division, a more concise but less intuitive way of performing polynomial long division. Both of these topics are pretty much useless in daily life but polynomial long division does, at least, give the student some insight into the relationship between polynomials and familiar base-ten numbers. Synthetic division has no such value; it's just a faster but less interesting way of doing something you'll never have to do.
I started asking hardcore math people -- mathematicians, statisticians, physicists, rocket scientists*-- if they'd ever used synthetic division. By an overwhelming margin, the answer I got was "what's synthetic division?" Not only did they not need it; it made so little impression that they forgot ever learning it.
Which bring us to this passage from a recent Dana Goldstein post (discussed earlier):
The problem, according to [David] Coleman, is that American curriculum standards have traditionally been written by committees whose members advocate for their pet pedagogical theories, such as traditional vs. reform math.Except, of course, that's not what happened here. As was the case with so many topics in mathematics, synthetic division remained in the curriculum because no one who knew what was going on had bothered to look that closely. Coleman has a clever narrative, but it doesn't fit the facts all that well.
Now I have a request for all the math geeks in the audience (and given that you're reading a blog called Observational Epidemiology...). Since we need to pare down the curriculum, what you choose to cut? Specifically, what mathematical topics that you learned in school can future generations do without?
* Literal rocket scientists -- JPL's just down the road.
Also posted in a slightly different form at Education and Statistics.
Tuesday, November 1, 2011
We need curriculum reform but we need to do it right
Past attempts to develop national curriculum guidelines became mired in culture war controversy, but this latest effort--led by the states, not the federal government--has a real shot at influencing teaching and learning at the classroom level, and hopefully fostering a more rigorous academic culture in American public schools. If administrators and teachers implement the new standards faithfully, how will the curriculum evolve? Let's first look at math.
Currently, American students are taught just a little bit about a whole lot of mathematical topics each year; we have a curriculum with tons of breadth, but not much depth. Check out this chart Coleman showed us from education researcher Bill Schmidt. It demonstrates that while typical first-graders in high-achieving Western European and Asian countries learn just three concepts--quantity, measurement, and addition/subtraction of whole numbers--American first-graders must learn 14 topics, including polygons, circles, how to use a compass, and how to estimate.Before I wade into the red flags, the suggestion that the curriculum needs to be greatly pared down is dead on. We do try to cover a ludicrous amount of material, much of it of little value. The explanation given here is too tidy (there are plenty of ways for undeserving concepts find their way into the standards), but it is, at least partially true.
The American curriculum may appear more rigorous, but our six-year olds are actually being denied the opportunity to master the foundational skills upon which the rest of their mathematical education will be based. The problem, according to Coleman, is that American curriculum standards have traditionally been written by committees whose members advocate for their pet pedagogical theories, such as traditional vs. reform math. "The only way to end a committee meeting is to let everyone get their stuff in," Coleman said. The result is that teachers feel rushed each year to move through an enormous list of standards. "Students and teachers bear all the weight of this," Coleman pointed out. "The standard writers are removed from this." The goal of the Common Core is, for the first time, to move American math standards in the simplified direction of our international peers.
.....
Before closing out, a few words on the nuts and bolts of the effort to implement the Common Core. The project is a partnership between a number of organizations, including the National Governor's Association; the Council of Chief State School Officers; Achieve, a non-profit testing group created by the governors; the ACT; the College Board; the State Higher Education Executive Officers; the American Association of School Administrators; and the Business Roundtable. The federal government is supporting the Common Core with about $350 million, most of which is dedicated to developing and implementing tests based on the new standards. Federal funds are also being used to create instructional materials and professional development sessions for teachers who will use the new curricula.
The other major supportor of the Common Core is the Gates Foundation, which expects to spend a total of $250 million "to develop next-generation instructional tools and assessments that will help states and school districts implement the standards."
Now the parts that make me apprehensive:
If you take on the paring without some serious thought, you can do more damage than good, and this example seems exactly the sort of thing that someone who hadn't given the subject much thought and who didn't know much about math might come up with;
And on the subject of the people behind the initiative, the list of partners seems rather light on mathematicians and scientists;
The emphasis here on elementary school is troubling. Historically, I believe it's the upper grades where we start to fall behind on international tests. Are we possibly fixing the part that works? This may be a small point but we've seen a long string of solutions that mainly affected areas which weren't actually affected by the problem. This does not inspire confidence;
The focus on international rankings is an even more troubling sign. TIMSS and PISA are too big a subject to go into this late in the evening, but there are a lot of reasons to worry about role that international tests play here. Just for a a brief overview, there are questions about
-- what these tests are really measuring,
-- where the problems with American scores are coming from,
-- what techniques really drove the successes in highly ranked countries,
-- whether those techniques would carry over to other cultures,
-- and finally the one closest to my heart, is there a possible downside to a country that built the world's greatest economy largely on creativity and unconventional problem solving suddenly doubling down on rote learning and regurgitation?;
Nor does the make up of the list of partners reassure me. I've already mentioned the lack of math and science people. As for the rest, the combination of politicians, administrators and businessmen seems awfully like the assortment that got us in this mess to begin with.
Curriculum reform is important but it's also difficult and I've grown rather cynical about the willingness and ability of most reformers to do the hard work and lay a solid foundation to support the big talk when it comes to difficult problems. Perhaps I judge these things too harshly but I haven't read anything here that makes me optimistic.
Sunday, October 30, 2011
Is consistency too much to ask?
In legal terms, the program is funded not just by today’s payroll taxes, but by accumulated past surpluses — the trust fund. If there’s a year when payroll receipts fall short of benefits, but there are still trillions of dollars in the trust fund, what happens is, precisely, nothing — the program has the funds it needs to operate, without need for any Congressional action.
Alternatively, you can think about Social Security as just part of the federal budget. But in that case, it’s just part of the federal budget; it doesn’t have either surpluses or deficits, no more than the defense budget.
Both views are valid, depending on what questions you’re trying to answer.
What you can’t do is insist that the trust fund is meaningless, because SS is just part of the budget, then claim that some crisis arises when receipts fall short of payments, because SS is a standalone program. Yet that’s exactly what the WaPo claims.
I wonder if the people who want to privatize social security have thought through exactly how bonds held in a 401(k) are different than the trust fund? Perhaps they are more awkward to default (in terms of not paying the bonds) on but governments have raided retirement accounts before. Add in the strange equivocation between "social security" and "social security/medicare" in terms of projecting cost growth (with the second) and targeting the first for reduction.
In general terms, I do not understand why there are such strong objections to income support for people in old age. The program isn't cheap but it widely benefits the majority of Americans (a lot). Why is it such a popular target for debate? Why not debate how high defense spending is relative to the rest of the planet? Or the amazing cost increases in medical care? Why are these not more pressing issues?
I really do not understand because this debate is eating up precious intellectual effort that really needs to be going into comparative effectiveness discussions for medicine.
Saturday, October 29, 2011
Pre-blogging David Carr
I got this from Chait so I'll give him the last word:
That's actually repugnant. I don't actually think the sentiment reflects the general view of the Times, but I do think the Times deserves to be held accountable. If the newspaper lets reporter pop off on a talk show, then his opinions are going to represent the Times.
Friday, October 28, 2011
California Pension Reform
To deal with what have been widely seen as abuses of the retirement system, Mr. Brown said the pensions of all new employees should be based solely on their regular salaries, not taking into account any overtime or bonuses. For existing employees, he said the retirement benefits should be based on an average of the last three years’ salary.
I was always surprised that it was any other way. After all, employee base salary is a reasonably predictable variable for actuaries. Furthermore, base salary is likely to be more representative of the income that actually needs to be replaced in retirement and inflating that number can lead to very high liabilities. Finally, it creates the potential for unfairness as the ability to get overtime in one's final three years may depend on the discretion of the supervisor.
I am completely against the current assault on pensions but that doesn't mean that we shouldn't look for places where intelligent reforms can happen.
All in all, it seems like a much saner approach. We'll see if it manages to gain any traction!
Another cautionary tale of corruption by metrics
There are any number of interesting angles to this story but the one that caught my ear (at least with respect to the discussions we've been having here) is the role that metrics played.
Specifically consequences like this:
Ira Glass
The New York Police Department declined our request to come onto the radio or to have the officers who supervised Adrian Schoolcraft, and who are heard on his recordings, to be interviewed about their side of all this. But the pressure on police commanders to get better numbers really goes back to 1994, when New York started tracking crimes with a system called CompStat. CompStat, for the first time, gave commanders timely, accurate data once a week on what crimes are happening, so they could send more cops to deal with it. Chances are you've heard of all this. It became one of the best known successes in modern policing. Serious crime has dropped an astonishing 77% in New York City since CompStat began in 1994. Other cities very quickly started imitating it-- DC, Philly, LA. Baltimore's version of CompStat ended up in a recurring plot line on the TV show The Wire, where street cops are told by the bosses to do anything to pump up their numbers. And the problem with CompStat, says Professor Eli Silverman, who studies the way police forces use numbers, is that the early success of CompStat created the expectation that numbers must get better every single year, no matter what.
Eli Silverman
In the beginning it was like an orange. You could squeeze juice from an orange in the beginning much more readily than you can as you extract juice from that orange. And now, it gets harder and harder to drive crime down, because you're compared to not how you were in '94, but how you were last year the same week. And when something's pushed to the excess that it is now, and numbers dominate the system, that's when you have negative consequences.
One of the reasons that metric-centric systems can become so bad is that they almost always start out as something good. Compstat, like standardized testing, was a good thing and still is, if used properly. At some point though, people start to focus more on the metric, not because increased focus is helpful but because a metric-based approach is so seductively simple. When that happens the metric becomes an end rather than means (the map becomes the thing for all you Korzybski fans in the audience).
Ira Glass
Then when the officer tried to file it that way, because he didn't have a name for the unauthorized driver, he couldn't file it at all. So the robbery went unreported. Rules go into effect in the 81st precinct that make it harder to report serious crimes. Officers are told that if there's a robbery, one of their supervisors has to come out to the scene themselves. And robbery victims are told that if they don't come into the police station, no crime report will be filed at all. After Graham Rayman started publishing these stories about Adrian Schoolcraft, retired cops and some on-duty cops started contacting him with their own anecdotes about crimes being downgraded from serious to much less serious-- the most shocking of these from a high ranking detective name Harold Hernandez.
Graham Rayman
He's a very distinguished detective. He was working in the 33rd precinct in Washington Heights. And one morning he comes into work and there's a guy who's accused of first degree rape sitting in his interview room. So he sits down and he looks at the guy. And he has a little twinge, and he says, have you ever done this before? And the guy said, yeah. And Hernandez says, how many times? And he says, oh, I don't know, seven or eight. And Hernandez says, where? And he goes, in this neighborhood. And Hernandez is now dumbstruck because there's been no report of a serial rapist-- sexual predator-- working the neighborhood.
Ira Glass
Like, no crimes have shown up. People haven't shown up saying they've been raped or assaulted.
Graham Rayman
He hasn't been notified. And he would be notified as a senior detective in the unit. It would be a very big deal. And so he says, can you give me the dates and locations? And the guy says, well, I can try, but you're going to have to take me around and I'll show. I'll show you. So he and a fellow detective get in the car and they drive around. And they look, and the suspect-- whose name is Darryl Thomas-- points out the locations. And then Hernandez takes his notebook and he writes down the locations. And then he goes back and he looks through stacks of crime complaints. And he finds them. And he realizes that they've been classified-- they've been downgraded. They've been classified either as criminal trespassing or criminal possession of a weapon-- both relatively minor crimes, given that the actual conduct in the narrative that the victims are describing is either first degree burglary, robbery, or sexual abuse, sexual assault. And he confronts his bosses about it. He confronts the precinct commander. And he confronts his detective squad commander. And everyone just shrugs. Meanwhile everyone's terrified that it's going to come out-- that these women are going to go to the press, and it's going to be a huge embarrassment, a huge scandal for the department. And if it had come out, it would have been a huge scandal for the department. But the department was able to keep it quiet. The District Attorney's office prosecuted Thomas and he went away for 50 years. But here's the interesting part-- they never publicized the case. There was never a press release issued about it. There was never a news article written about the case.
That's generally when things go to hell.
Wednesday, October 26, 2011
Felix Salmon on the implosion of Netflix
In hindsight, it’s pretty clear that Netflix CEO Reed Hastings let the bubblicious stock price — it briefly topped $300/share at the beginning of the quarter — go to his head. The company was swimming in money! And so, in September, Hastings signed a deal to pay $30 million per movie for everything that DreamWorks creates, in return for the right to stream those movies a few months after they’re released on DVD. It’s known as the “pay-TV window”, and in order to wrest those rights from HBO, Netflix had to outbid HBO, which was reportedly paying something in the neighborhood of $20 million per movie.There is a huge hype machine out there, powered by a symbiotic PR/press relationship and focused on selling tales of visionary CEOs. These stories are almost always incredibly distorted. In all but a handful of cases, these superstar CEOs are simply competent executives who had two or three good ideas and a great deal of luck.
When you're at the center of all that myth-making (as Hastings was), it can be difficult not to start believing it. When that happens, bad decisions inevitably follow. We've all heard about Hastings' disastrous attempts to wreck a perfectly good business model but I think this example (again from Salmon) might just be more telling:
Maybe the company shouldn’t have spent $40 million, over the course of the third quarter, buying back 182,000 shares at an average price of $218 apiece. (In the wake of today’s results, they’re trading in the $80s.)
While you're there, check out Salmon's tremendously informative discussion of the dynamics of Netflix's stock swings.