Sunday, April 3, 2011

Weekend Thriller Blogging -- the Maltese Falcon

I've been chipping away at the Joe Gores catalog and I decided to check out Spade and Archer, Gores' authorized prequel to the Maltese Falcon. The idea of trying to follow up Hammett was probably not wise but if it had to be done, Gores was the only choice. Not only did he have the literary talent and standing, he also shared Hammett's background as a San Francisco P.I.

Before starting Gores' novel I decided to go back and reread the original. It's not Hammett's best book. That would either be Red Harvest* or the collected Continental Op stories, but Falcon is still very good and it offers an almost unique experience for the reader.

The Maltese Falcon and Shane are the only two cases I can think of where strong, well-written, enjoyable novels were made, with almost complete fidelity, into great, iconic films. To read these books is to be pleasantly overwhelmed by memories of the movies they inspired.**

There is almost a one-to-one mapping of page to screen. This is only possible because both are short novels. Each comes in under two hundred pages. Most otherwise faithful adaptations either have to add material (The Man Who Would Be King) or leave large parts out (The Silence of the Lambs). Almost everything you read in the Maltese Falcon is associated with some unforgettable image.

There is one deviation worth noting. As Pauline Kael pointed out, Effie's reaction to Spade at the end of the book is significant, highlighting aspects of the characters we might have tried to overlook. It is an important difference from the movie but by the time you get to it you're so immersed in the experience, it's almost like seeing a deleted scene.

*I was tempted to mention Yojimbo here but that's a fight for another post.***

** I realize some of you have another set of films to add to this list, but I never made it past Fellowship, so I'll just have to take your word for it.

*** If I do post on Red Harvest and Yojimbo, remind me to toss Savage Range into the discussion

At least we can still drink and drive

Brad DeLong has a list of around two dozen changes and corrections he'd like to see in the paperback edition of Superfreakonomics and he doesn't even get around to this.

Saturday, April 2, 2011

Press-release journalism and the NYT's lost default setting

As I've mentioned before, much of what we've heard about the NYT paywall makes me wonder if they've really thought things through. The following link from Mark Thoma raised yet another question:

Microsoft Accusing Google of Antitrust Violations - NYTimes.com

Most shorter news stories, particularly those based on press conferences, released statements or other publicly available information, are pretty much interchangeable with respect to provider. The version you get from the New York Times will be essentially identical to the ones from the Washington Post or the LA Times or NPR or any other major outlet.

The New York Times traditionally got a disproportionate share of the traffic for these stories because it had become something of a default setting. This traffic meant increased ad revenue. Perhaps more importantly, it brought people into the site where they could be introduced to other, less interchangeable features (for example, the film reviews of A.O. Scott or the columns of Frank Rich). These features are the basis of a loyal readership.

I'm sure that the models Sulzberger and company are using take into account the fact that traffic will drop when you put the paywall into effect. Having worked on some major corporate initiatives, I can tell you that is not the sort of thing that is likely to be omitted. What is, however, often left out is the necessary disaggregation. For example, even in well-run Fortune-500 businesses, you will often run across analyses that correctly predict that a change will cause a net gain of ten percent of market share but fail to note that most of the established customers you will lose are highly profitable while most of those you're going to gain aren't worth having.

Friday, April 1, 2011

Interactively nerdy

Pass the cursor over the image.

AP classes and college development

I'm a big believer in acceleration and giving students the opportunity to test out of courses (I always advised students to explore CLEP). I have never been that impressed, however, with the AP approach. It always struck me as badly thought out and prone to play to the weakest parts of our education system.

I'll make a partial exception for calculus. Because of the extensive prerequisites in majors such as engineering, having cal I or, better yet, cal II out of the way can be a tremendous advantage to an incoming freshman. Add to that the fact that the nature of the subject makes teaching to the test much less of a concern.

With that exception noted, I never saw that strong a case for AP. On the whole, I suspect that college level material is better taught by college faculty, particularly given the test-prep approach of many of the AP classes. If anything, I'd like to see more anti-AP programs. Instead of giving college credit for high school courses, give high school students more opportunities to take college courses (either on site or through distance learning or some kind of independent study). There are certainly precedents: even back in the dark ages, I was in a program where as a high school senior I could attend the local college half-time. With the advent of distance learning, email and digital media, the argument for AP has only gotten weaker.

At this point, I should segue gracefully into a discussion of this paper (via TNR) on the impact of AP courses but to be perfectly honest, I'm in a hurry so I'm just going to give you the abstract and let you all talk it over amongst yourselves:

The Advanced Placement (AP) Program was originally designed to provide students a means to earn college credit and/or advanced placement for learning college-level material in high school. Today the program serves an equally important role as a signal in college admissions. This paper examines the extent to which AP course-taking predicts early college grades and retention. Controlling for a broad range of student, school, and curricular characteristics, we find that AP experience does not reliably predict first semester college grades or retention to the second year. We show that failing to control for the student’s non-AP curricular experience, particularly in math and science, leads to positively biased AP coefficients. Our findings raise questions about recent state policies mandating AP inclusion in all school districts or high schools and the practice of giving preference to students with AP course experience in the university admissions process.

Finally, a bill that will "empower and protect teachers"

I wonder if there's a catch?

Thursday, March 31, 2011

Test Scores

Diane Ravitch has some comments on the evidence that there may have been some alterations of D.C. test score results:

What will this revelation mean for Rhee's campaign to promote her test-driven reforms? Her theory seemed to be that if she pushed incentives and sanctions hard enough, the scores would rise. Her theory was right, the scores did rise, but they didn't represent genuine learning. She incentivized desperate behavior by principals and teachers trying to save their jobs and meet their targets and comply with their boss' demands.

Rhee's advocates point out that D.C. scores went up on the National Assessment of Educational Progress, the federal test. This is true, but the gains under Rhee were no greater than the gains registered under her predecessor Clifford Janey, who did not use Rhee's high-powered tactics, such as firing massive numbers of teachers.


I think that this type of issue is another reason that making testing into such a high stakes gamble may be problematic -- it could massively incent poor behavior (at all levels). Furthermore, that a more humane approach had the same absolute level of improvement as the draconian approach is worth noting. I am sympathetic to arguments that education is important but it seems that dramatic reforms aren't really beating incremental reforms. I suspect that this behavior may be true of many complex systems (and learning is nothing if not complex) that are challenging optimization problems.

Wednesday, March 30, 2011

If you haven't used your 20 yet...

This one's definitely worth a click.
In Prison for Taking a Liar Loan
By JOE NOCERA

A few weeks ago, when the Justice Department decided not to prosecute Angelo Mozilo, the former chief executive of Countrywide, I wrote a column lamenting the fact that none of the big fish were likely to go to prison for their roles in the financial crisis.

Soon after that column ran, I received an e-mail from a man named Richard Engle, who informed me that I was wrong. There was, in fact, someone behind bars for what he’d supposedly done during the subprime bubble. It was his 48-year-old son, Charlie.

On Valentine’s Day, the elder Mr. Engle said, his son had entered a minimum-security prison in Beaver, W.Va., to begin serving a 21-month sentence for mortgage fraud. He then proceeded to tell me the tale of how federal agents nabbed his son — a tale he backed up with reams of documents and records that suggest, if nothing else, that when the federal government is truly motivated, there is no mountain it won’t move to prosecute someone it wants to nail. And it was definitely motivated to nail Charlie Engle.

Mr. Engle’s is a tale worth telling for a number of reasons, not the least of which is its punch line. Was Mr. Engle convicted of running a crooked subprime company? Was he a mortgage broker who trafficked in predatory loans? A Wall Street huckster who sold toxic assets?

No. Charlie Engle wasn’t a seller of bad mortgages. He was a borrower. And the “mortgage fraud” for which he was prosecuted was something that literally millions of Americans did during the subprime bubble. Supposedly, he lied on two liar loans.

...

Apparently, though, it’s only a high priority if the target is a borrower. Mr. Mozilo’s company made billions in profit, some of it on liar loans that he acknowledged at the time were likely to be fraudulent and which did untold damage to the economy. And he personally was paid hundreds of millions of dollars. Though he agreed last year to a $67.5 million fine to settle fraud charges brought by the Securities and Exchange Commission, it was a small fraction of what he earned. Otherwise, he walked. Thus does the Justice Department display its priorities in the aftermath of the crisis.


It’s not just that Mr. Engle is the smallest of small fry that is bothersome about his prosecution. It is also the way the government went about building its case. Although Mr. Engle took out the two stated-income loans, as liar loans are more formally called, in late 2005 and early 2006, it wasn’t until three years later that his troubles began.

...

The film, “Running the Sahara,” was released in the fall of 2008. Eventually, it caught the attention of Robert W. Nordlander, a special agent for the Internal Revenue Service. As Mr. Nordlander later told the grand jury, “Being the special agent that I am, I was wondering, how does a guy train for this because most people have to work from nine to five and it’s very difficult to train for this part-time.” (He also told the grand jurors that sometimes, when he sees somebody driving a Ferrari, he’ll check to see if they make enough money to afford it. When I called Mr. Nordlander and others at the I.R.S. to ask whether this was an appropriate way to choose subjects for criminal tax investigations, my questions were met with a stone wall of silence.)

Mr. Engle’s tax records showed that while his actual income was substantial, his taxable income was quite small, in part because he had a large tax-loss carry forward, due to a business deal he’d been involved in several years earlier. (Mr. Nordlander would later inform the grand jury only of his much lower taxable income, which made it seem more suspicious.) Still convinced that Mr. Engle must be hiding income, Mr. Nordlander did undercover surveillance and took “Dumpster dives” into Mr. Engle’s garbage. He mainly discovered that Mr. Engle lived modestly.

In March 2009, still unsatisfied, Mr. Nordlander persuaded his superiors to send an attractive female undercover agent, Ellen Burrows, to meet Mr. Engle and see if she could get him to say something incriminating. In the course of several flirtatious encounters, she asked him about his investments.

After acknowledging that he had been speculating in real estate during the bubble to help support his running, he said, according to Mr. Nordlander’s grand jury testimony, “I had a couple of good liar loans out there, you know, which my mortgage broker didn’t mind writing down, you know, that I was making four hundred thousand grand a year when he knew I wasn’t.”

Mr. Engle added, “Everybody was doing it because it was simply the way it was done. That doesn’t make me proud of the fact that I am at least a small part of the problem.”

Unbeknownst to Mr. Engle, Ms. Burrows was wearing a wire.
...

It gets worse from there

One more radio story then I'll call it a night

More extraordinary journalism from This American Life about how a small drug-related offense at the wrong place and the wrong time can have truly horrifying consequences.

Ira reports from Glynn County Georgia on Superior Court Judge Amanda Williams and how she runs the drug courts in Glynn, Camden and Wayne counties. We hear the story of Lindsey Dills, who forges two checks on her parents' checking account when she's 17, one for $40 and one for $60, and ends up in drug court for five and a half years, including 14 months behind bars, and then she serves another five years after that—six months of it in Arrendale State Prison, the other four and a half on probation. The average drug court program in the U.S. lasts 15 months. But one main way that Judge Williams' drug court is different from most is how punitive it is. Such long jail sentences are contrary to the philosophy of drug court, as well as the guidelines of the National Association of Drug Court Professionals. For violating drug court rules, Lindsey not only does jail terms of 51 days, 90 days and 104 days, Judge Williams sends her on what she calls an "indefinite sentence," where she did not specify when Lindsey would get out.
As the story notes, Williams' court is also unusually ineffective.

Harsh, cold moments of self-realization

I write for a blog called Observational Epidemiology.

I actually look forward to listening to podcasts on math history.

It's a wonder I date at all.

Why we need NPR

Here's All Things Considered covering the Japanese nuclear crisis with a calm tone and meaningful context.

And then there's this...

Just pay the 99 cents, you cheapskate!

A while back, This American Life did a piece on college partying. It's a fantastic piece of journalism and it's highly relevant to the debate over the impact, positive and negative, of colleges on the areas that host them.

And while we're on the subject, our friend at Metaphor Hacker sends us another relevant radio piece (this time on the BBC).

Tuesday, March 29, 2011

"The best report ever on media piracy"

You probably don't have time to read the entire 440 page report (I didn't), but you should at least clear out a few minutes for Salmon's sharp and insightful summary.

Student Assessment

From Dana Goldstein:

The good news is that Campbell’s Law does not mean we should give up on assessing students and holding school systems accountable for their academic success. Research shows that certain kinds of exams—those that require essay writing on broad themes, for example—enhance student learning of key concepts. We can also assess students by requiring them to give oral presentations, or by looking for growth in portfolios of their work over the course of a year. Effective teachers produce students who excel when held to these more sophisticated standards, which are difficult to fudge or cheat.


This actually matches my experience with teaching quote well. Standardized tests are the only feasible way to handle large classes (how else do you assess 400 students?). But my best results come from asking essay questions (in free hand) and requiring many, many class presentations. Not only is the assessment a lot more complete but I gain a very good idea of what concepts and ideas that I failed to communicate well.

This type of assessment is a valuable tool in making next years class better than the one before it (a process I hope never stops). Sadly, it is not well suited for mass comparisons between schools. But then complex phenomena rarely summarize well (just consider confounding by indication for how hard it is to use summarized data to capture complex processes).

Monday, March 28, 2011

"We had a reason..."

A few years ago, I was working on the roll out of a big project (think lots of zeros) for a company which will remain nameless for obvious reasons. Though impressive in many ways, the initial launch was set up in a way that seemed to preclude us from using most of the data that we had spent a tremendous amount of time and money acquiring.

One day, toward the end of the project, I was having a few beers with one of the chief architects and I asked him point blank why they chose to set things up this way. His answer was (and I'm giving you this verbatim) "I remember we had a reason but I don't remember what it was."

I've been flashing back on that conversation quite a bit recently as the details of the NYT paywall emerge. Of course, the resemblance could be the result of incomplete information. If I had access to all of the data and analyses, I might be loading up on their stock instead of mocking their corporate strategy (I would continue to mock Maureen Dowd regardless), but being limited to an outsider's view, I have to wonder what would happen if you downed a couple of beers with Sulzberger then asked him about this post from Philip Greenspun:

...how the NY Times spent a reported $40-50 million writing the code (Bloomberg; other sources are consistent). Google was financed with $25 million. The New York Times already had a credit card processing system for selling home delivery. It already had a database management system for keeping track of Web site registrants. What did they spend the $40-50 million on? A monster database server to keep track of which readers downloaded how many articles? They should already have been tracking some of that for ad targeting. In any case, a rack of database servers shouldn’t cost $40 million.

What am I missing?

[I built a pay wall back in 1995 for the MIT Press, restricting access to some of their journals, e.g., Cell, to individual subscribers and people whose IP addresses indicated that they were at institutions with site-wide subscriptions. I can't remember exactly what I charged the Press, but it was only a few days of work and I think the invoice worked out to approximately $40 million less than $40 million.]