Here's one for the Unqualified Offerings crowd...

I'm taking this with a small grain of salt (there are a couple of things in the Georgetown report that concern me a bit), but with those caveats I think we can call this a point for Thoreau and company.

High Unemployment Major #1:
Information Systems
Unemployment rate for recent grads: 14.7 percent*
In the digital age, it may seem as though all bachelor's degrees in the computer science field would be a safe bet. But numbers from the Georgetown Report suggest that this is not the case. In fact, the report found that recent grads in this major faced an unemployment rate of nearly 15 percent.
Why the depressing job prospects? The simple answer: Too many job applicants, not enough spots. "The market is saturated for this industry," says Hallie Crawford, a job search expert and certified career coach.
With the rise of technology, many people have opted to pursue information technology paths, says Crawford. And the influx of new candidates for positions within this field has made the job market very competitive, she says.

Here's what I'm taking away from most of these stories and from what I'm hearing from people in the STEM job market:

The world of the STEM job hunter is brighter than that of the non-STEM crowd, but much dimmer than you've been told;

Because many of these specialties are fairly narrow, a small increase in supply or decrease in demand can gut the market (see above);

Even in hot, high-demand fields, fewer people are making big bucks than you might think. "Only 4 percent of software developers in the burgeoning app economy have made over a million dollars. Three-quarters of them made less than $30,000."*;

You hear stories about companies willing to do anything to acquire talented people and keep them happy. At best these examples are unrepresentative. At worst, they're fraudulent.

I would certainly encourage people with any interest in the field to go into one of the STEM fields. The subjects are interesting and you can probably get a pretty good job, but keep your expectations reasonable, your debt low and, whatever you do, don't believe the hype.


* I'm willing to bet you dinner that most of that 4% got a significant portion of that million through their talents as entrepreneurs, investors or managers.

Weekend blogging -- Memorial Day Roger Corman Marathon

I was having a cup of coffee and a cookie this evening at a place on Beverly I frequent a lot. The bakery's first rate, the coffee's good and I have no trouble picking up the wifi from the Starbucks next do. I happened to look at the theater across the street and the marquee read "Roger Corman and Joe Dante in Person." That sort of thing happens to you when you live in LA.

Unfortunately, none of the Poe films appear to be available for streaming but Hulu does have a few worth checking out. Roger Corman never made a bad film under the circumstances, and even when the circumstances were particularly dire, he always did something interesting.

A Bucket Of Blood (1959)

Though Little Shop (also included here) gets more attention, I think this is the better movie, largely due to the rare lead by beloved character actor Dick Miller.




The Little Shop of Horrors (1960)

Still, you do have to give this one its props, shot in a couple of days for $30K. A pretty good little film in absolute terms but amazing when you realize what he had to work with.








The Terror (1963)

In some ways an even more impressive example of high speed, low cost movie making. Though there are differing accounts, most go something like this: when he realized that the film The Raven was going to wrap up three days early so he had Leo Gordon* write a script over the weekend. They started shooting that Monday, scheduling shots based on which part of the set was supposed to be torn down next.





* Gordon is more familiar to movie and TV fans as a menacing character actor in countless shows like Andy Griffith and Maverick, but he was also a highly successful self-taught writer. He had learned the craft while reading most of the books in the San Quentin library while serving time for armed robbery.

Can nobody work out the incentives?

I hate to do the both sides are out to lunch meme, but this response to the Levitt/Dubner/Noah Smith health care plan missed the main point: 

The L/D plan would, in its majestic equality, allow the affluent person with a well-stuffed savings account and the low wager-earner drowning in debt alike to set aside $1,000 for health care expenses and to take the risk of incurring 4 grand of debt through events they have little or no control over. Indeed, their always-smarmy tone (“if they are being prudent”) suggests that the point of the plan is not so much health care provision as setting up a cheap moral lesson in thrift, a lesson that not coincidentally will be much easier for people similarly situated to Levitt than for the ordinary working person in 2014 to pass.

But let’s assume arguendo that we should ignore questions of equity, and also assume that the only relevant question is trying to determine how to collectively spend health care dollars in the most efficient manner. Even on its own terms, the plan doesn’t make sense. The L/D wouldn’t disincentivize health care spending per se; it would massively disincentivize seeking cheap preventive care. If you get regular check-ups, it costs you money; if you save money by skipping checkups and get an illness that could have prevented, the costs are largely paid collectively. In other words, the L/D plan discourages the most cont-effective forms of care while doing little to discourage the least cost-effective. Even on its on terms, I don’t see how this plan makes any sense.

Cheap preventative care isn't where this system is going to go wrong.  Nor is it in the poor equality properties of the law, as some young people might end up ahead on total revenue (while others get crushed).  behind the veil of ignorance it isn't clear how it will all work out.

Now let's look at this plan:

On January 1 of each year, the British government would mail a check for 1,000 pounds to every British resident. They can do whatever they want with that money, but if they are being prudent, they might want to set it aside to cover out-of-pocket health care costs. In my system, individuals are now required to pay out-of-pocket for 100 percent of their health care costs up to 2,000 pounds, and 50 percent of the costs between 2,000 pounds and 8,000 pounds. The government pays for all expenses over 8,000 pounds in a year. 

So you have two efficiency problems here.  One is that you now have a whole bunch of extra paperwork and IT to track where people are on the cost spectrum.  Do we mail people bills after we determine if they have not hit the cap?  What about people will marginal addresses and living situations.  You are replacing a cheap system with average outcomes with one that is immediately more complicated to administer. 

But where this will go terribly wrong is for those people who go over 8,000 pounds per year.  Did you notice that piece where the government pays for all expenses over 8,000 pounds.  How do we know that these costs are acceptable?  After all, every single hip replacement might exceed 8,000 pounds in expenses.  How do we know if we are getting ripped off? 

So you end up needing to do the same schedule of acceptable costs as any socialized medical system has.  This rather removes the benefit of the free market in setting prices, as you have a single payer for all expensive conditions.  Will hospitals not offer free parking to get people to have a procedure at their (more expensive) hospital?  Why would the patient say no?  Altruism?

Even worse, this makes outcomes worse for patients with chronic conditions, at least until they hit the 8,000 pound ceiling in any year (and note the billing issues here -- if people have to pay and be reimbursed there can be a liquidity issue).  Now these people pay 4,500 pounds with a 1,000 pound subsidy.  Hopefully nobody will have trouble paying the 3,500 pounds per year?  That is around $450 a month -- what if the worker gets $5 an hour? 

And this gets back to the most important issue -- these people completely misunderstand the whole idea of insurance.  We insure against risks that exceed our ability to pay.  Is 3,5000 pounds a sum that every British person could pay without hardship?  A cost of zero would make it possible for everyone to be able to afford health care, regardless of financial circumstance.

Now, what I want to make exceedingly clear is that the nation with the highest private sector portion of payments also has the highest public sector as well, as even libertarian Megan McArdle notes:

A lot of people seem to think that "per-capita government spending" means "spending per person covered by government insurance." That's understandable, but wrong. "Per-capita government spending" means "government spending on health care per U.S. citizen." In other words, we spend as much to cover a fraction of our population as other governments spend to cover everyone. So pointing out that Medicare beneficiaries cost more on average than younger people is true but irrelevant. We spend more covering old people, poor people and veterans than many other governments spend to cover all those people, plus the rest of the population.

 So if you are advising the English on health care reform, why would you suggest the politically unpopular move of putting more "skin in the game" when the country that does the most of this ends up paying more money (out of government revenues) to cover fewer people?  And England allows private health care, so the benefits of a more private system (over and above current options) isn't absolutely clear. 

Finally, there is the issue of prioritization.  Is the NHS really the biggest policy challenge that the UK faces?  Is it in the top 10?  Now it is possible that innovation is under-supported by this approach.  Of course, they could simply increase research grants, if this was thought to be the most important issue.

But wouldn't issues like persistent unemployment and industrial decline be better places to focus efforts?  And how would increasing the government's expenditure on health care (likely financed by higher taxes) work to improve these issues?  Or is it expending political capital on an experiment that might well not work out to reduce costs? 

A pretty good one-page intro to New Math

Not what you'd call 'in  depth,' of course, but this primer by Calley Connelly of MSU Bozeman does a pretty good job hitting the major points and players.

Update: For something more in depth, try this and of course this.

Good grief! -- Sally Brown on New Math [Updated]

I have been working on a long piece on the parallels between the New Math of the Sixties and the Common Core math of today. As part of my research, I came across an amusing quote from a Peanuts strip of the time.

From Wikipedia:

In 1965, cartoonist Charles Schulz authored a series of Peanuts strips which detailed kindergartener Sally's frustrations with New Math. In the first strip, she is depicted puzzling over "sets, one to one matching, equivalent sets, non-equivalent sets, sets of one, sets of two, renaming two, subsets, joining sets, number sentences, placeholders." Eventually she bursts into tears and exclaims, "All I want to know is, how much is two and two?"

What surprised me was how well Schulz captured the terminology. The part about one to one matching was particularly apt.

[Found it]

The Aphorisms of Success

I've blogged a bit on corporate culture (and there are far more on the topic waiting to be written or rewritten). One of the aspects I should focus more on is the emphasis and, in some cases, the outright enforcement of aspirational language.

It is easy to satirize the steady stream of phrases like "achieving excellence," "amazing customers." and "maximizing impactfulness." A friend of mine, who was dean of business at a small college at the time, actually created an award called "the margins of excellence" (excellence apparently being a thing you don't want to hit dead on).

But there are bigger concerns than just looking silly. It is true that most of the time if properly applied, the combination of hard work and a reasonably positive attitude will often achieve impressive results, but it's not a deterministic relationship. When you ignore the caveats and the limits and completely commit yourself to the anything-is-possible rhetoric, the results can be disastrous.

I was recently reading some particularly embarrassing example on an education blog, I was reminded of the This American Life segment on Duke Fightmaster.

Duke Fightmaster is not a man of half measures, and he believed in the aphorisms of success, that if he wanted something badly enough, he would have it. He was going to replace Conan O'Brien. Not by doing all the normal things like getting a production job at a local talk show, learning the business, working his way up. Instead, he would make himself into a talk show sensation from his own bedroom.

As you might guess, this did not go well.

Duke Fightmaster
I guess somewhere in my mind I just thought, you know, no matter how bad things get, I'll just kind of put my head down and keep going. And I knew that it was ridiculous, starting a talk show. I mean, I knew that, outwardly, people think I'm ridiculous.

And I remember just driving around like, "The show isn't going anywhere, I'm not going anywhere, I've wasted these last years." And I remember just driving around so depressed. And I just felt like I had broken-- and I had a breakdown where I just started crying in my car. And I just felt like I hit the core of my being and it was, "you're a loser." And I think that was part of my rock bottom.

Sarah Koenig
Did you quit after that?

Duke Fightmaster
No. No, I think I still went for another year after that.

You know, anyone who makes it in this life at anything, you always hear, has to go through hell. So I figured, "I'll just go through hell." I remember my friend who worked in real estate worked for one of those cheesy real estate motivators that used to yell out, "You have to have a break down to have a break through." So I was thinking, "OK, I've had my break down, so now I'm going to actually break through to some new level."

You really should listen to the whole thing

France and jobs

Sometimes the data just screams at you:

Since the late 1990s we have completely traded places: prime-age French adults are now much more likely than their US counterparts to have jobs.

This is for adults 25 to 54.  So maybe the USA might have some advantages above or below that age range.  But France has a world class medical system, high taxes, and a great deal of worker protection.  Enough protections that I can actually remember meeting French people in Quebec who moved there because their business model required too much worker churn to be viable in France. 

So we shouldn't necessarily say "they have it right".  There are good and bad things about the French model, and it hasn't always been a good thing to be a participant in the French economy.  However, what this does do is highlight how challenging it is to link US-style markets to general population employment. 

That has some real policy implications as it does remove a key trump card in the balance between business interests and social programs. 

When "best practices" aren't -- sometimes imitating the successful is a really bad idea

We started the week with a post on the much touted Relay Graduate School of Education. Yesterday we had a piece discussing the assumptions underlying the notion of "best practices." Here's where those two topics come together.

As I mentioned before, Relay GSE and its role in the reform movement is a complicated story. Not only are there a lot of moving parts; the moving parts have moving parts, so in this thread, I'm trying to open with a cursory bits for context then zoom in on one main aspect per post.

The cursory part: The following is a very good lesson intro but not a particularly good math lesson intro. The good part is is that the kids are having fun, they're ready to learn and they are associating positive emotions with the class. All of these things important and the instructor is managing them exceedingly well. The math part is considerably weaker. The opening is knowledge-, not process-based (no problem-solving or higher-order thinking) and the knowledge covered -- a mediocre mnemonic (since these are made-up words, they are easy to scramble or to forget entirely) for a formula most kids don't have that much trouble remembering -- is fairly trivial. Even the question around the 2:00 mark that got the dean so excited didn't show any significant connection with the material. (Questions you'd rather hear at that point include: "Why do they have to be right triangles?"; "What do we do with other shapes like rectangles?"; "Does this have anything to do with similar triangles?"; "If they give us both angles, how do we know which side is opposite?")

But I don't want to get too caught up in the criticisms. Though I have concerns, it is still clear that Corcoran is an extraordinarily talented teacher with a tremendous gift for entertaining and engaging students.



KIPP Academy's Frank Corcoran: Captain Hook from KIPP NYC on Vimeo.

He is also a potentially disastrous role model.

As I said in the last post:

In order for a best practices approach to make any sense whatsoever, the optimal level of the factors in question must remain basically the same from person to person, location to location, and sometimes even job to job. Those are extremely strong and in some cases wildly counterintuitive assumptions and yet they go unquestioned all the time.

For a young teacher, there is tremendous appeal to the idea of winning kids over with the big show. Today, they're ignoring your lessons, rolling their eyes at your advice and occasionally nodding off while you're talking; tomorrow, they're hanging on your every word. It hardly  ever works that way. One lesson almost never makes you anyone's favorite teacher.

On top of the question of effectiveness, there's often a real risk associated with the 'fun' lesson or hook. Not only does it break the normal structure and routine; it gives the students a relatively legitimate argument for non-cooperation ("if this is supposed to be fun and I'm not having fun, why can't I do something else?"). With time, teachers generally learn how to read classes and situations and discover ways of framing and executing these activities, but for an inexperienced teacher with a problem class, things can go badly.

Check out this passage from Michael Winerip's 2010 NYT article on Teach for America and keep in mind that there is an extremely high degree of overlap between the pedagogical methods taught by TFA and those taught by Relay.

The 774 new recruits who are training here are housed in Rice University dorms. Many are up past midnight doing lesson plans and by 6:30 a.m. are on a bus to teach summer school to students making up failed classes. It’s a tough lesson for those who’ve come to do battle with the achievement gap. 

Lilianna Nguyen, a recent Stanford graduate, dressed formally in high heels, was trying to teach a sixth-grade math class about negative numbers. She’d prepared definitions to be copied down, but the projector was broken. 

She’d also created a fun math game, giving every student an index card with a number. They were supposed to silently line themselves up from lowest negative to highest positive, but one boy kept disrupting the class, blurting out, twirling his pen, complaining he wanted to play a fun game, not a math game. 

“Why is there talking?” Ms. Nguyen said. “There should be no talking.” 

“Do I have to play?” asked the boy. 

“Do you want to pass summer school?” Ms. Nguyen answered. 

The boy asked if it was O.K. to push people to get them in the right order. 

“This is your third warning,” Ms. Nguyen said. “Do not speak out in my class.”

This is really bad. The lesson was not great to begin with -- there are better ways to get the concept across and the fun potential of lining up silently is limited -- but with the disruptions the time was almost entirely wasted (and wasting students' time is one of the worst things a teacher or administrator can do). And the damage almost certainly wasn't be limited to that one day. The teacher had her authority challenged, made empty threats, lost control of her classroom.

But it could have been worse. Kids have a natural tendency to push boundaries and the boundaries here were relatively tight. Now think about an activity that requires shouting and striking martial arts poses. In the video clip, we had an experienced and charismatic teacher with a medium sized class of well-behaved students in a school with strict discipline and a student body self-selected to be compliant and cooperative. Imagine what might have happened if someone like Ms. Nguyen had tried this in a tough school with thirty or forty students.

At the risk of oversimplifying, you can basically break this Relay clip down into two parts:

The dull content-driven part -- making concepts understandable, intriguing them with a challenging problems, getting them to make connections and engage in higher-order thinking -- plays an insignificant role in this clip. Corcoran may have done all of these things later in the lesson, he may even have done them very well, but in this clip there is simply nothing along these lines worth noting, let alone imitating;

Then there's the exciting performance-driven part. Corcoran is remarkably talented and he puts on an exceptional show, but like a lot of other impressive acts, you probably shouldn't try this on your own.

The two big assumptions behind 'best practices'

[Homonym alert -- another smart phone composition]

There is no notion better loved by scientific management types than 'best practices.' It has become one of the truly obligatory PowerPoint phrases and it is rare to hear a high-level executive lay out plans for fixing a large organization without promising to promote them. These days those executives often have titles like 'superintendent.' Scientific management is now extraordinarily popular in education circles, particularly in the education reform movement. This confluence of two of the major interests of this blog means there are some major threads starting that will allude to this topic quite a bit.

'Best practices' are often treated as a self-evidently good thing  – Who wouldn't want to be best? – – but the idea of finding optimal methods and strategies and applying them across an organization is based on two very big and difficult-to-justify assumptions.

The first is that you have or even can identify these behaviors. Determining "best" status usually requires a high degree of faith in your metrics and metrics almost never perfectly align with the properties they are supposed to measure. Even when handled by the most competent of people, things can go badly wrong.

And, as anyone who has worked for large corporations can tell you, the executives overseeing these programs often are not up to the job. Between various biases, office politics, and a widespread misunderstanding of how statistics works, the results are often far from "best."

Most corporate cultures strongly discourage employees from questioning whether or not a "best practice" is actually best, but at least the question does sometimes come up. The very idea of the next assumption often escapes people entirely.

In order for a best practices approach to make any sense whatsoever, the optimal level of the factors in question must remain basically the same from person to person, location to location, and sometimes even job to job. Those are extremely strong and in some cases wildly counterintuitive assumptions and yet they go unquestioned all the time.

Later in the week, we'll discuss how violating these assumptions can lead to trouble (and connect this topic with an earlier post).

Freakonomics

This piece of a review of the newest Freakonomics book is a bit harsh:

They take this as evidence that even intelligent politicians don't like hearing uncomfortable truths that challenge positions to which they are committed. But it seems more likely that Cameron, who is indeed an intelligent politician, noticed they were talking nonsense. After all, it's a ridiculous analogy. People don't go to the NHS and "pick out" their treatment. They are in the hands of doctors and other healthcare professionals who collectively try to find the best treatments for them, within limits. Healthcare is nothing like transportation. If it were, the NHS, whatever future problems it might be facing, could hardly have survived so long (and performed more efficiently than the rival US system, where many patients really are "picking out" their preferred treatments). Only two economists (or rather one-and-a-half economists) could be so arrogant and so ignorant as to think that this was how to talk to a future British prime minister about healthcare. I imagine that what Cameron was really thinking was: if these are the clever people, spare me from the stupid ones.

But it does get at a very real issue -- different markets operate in different ways.   Noah Smith and Paul Krugman point out the difficult link between theory and empiricism here.  It is true that very few health care markets are purely socialist or free -- they are classical mixed markets in most places.  That said, the English model is hardly a disaster. 

What I generally want to see when people suggest large countries radically change an existing system (upsetting many stakeholders and people who planned their lives around a set of rules) is that there will be relatively immediate benefits (i.e. it is politically viable) or long term improvements for the country (i.e. it is worth losing an election over as it makes people's lives better). 

Levitt clarified his ideas, but I think they still have some serious issues.  He suggests:

On January 1 of each year, the British government would mail a check for 1,000 pounds to every British resident. They can do whatever they want with that money, but if they are being prudent, they might want to set it aside to cover out-of-pocket health care costs. In my system, individuals are now required to pay out-of-pocket for 100 percent of their health care costs up to 2,000 pounds, and 50 percent of the costs between 2,000 pounds and 8,000 pounds. The government pays for all expenses over 8,000 pounds in a year.

Yet, ironically, this approach requires a real faith in effective government.  Why?  Because there will be people who need different amounts of subsidy (currently poor elderly, for example, or those whose illness prevents them from working).  Or it requires getting rid of universality, which might be a feature in the long run but has many bad features in the short run.  It adds in layers of billing and pricing, that health systems are often poor at generating (or at least the US systems seem to be).  People need to be able to get accurate price quotes, collections for debt needs to exist, and the hospital have to set up payment under difficult circumstances. 

It also requires the government to dynamically adjust the "payout" and the "thresholds" as prices change.  Will that be done by a central payments board?  How is that really different than the current English approach of determining cost effectiveness in general?    You are still using expert opinion to run the system, just in a different place.  And there could be some real concern that the "thousand pound" subsidy could be used to replace current benefits or drop over time as it is eroded by inflation. 

So what is the evidence that this radical reform will reduce total health care costs?  Because this is a case where we want to have a clear test of the theory before completely reforming a relatively functional system (it's mediocre for the OECD but one can go down from average, as well as up).  There are some examples of health care systems that might be more free market plus regulation oriented (say Singapore).  But why not the French model? 

I'd like for you all to take a look at something...

This is one of those big, complex stories that are themselves subplots of still bigger, more complex stories. These subjects tend to get out off if you approach them too ambitiously. The best way to handle them, at least for me, is to keep each post small and manageable, at least while you're laying the groundwork (blogs are good for that).

I've been meaning for a long time to write about Relay Graduate School of Education and its role in the education reform movement. Lots of moving parts here, but there's one very important part that I think we can pull out and address as a stand alone question:

Does getting a master's from Relay require graduate level work?

When you have a minute, check out Relay's website then watch a few of these videos. They're all short and relatively self-explanatory. I don't want to go into content, pedagogy, or applicability at this point (that can wait until later posts), but I do want to mention that the most interesting (hooking the lesson) is also the least representative.

Here are some of the videos which, as far as I can tell, are used as part the school's flipped classes:

Lesson plans*


Transitions


Wait Time


Clear and precise directions


Strong voice and positive framing


Hooking lessons


It's been a long time since I took a methods class but this looks a lot like what I remember from sophomore and junior level courses. Are these things you would normally see at a graduate level? I realize these videos are only part of the program but this description of the curriculum does nothing to allay my concerns:

The Relay GSE curriculum comprises two core components. First, graduate students learn core instructional practices in planning, delivery, and assessment of teaching and learning that are necessary for all teachers, regardless of the subject or grade level they are teaching. These practices are sometimes referred to in the education field as “general pedagogy.” Second, graduate students will learn how to teach their specific subject at one or more specific grade levels. Math teachers do not learn geometry, for example, but rather how to teach geometry and how students learn geometry. This is sometimes referred to as “pedagogical content knowledge.

Help me out on this one. Based strictly on the information Relay provides us, would you say this constitutes graduate or undergraduate level work?


*Not sure if intentionality (intensionality?) means what he thinks it means.

Quoting Pólya quoting Shaw

Along with Richard Feynman's "total temperature of the stars," this is my favorite comment on 'new math.'


From The Random Walks of George Pólya:

In the immediate post-Sputnik era Pólya had been an outspoken critic of the formalism of the School Mathematics Study Group (SMSG) and the “new math." He often cited an example taken from the SMSG geometry text that gave a theorem with proof—taking up half a page—stating that with three points on a line, one point must lie between the other two. He argued that though this is a necessary theorem for a foundations course in geometry, it has no place in an elementary text. He said that had he been asked to study the proof of such a theorem in high school, he would almost certainly have given up on mathematics, having concludcd that the subject is dumb! In support of this viewpoint— that there was excessive rigor in the “new math"—he was one of the signers of a manifesto on curriculum reform that appeared in The Mathematics Teacher and The American Mathematical Monthly decrying the direction of the reform movement of the 50's and 60's.

In talking about what he regarded as the excess of rigor in SMSG. he cited the oft‘repeated story about Isadora Duncan's proposal of something like marriage to George Bernard Shaw. She argued that their children would have his intelligence and her beauty. Of course, Shaw pointed out that the children might well have... Pólya suggested that SMSG had been put together by research mathematicians and high school teachers. on the assumption that the material would reflect the mathematical sophistication of the researchers. and the pedagogical skills of the high school teachers. But then, like Shaw, he pointed out that the material in fact reflected... The observation was unkind but there was, perhaps. some truth in it.

Weekend blogging -- Breaker Morant

I've always meant to see this one, even more so since I came across Edward Woodward's extraordinary work as the self-loathing agent Callan.

"Santa Ana winds blowin' hot from the north..."

Yes, it's been one of those weeks.

“There was a desert wind blowing that night. It was one of those hot dry Santa Anas that come down through the mountain passes and curl your hair and make your nerves jump and your skin itch. On nights like that every booze party ends in a fight. Meek little wives feel the edge of the carving knife and study their husbands' necks. Anything can happen. You can even get a full glass of beer at a cocktail lounge.”

― Raymond Chandler, Red Wind: A Collection of Short Stories

The firefighters say they've never seen them coming in like this.

The SAT probably is unfair to the disadvantaged but not for the reasons you've been hearing

This is another one of those posts that I started weeks ago as part of the big SAT thread then didn't get around to posting. One of the big questions was the fairness of the test. I had alluded to the problem but usually as a side question. Part of the reason I didn't spend more time on the question was because of my specialty. Though I did originally certify to teach math and English, I've been focused almost entirely on the former for a number of years, and almost all of the prep work I've done with student has been on the math side.

If I had been working with the verbal part, I would have had to address some uncomfortable questions. The verbal SAT is a good, well-designed and informative test but there are inescapable concerns about its fairness.It is very difficult to design a verbal reasoning test that is not culturally biased. Language and culture are so intertwined that it is almost impossible to even discuss one with out considering the other. Cultural biases are not nearly as much of a concern on the mathematics side of the test.

Still, even in the reasonably objective and unambiguous world of mathematics, there are any number of ways in which background can give an unfair advantage. These include (but are by no means limited to) enrichment activities, role models, high-achieving schools and community culture, support and tutoring, and expensive prep classes.

This last item has become one of if not the central element in the SAT/fairness discussion. All stories on the subject seem to be contractually obligated to talk about expensive test prep courses and yet, as far as I can tell, they all frame the issue in a way that makes the criticisms completely invalid.

There are two fallacies in this standard line of argument: The first is based on confusion over absolute versus relative values; the second is based on a common but profoundly wrong concept of the test itself.

As an absolute statement it is true that if prep courses do any good at all then the ability to pay for them will provide an unfair advantage. The question on the table now, though, is not absolute. The people who are arguing for the elimination of the SAT are also arguing, sometimes implicitly, often explicitly, for grades to take a much larger role in the college selection process to take up the slack. This leads to a very different question: does having money give one a greater advantage on the SAT then it does on GPA?

Private tutoring centers are a huge national industry, and if you send your child to one for any length of time, the cost will probably be far greater than what you would've spent on an SAT prep course. We could, of course, have a long discussion about the intrinsic value of what is taught in one versus the other, but from an economic fairness standpoint, all we care about is the cost and the effectiveness in improving the given metric.

A valid argument here would start with a comparison of the ways that privilege can provide an unfair advantage on the SAT versus GPA, but what we've gotten so far is the pseudo-argument: A is worse than B because A is bad ("French Fries are so fatty; I think I'll have onion rings instead."). As far as I can tell, none of the many stories describing the potential impact of prep courses even mention the existence of the private tutoring industry.

The other fallacy here is the very wrong but very common belief that the SAT is some kind of mysterious black box, the secrets of which can only be revealed by one of the illuminated. I've already been through this at some length but just to reiterate, because of the stability of the tests and the large number of previous editions that the College Board has published, the SAT is one of the most transparent exams you're ever likely to take.

At least on the math side (which is the area I have some experience with), this transparency, along with the nature of the questions, makes the test surprisingly easy to teach and to teach yourself. In the latter case, it goes like this:

Take one of the old tests (don't worry about the time limit);

Check your answers;

Read the explanations for the ones you got wrong;

If you don't understand the explanations for some of those problems, take them to a teacher or administrator and ask for help (as a former teacher, I can tell you that educators love to see this kind of initiative and will go to great lengths to encourage it). There are also free after-school programs that would be glad to help (I volunteer at one of them);

Repeat the process. After you start breaking fifty or sixty percent, work on reducing your time.

If it's this easy, why does anyone bother with a pricey prep course? Well, for one thing, it's not that easy. We are talking about a tremendous amount of work and self-discipline. The courses provide structure and external discipline, not to mention a large dose of motivation and reassurance to counteract the test's foreboding reputation (a problem greatly compounded by journalists' tendency to talk about the exam in dark and mysterious terms).

To sum up, there is tremendous unfairness in our education system. The SAT is sometimes part of that unfairness, but neither for the reasons or to the extent you often hear.