A very nonstandard pedagogical example

Not sure about how this post over at You Do the Math came out, but it does fit in closely with the Common Core/math curriculum thread that will be spooling out here at West Coast Stat Views over the next few weeks. The post talks about my, in retrospect, rather odd refusal to learn my multiplication tables in elementary school and it illustrates some of the points that will come front and center when George Polya comes into the discussion.

Weekend blogging -- all auteur, all the time

As mentioned before, I have mixed feelings about auteurism as a theory, but I generally enjoy the corpus.

Hulu's "Criterion Picks" theme this week is "Starring the Director" and they've made some interesting films available for free viewing. They include a hard-to-find picture by Orson Welles (which I haven't seen) and The Rules of the Game by Jean Renoir (which I have seen and which lives up to the hype).

As Joe Bob used to say, check it out.

Passions and Procrustes

Many of the problems with education reform come from starting with overly simplified models and assumptions, then compensating with overly complicated implementations schemes. This is true with the areas we talk about a lot -- teacher and school quality, incentives, accountability -- but it's probably even more true with pedagogical questions.

Though virtually every proposed educational innovation comes with language about treating students like individuals and recognizing different learning styles (until the phrases start to sound like the conditioned aphorisms of Brave, New World), it is simply the nature of general, top-down reforms to tend toward the Procrustean. Most start with good intentions, but the pressure to come up with something easily implemented and widely applicable (not to mention, pitchable), invariably undercuts those intentions and generally produces an overly simplistic, one-size-fits-all solution.

All of this tends to lead to those weird disconnects you often see in education reform debates where a group of people approvingly discuss proposals that are completely at odds with their owns experiences as students. This is never more true than when you look into the origins of the passions that drive the best work.

Good teachers try to cultivate and where possible leverage and concatenate enthusiasms. They understand that...

R.L. Stine can lead to Stephen King.

Stephen King can lead to H.P. Lovecraft.

Lovecraft can lead to Arthur Machen

Machen can lead to Ovid and Grimm and any number of wonderful  books on myth and folklore.

And, of course, myth and folklore can lead to pretty much any area of art or culture.

The trouble is, you really don't want to put R.L Stine in your standards. It's not an approach that would work for everybody and besides, he's not that good.

You do, however, want all of the students to have an RL Stine of their own. It could be JK Rowling (who is good). It could be comic books that lead to folklore through stories about Thor and Hercules. A collection of Star Trek books that lead to a career in physics or engineering (which has happened surprisingly often). A fascination with sports that leads to a career in statistics.

When you ask successful people how they got interested in their fields, most will tell stories that are variations on this theme. Paul Krugman, for example, first became intrigued with the underlying principles of economics when he read Isaac Asimov's Foundation trilogy.

The trouble is that this is what they call in ed schools divergent learning, every student is expected to a different outcome. Worse yet, it's doubly divergent. Not only are students reaching different destinations; they're getting there via different paths. Movement reformers favor standardization, test-driven metrics and top-down initiatives, and despite endless protests to the contrary, it is horribly difficult to foster the kind of learning I've just described using these approaches.

And national experiments

I strongly believe in being careful when generalizing the results from one country to another, particularly when those countries are as different as the US and Sweden. On the other hand, when considering radical shifts in national policy, you have to at least consider how well those policies have worked in other countries.

Somewhat surprisingly, Sweden is perhaps the best test we've had of the kind of privatization advocated by many in the education reform movement. As a result, the country's reforms were embraced by such unlikely supporters as the Heritage Foundation.

Here's a 2010 Foundation interview with Thomas Idergard, Program Director of Welfare and Reform Strategy Studies at Timbro, a "free-market think tank" based in Stockholm:

The Swedish school voucher program was introduced in 1992 by the then Center-Right government. First, the Social Democrats opposed the reform, but after having returned to power in 1994 they not only accepted it but also expanded the legislated compensation level of the voucher. Today there is almost a total national political consensus—with the one and only exception from the small Left (i.e., former Communist) Party—on the foundations of school choice in Sweden.

Since the 1970s, the Swedish school system had declined regarding quality and student attainment. One reason for this was the lack of choice. Only the very rich, who could afford private schools with private tuition fees on top of our very high taxes, had a right to choose. For all the rest, the school was one monolithic organization in which all students were considered to have the same needs and to learn the same way. The lack of choice created a lack of innovation regarding pedagogical concept and ways of learning adapted to different students’ needs. Public schools, run by politicians in the local branch of government (cities and municipalities), were all there was for 99 percent of all students.

The school voucher program was designed to create a market—with competition, entrepreneurship, and innovation—based on the Swedish and Scandinavian tradition of social justice and equality: All families should be able to choose between public and private schools regardless of their economic status or wealth. This equal opportunity philosophy, taken into its full potential, created an education market!

Since the calls for American reform are often based on low PISA scores and since a new round of scores have just been announced, it would be reasonable to check what has happened to Sweden's scores:

No other country has fallen so abruptly as Sweden in maths over a ten-year span. Overall, not one of the other 32 countries included in the OECD's Programme for International Student Assessment (Pisa) survey has seen its students take such a beating in their studies.

"The bleak picture has become bleaker with the Pisa review that was presented today," Anna Ekström, head of Sweden's National Education Agency (Skolverket), said after she became privy to the results. She had hoped for Sweden to finally buck the trend and stop declining in the ranking.

Sweden's schools now rank below both the United States and the UK according to the Pisa rankings.

I've never been a fan of using international test scores (even less so after this history lesson from Diane Ravitch), but if you are going to use such arguments they need to be what my business analyst friends call "directionally accurate." Recently we've seen a lot of arguments that don't clear that bar.

Natural Experiments

This was fascinating:

Their answer is yes: when urban life revived in the medieval period, French towns tended to be near old Roman centers, while British towns didn’t. And the British had the better of this deal, because optimal town locations in the Roman era — with good roads — weren’t the same as in the Middle Ages, when roads remained terrible but the technology of water transport had improved.

 Which says all sorts of things about how it might actually be possible to improve things in a rather dramatic way by asking some tough questions. 

How did we miss this?

It's terrifying when Brad DeLong is more on top of interesting stories on education than we are!  But this is from James Kwak: 

I have no problem with the premise: better teachers improve student outcomes, which is worth a lot of money. But do you see what’s going on? To get better teachers, the authors say, requires ”attracting more qualified people” and then “identifying and retaining” the most effective ones.

That just doesn’t follow. And anyone who’s worked in an actual company should realize that. Yes, it’s always better to have better workers. One way to get better workers is to hire more effective people and to fire less effective people. But the other way—which, in most industries, is by far more important—is to make your current workforce more effective. You do that in part by figuring out what attributes or processes make people more effective, and in part by training people and implementing processes in ways that improve productivity.

The idea that the only way to improve teacher effectiveness (remember, they said “requires”) is to increase quality at the front end and link retention to quality on the back end is the kind of illogical, impractical inference you draw if you have a certain type of attitude toward workers: the attitude that there’s only one abstract attribute that matters (quality) and that it’s intrinsic and unchanging. What’s surprising is that this is a non-obvious kind of fallacy: again, anyone who has run a business realizes that what matters more is what you do with the workforce you have.

I think that the whole idea of organizations like Teach for America falls into the trap above.  Focusing entirely on the recruitment and retention piece and not at all on the teacher development piece.  In some ways this seems to be a malaise of our age -- the want to have plug and play human resources instead of developing the work force with patience and practice. 

The conclusion is interesting as well:

But I also suspect that there’s a feeling, maybe not among these authors, but among the billionaires who like investing in education, of “if only more people like us became teachers”—that there are highly productive people and less productive people, and all we need is to adjust the incentives so more of the former go into teaching. I don’t think the world is that simple.

 That would also be a big issue with the whole inter-state competition piece.  If you think ability is an intrinsic quality (and a scalar) that is invariant between positions then this type of approach is very sensible.  Alternatively, if you want job insecurity to be high, using fear to motivate employees is actually surprisingly effective.

That would put reform into an awkward place, wouldn't it?

TFA Context -- one interesting table

On the heels of Gary Rubinstein's recent post on his first year in Teach for America (reviewed here) and this piece by Jennifer Berkshire on the generous contributions the organization gets from numerous corporate donors like FedEx and Subaru, and given TFA's way of popping up in various ed reform discussions, this seems like a good time to review some basic and uncontroversial facts about this very controversial subject.

Let's start with Wikipedia's introduction:

Teach For America (TFA) is an American non-profit organization whose mission is to "eliminate educational inequity by enlisting high-achieving recent college graduates and professionals to teach" for at least two years in low-income communities throughout the United States.

Of course, TFA does other things, but this is very much the persona-mission of the organization, so it's useful to evaluate the performance of TFA as a teacher recruiting organization. There is a great deal of disagreement over how to interpret the data on TFA members' effectiveness and retention, but some other aspects are much more clear-cut.

TFA is a small, expensive program.

More precisely, this was a very small and expensive program; it's become a merely small but very expensive one.

Year	# of Applicants	# of Incoming Corps Members	# of Regions	Operating Budget
2003	15,708	1,646	20	$29.8M
2004	13,378	1,626	22	$34.0M
2005	17,348	2,181	22	$38.4M
2006	18,968	2,464	25	$55.6M
2007	18,172	2,895	26	$77.9M
2008	24,718	3,614	29	$122.3M
2009	35,178	4,065	35	$153.4M
2010	46,359	4,493	40	$176.0M
2011	47,911	5,066	43	$229M
2012	48,442	5,800[21]	46	$244M
2013	57,000	6,000[22]	48

The cost per recruit has increased dramatically

In order for the TFA model to be scalable, the cost per recruit needs to drop sharply at some point. No sign of that yet.

There is reason to be concerned about selection effects

Actually, double selection effects. First there's self-selection. TFA is known for a daunting and highly selective application process that tends to attract high-achievers with solid resumes. Second, there's the process itself:

In 2010, 46,366 candidates applied and 5,827 were initially admitted, making the acceptance rate 12.6%. However, that number does not include those who earned eventual acceptance into the program from the waitlist of 932 candidates. If all on the waitlist were given acceptance, the acceptance rate would be 14.6%. Since some but not all were accepted from the waitlist, the exact 2010 acceptance rate is unknown, but it ranges from 12.6-14.6%. The acceptance rate for 2011 corps members was less than 11%

The result of all this is a tremendously unrepresentative sample of the pool of potential teachers. As a result, it's difficult to apply anything we learn from TFA data to general policy questions in education.

Equal enforcement of contracts?

Dean Baker is strident:

If the connection with AIG isn't immediately apparent, then you have to look a bit deeper. Folks may recall that AIG paid out $170m in bonuses to its employees in March 2009 with its top executives receiving bonuses in the hundreds of thousands of dollars.

These were people who not only shared responsibility for driving the company into bankruptcy; they also had been at the center of the financial web that propelled the housing bubble into ever more dangerous territory. In other words, the bonus beneficiaries were among the leading villains in the economic disaster that is still inflicting pain across the country.

The prospect of executives of a bailed out company drawing huge bonuses at a time when the economy was shedding 600,000 jobs a month provoked outrage across the country. President Obama spoke on the issue and said that unfortunately no one in his administration was smart enough to find a way that could keep the bonuses from being paid. The problem according to Larry Summers, then the head of President Obama's National Economic Council, was that the bonuses were contractual obligations and they had to be honored.

This provides a striking contrast to what might happen to current and former city employees in Chicago and may happen to current and former employers of the state of Illinois and Detroit. In these cases, it seems that the contracts workers had with their employers may not be honored. Employees who worked decades for these governments, with part of their pay taking the form of pensions in retirement, are now being told that these governments will not follow through on their end of the contract.

The differing treatment of contracts in these situations is striking for several reasons. First, the AIG executives stood to gain much more money with their bonuses on a per person basis. In contrast to the six-figure bonuses going to top executives, pensions for Detroit's workers average just $18,500 a year. Pensions for Chicago's workers average over $33,000 a year, but almost none of these workers will get Social Security, so this will be their whole retirement income.

I am not as upset at the difference in size of the individual compensation, the difference in liability for global economic problems, or the asymmetry in harm -- these points are decent but they are secondary to the key argument.  The real issue is whether the need to honor contracts is being applied equally.  And, it is true that bailing out pensioners has a serious element of moral hazard.  But it would be intriguing to see the argument for bank bailouts NOT having at least some element of moral hazard.   

The real question is what is the status of contracts as being fundamental; the ability to amend a long term agreement when the terms work out in somebody else's favor would really change the dynamics of our ability to run a modern economy.  Remember, it is a small walk from this to deciding not to pay for materials that have been purchased because your business plan did not work . . .

Non-linear relation of the day

There is a modern ethic that more and harder work is always an unbounded good.  But this perspective piece argues that too much pressure can actually reduce outcomes:

When knowledge workers are pressed too hard, the intimate connection between workers and their work is compromised and many things go wrong. Stress and anxiety harm mental health and, hence, performance. Competition rises and team cohesion—a major source of productivity gains—declines. Animosity may develop among staff, or between staff (who feel exploited) and management. Overworked workers take on extra tasks and pay a task-switching productivity penalty that DeMarco estimates at 15%, minimum. And it isn't just average productivity that declines; it is also peak productivity, those rare moments of transcendence when important breakthroughs are made.

Simply assuming a linear relation between effort and output seems like a dangerous assumption, and one that leads to bad policy.  It's also worth noting that we'd prefer to be on the other side of the productivity/pressure curve if we wanted to accept this lower productivity -- happy, unstressed workers tend to be easily retained by an employer.  But unhappy/stressed workers and low productivity seems like a bad trade. 

h/t: Mike

Good reporting alert

From the Seattle Times:

But what’s remarkable is the degree Boeing also wants the public to pay its basic costs. Including, it said, “acquiring site, constructing facility, building infrastructure and procuring equipment/tooling.”

That’s right — we are to buy the land, the factories and the machines that go inside, or at least a share of them. And give it all to Boeing, or let them use it rent-free.

“Company preference is toward a location that will share in the cost of all capital expenditures,” Boeing wrote.

Now that’s socialism. It’s the corporate variety, and it isn’t all bad, what with the good-paying jobs and boost to the local economy. But having the public buy the means of production — socializing the capitalists’ risks (though definitely not their profits) — is a far cry from free enterprise. Almost as far, in a different direction, as what the socialist was going on about.

I think that this point is right on.  It is one thing to ask for tax relief or talk about infrastructure, but when the company is asking the state to build the means of production then it really is socialism.  Whether these profits go to a corrupt apparatchik or to the management of a publicly traded corporation is irrelevant.  What is important is that nobody can realistically compete with the state.  So this type of behavior gives a subsidy to some folks, and prevent entry into the market by competitors with fewer political connections.  

Food for thought, really.  

An extraordinary post by Gary Rubinstein on his first year of teaching

If you're just joining us, Gary Rubinstein is a distinguished math teacher and education writer. He's also, as you'll see, both an alumni and a sharp critic of Teach for America. In this post, he takes a remarkably hard and honest look back at his first year of teaching.

This kind of walk down memory  is not something I'd like to do. My first year appears to have gone a little smoother than his did (at least none of the students hit me), but it was still highly stressful and I still have to live with the knowledge that a lot of kids learned less than they should have because their teacher was just beginning to figure out what he was doing.

The whole piece rings exceptionally true and I recommend reading it in its entirety  but there are a few secondary points I'd like to highlight because they fit in with some of the ongoing threads on our blog.

1. Under the circumstances,  a $5,000 recruitment fee seems high. It's been a few years since I was in the field, but back then applicants were expected to shoulder all of their own expenses (the best I ever got out of the deal was the very occasional  free lunch) and it's a lot easier for schools to find qualified applicants than it was twenty years ago.  It should also noted that some of the schools that pay significant fees to schools in areas that have a large surplus of qualified and experienced teachers, perhaps the most egregious example being Huntville, a major aeronautics research center (hence the nickname 'Rocket City') that gets dozens of qualified applicants for every teaching position. (For a bit of context, the organization had a 2012 operating budget of $244M and put out 5,800 new corps members.);

2. You have to have a thick skin to teach junior high and high school. Kids can be cruel, but more to the point, they are going through an incredibly intense, confusing and stressful period and, as a characteristic of their age, they have a natural proclivity for misplaced emotions. Combine that with an instinctive need to test boundaries and you are left with a room filled with people who will make your life miserable if you let them. With time, you learn how respond without letting them feel they've pushed your buttons and, ironically, in the long run they'll be happier having failed. When you're just starting out, though, you might as well be prepared.

3. I realize I've been spending a lot of time on the culture of the ed reform movement lately, but I don't think you can fully understand what's been going on in the education debate without understanding that culture. TFA is a big part of that picture. Reading accounts of TFA alumni, I'm always struck by what an intense bonding experience the training and first two years would have been. Even though Rubinstein may not have been the best fit with TFA, he still says half the people he invited to his wedding were fellow core members.
Add to that official rhetoric that creates distance between TFA members and established traditional teachers, and you can see why compromise and self-policing might be difficult for the movement they largely define and why the movement is so quick to converge on certain sometimes unusual positions like pedagogical theories that seem to owe more to Derrida than to Piaget.

4. Putting aside those occasional unusual positions, whenever I read accounts of the training material, there's generally an odd disconnect. Most of what I hear is relatively familiar, pretty much in line with what you'd hear in a typical education class, but it's usually described as something special, perhaps even unique to TFA (apparently trainees sometimes also pick up on these discrepancies -- check out what this writer had to say about these “uncommon techniques”). Apparently, assertive discipline* is another one of those overlaps between TFA and lots of traditional educators. I used the technique for a year when I first started teaching twenty-plus years ago (then dropped it like a fresh horseshoe). It was a hot trend and its proponents assured all the new teachers that it was almost completely effective if done according to the instructions. In practice, most new teachers seemed to get results closer to Rubinstein's.

Here are some excerpts:

Nowadays, districts pay a $5,000 recruitment fee to TFA for the opportunity to hire the new TFA trainees.  I don’t know if back then TFA got any money for me.  I hope they didn’t.  At my school that year there were about 150 teachers.  Three of us were new, me, Jon, and Mitzi, all TFA.  I don’t know who the school would have hired if not for us, so it is hard to say whether or not we were a positive or negative influence on the school compared to what it would be without us.  Though that year did nearly break me, and wasn’t so kind to Mitzi or Jon either, I’ve always felt that, in the scheme of things, we didn’t do ‘damage’ to our students.  One reason for this was that we taught middle school so I was just one out of seven teachers my students had each day.  The other six teachers knew what they were doing so in some ways my class became an opportunity for students to try to learn self-control since the teacher wasn’t doing a very good job at creating a controlled learning environment.
...
But having lived through the TFA experience and having many TFA alumni who are close friends of mine — I think half of the friends I invited to my wedding were people I met through TFA — I do know that there is a big difference between ‘the organization’ which is a greedy and power hungry one that will lie about their statistics when it benefits themselves to do so and ‘the corps,’ the mostly twenty-two year olds who just graduated college and who try to use whatever skills they have along with their very limited training to get through that first year and try to still make some kind of difference.  And while I am sure that TFA, the organization, at least in its current incarnation, harms children, teachers, and communities, overall, I do think that most of the individual teachers don’t.
...
Mr. Popcorn Pinnochio Afro Rubinstein is one of the meaner nicknames I’ve been called as a teacher.  (The Pinnochio is because of the size of my nose, and not, I think, because they thought I was a liar).  Better nicknames have been Mr. Frankenstein and even Mr. Robitussin.  As can be seen in the picture, till the end I had faith in the TFA endorsed ‘Assertive Discipline’ method of writing names on the board and putting checks next to them.  Still, you either have to hate a guy a lot to make a picture like this, or maybe like them a little.

* I later learned that assertive discipline was recent variant of the far older Rumplesnitz Method of crisis management.

Weekend blogging -- auteur edition

I've always wondered why, despite Orson Welles reputation, his films were so difficult to find. Here's one of the few exceptions.

Comment on last post

Blogger ate another comment so I am going to put it out as a post.

Mark wonders why a movement with smart people and admirable goals can have issues with corruption.  I think that the key piece to understand here is that, in a real organization, the goals will be a mix of real goals and marketing. 

You only have to look at the rhetoric of he top 1% of earners being job creators (remember trickle down economics) to see how this can happen.  After all, the goal of making everyone wealthier and more prosperous is noble.  But it is a "heads I win, tails you lose" scenario.  If trickle down happens the elite get more money.  If it doesn't happen the elite get more money.  It's worth noting that the elite do pretty well regardless of what the truth is.

Similarly, if charter schools improve outcomes for all children than the people who run charter schools will get rich and help kids.  If they fail, these same people will simply get rich (as we won't be able to see failure fast enough to prevent vast profits.  Now I am positive that 100% of these people want the first scenario.  Everybody would like to be wealthy and to be a moral hero at the same time. 

It gets tricky when these goals conflict.  These things range from the subtle (that one study is concerning but maybe it was a fluke) to the less so (this stuff is great marketing and provides cover for all sorts of actions).  It isn't helped by our media preference for news about problems and not news about "another senior class graduates from a public school with a solid education provided by hard working union members" -- which is anodyne and unremarkable news.

So I think that option #5 (it is all marketing) should show up.  It's a variation of #3, except it does not necessarily require the people saying this stuff to necessarily believe it. 

"Carerruption" -- the biggest threat to the education reform movement

The following is the beginning of a blistering piece of satire over at EduShyster:

How can something so wrong feel so righteous? 

For far too long, three little words have been holding back the adult interests that long to put students first. What are they you ask? The teachers union conflict of interest laws. Thankfully these outdated and antiquated restrictions are now out of sight and out of mind where they belong. And while haters like you are already mumbling about ethics, may I take this opportunity to remind you that it isn’t corruption if you do it for the right reasons? I believe the word is *carerruption*

From there the blogger, Jennifer Berkshire, proceeds to list a few select examples of questionable education reform initiatives (totaling in the billions) pushed or brokered by officials who personally stood to profit from the enterprises. It's a great read but it leaves what might be the most important question unasked: why is a movement dedicated to such admirable goals and run by such smart people so vulnerable to blatant scams and rampant corruption?

I'll be filling out more details, but these are the bare bones of my attempt at an explanation.

1. Group dynamics -- given the scope, size and influence of the movement, we are talking about a surprisingly tight-knit, highly interconnected group. Add to that a relatively high level of homogeneity in terms of background, education, class, teaching experience and pedagogical philosophy. Under these conditions we would expect a tendency toward group-think, excessive social norming, powerful group identity, and us vs. them attitudes. We would also expect affinity cons.

2. Culture -- those us/them tendencies are greatly heightened by a dogma that implicitly and sometimes explicitly blames the failures of schools on "some combination of apathy or incompetence" on the part of non-movement educators. You can find many more examples on Gary Rubinstein's blog.

3. Spin feedback -- the reform movement has been extraordinarily aggressive in its well-financed lobbying and PR efforts. For a while, it was quite successful at selling the twin narrative of impending disaster and shining hope. We've since seen growing popular skepticism about this narrative but very little of that skepticism seems to have made it into the movement itself. Unfortunately, if perhaps inevitably, the rhetoric intended to convince the rest of the world is most resonant within the group.

4. Lack of immediate external checks -- the press has tended to be sympathetic and has generally held off from criticizing until there was overwhelming evidence that something was wrong (Michelle Rhee, the LA IPad fiasco).

The result of all of this is a movement that has no natural defenses against internal abuses, and, given the amount of money we're talking about, abuse is pretty much inevitable.

Update: If you're coming in via link, make sure to check out Joseph's reply.

"But the Pension Fund Was Just Sitting There"

For some reason I started thinking about the title of this old Doonesbury book. Funny how the mind works.

On a completely unrelated note, David Sirota has a fascinating article on Detroit's financial troubles. As our favorite auteurist used to say, check it out.