With Help From Some Friends

Jul 24, 2014 by

Jay P. Greene – I’ve written several times before about education policy analysts who confuse the constant sound of their own voice for actual influence over policy. There are many faux education experts who have never really done anything or studied anything that would support their self-proclaimed status as experts. And the foundations that fund them are making a foolish mistake in thinking that the non-stop chattering of these faux experts actually influences anybody. Education policymaking is a long game that requires investment in serious inquiry. Solid evidence, not an insular circle of blabbering, moves the elite consensus and creates the conditions for enduring policy changes.

The problem is that not only are foundations remarkably under-funding serious inquiry, but the academics who should be engaging in that research are increasingly drawn to the siren’s call of policy influence. Yes, it is a proper goal of policy research to have influence, but that influence is the end-product of serious work, not the thing for which the quality of one’s work and intellectual standards should be sacrificed.

The latest example of academics attempting to trade their integrity for influence can be found in Ray Fisman’s Slate article on vouchers in Sweden. Fisman is a Harvard-trained economist who has rapidly risen to a named professorship at Columbia University’s business school. He rose so rapidly because he has done some excellent work published in leading journals.

But even highly capable scholars have difficulty resisting the temptation to abandon their standards for their imagined ability to influence policy. So, Fisman has also become a columnist for Slate. His columns are nothing like his scholarship. In particular, his recent piece on vouchers in Sweden was filled with glaring errors of fact as well as obvious flaws in causal reasoning. Andrew Coulson has an excellent take-down of Fisman’s piece over at Education Next. You should read Andrew’s entire piece, but some highlights of Fisman’s sloppiness include:

Fisman claims “more Swedish students go to privately run (and mostly for-profit) schools than in any other developed country on earth.” In fact, only about 14% of Sweden’s students attend private schools, significantly less than the 68% in Belgium as well as higher numbers in a host of other developed countries.

Fisman’s only “evidence” that vouchers have harmed achievement in Sweden is that PISA scores have dropped in that country over the last decade. The Razorback football program has also gotten a lot worse over the last decade. By Fisman’s causal reasoning, perhaps Swedish vouchers are responsible for my poorly performing Hogs. This is the type of mis-NAEP-ery we expect of Marc Tucker or Diane Ravitch, not a Harvard-trained economist in a named professorship at Columbia.

Fisman would never make such sloppy mistakes in a journal submission or conference presentation. His colleagues would laugh at him. But nothing seems to deter Fisman or other would-be Paul Krugmans from making laughable claims in the popular press. Maybe academics should not be given such a free pass for whatever they write outside of journals. Maybe the credibility of their scholarly work and their status within the academic community should also be called into question if they are willing to be so reckless.

Look, I know from personal experience the lure of policy influence. I’ve been in the think-tank world and taken part in the silly collection of “metrics” of influence to get foundation funding. And I’ve felt the temptation to claim expertise in areas beyond my scholarship. But we all have to resist these temptations if we are to maintain the standards of academic work. We need to maintain those standards so that research can remain credible and be the source of true, long-run policy influence.

via Jay P. Greene’s Blog | With Help From Some Friends.

Print Friendly, PDF & Email

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.