Statistics vs truthiness

I thoroughly enjoyed reading Howard Wainer’s Truth or Truthiness: Distinguishing Fact From Fiction By Learning to Think Like a Data Scientist. I even laughed out loud occasionally, as there’s a lot of wit on display here, and one gets a strong sense of Wainer’s personality. This is not usual in a book about statistics (although having said that, Angrist and Pischke also do quite well on the clarity and fun front, especially for econometricians.)

Truth or Truthiness a collection of essays in effect, published as a response to this brave new world of truthiness (ie. lies that people believe because they want to) in politics and public debate. Wainer writes very clearly about statistics in general, and his main theme here, causal inference. This is of course dear to the heart of economists, and gratifyingly Wainer recognises that the profession is more scrupulous than most disciplines about causation. The book starts by underlining the importance of having a clear counterfactual in mind and thinking – thinking! – about how it might be possible to estimate the size of any causal effect. As Wainer puts it, “The real world is hopelessly multivariate,” so untangling the causality is never going to happen without careful thought.

I also discovered that one aspect of something that’s bugged me since my thesis days – when I started disaggregating macro data – namely the pitfalls of aggregation, has a name elsewhere in the scholarly forest: “The ecological fallacy, in which apparent structure exists in grouped (eg average) data that disappaears or even reverses on the individual level.” It seems it’s a commonplace in statistics – here’s one clear explanation I found. Actually, I think the aggregation issues are more extensive in economics; for example I once heard Dave Giles do a brilliant lecture on how time aggregation can lead to spurious autocorrelation results.

Having said how much I enjoyed reading Truth or Truthiness, I’m not sure who it’s aimed at who isn’t already really interested in statistics. For newcomers to Wainer, I’d recommend his wonderful earlier books, Picturing the Uncertain World, and Graphical Discovery. They’re up there with Edward Tufte’s books on intelligent visualisation (rather than the decorative visualisation that’s become unfortunately common).

51ZBzzdWQwL

The polarised republic

Cass Sunstein’s #Republic: Divided Democracy in the Age of Social Media is very timely, as we all, horrified, watch the American republic splinter ever more irreparably since the election last November. The book links the literature on filter bubbles and social media dynamics with the actual political impact in the US context, and the constitutional implications.

It cites the growing empirical literature on political polarisation as a result of the spread and increasing use of social media, especially Facebook. (Of course, conventional media have contributed to the polarisation as well – there are some empirical studies such as this one.) Some of the figures Sunstein cites are startling, such as the polling showing that both Republicans and Democrats have growing increasingly likely to express “displeasure” if their child were to marry someone with the opposite political affiliation (49% and 33% respectively in 2010, up from 5% and 4% in 1960, presumably higher still now). This far exceeds the “displeasure” expressed about inter-racial relationships.

Much of the book concerns the scope for deliberative democracy, or getting people to talk to each other and talk through problems. Technology could in principle enable this, although it currently does the opposite. At the same time, the other occasions on which we would all ‘meet’ different kinds of people, from different classes and races, and different opinions, have shrunk. There is more social sorting in real life. The conventional broadcast media are being displaced, and narrower themselves. (Not to mention now being under attack by Trump and Bannon.) Sunstein isn’t too starry eyed about democracy, though: “For many political questions, what matters is getting the facts straight, and for that you need experts, not deliberative opinion polls.” Hooray!

Communications and the media are exceptionally important in a democracy (cf Amartya Sen) and are at the epicentre of the current maelstrom of populism. I was interested in Sunstein’s emphasis on the importance of media ‘solidarity goods’, a special form of merit good that promotes social interaction, debate, understanding, a sense of shared citizenship and solidarity. He suggests solidarity goods are essential to build social capital.

The book resists the temptation to offer quick fixes – there aren’t any. Instead it underlines the priciples of any measures that might make things better: exposing people to material and ideas they wouldn’t otherwise choose or experience; ensuring citizens have a range of common experiences; ensuring policy debates have substance – ‘expertise’. It’s clear to me there are some sharp questions about the regulatory framework governing social media and the online world in general, questions regulators have been pretty keen to avoid so far. It’s time for them to do so now.

Untitled

Markets, states and humans

I was eager to read Paul De Grauwe’s The Limits of the Market because I profoundly agree with its premise that the false dichotomy between ‘the state’ and ‘the market’ has led to bad public policies and lower social welfare. The book is a short overview of the flaws of this dichotomous view of the world. It organises its discussion around two sets of reasons why a ‘free market’ is a meaningless abstraction: externalities and ‘internalities’.

The idea of an externality is familiar of course – that individual choices by a person or business have consequences, good or bad, for others. Once you start thinking about it, you realise externalities are pervasive. Indeed, they include many not acknowledged in standard economic theory which assumes fixed preferences, when of course preferences are socially determined. As De Grauwe points out, it is not easy to address externalities with government policies (not that this means there’s no point in trying): “The market fails in the face of externalities. When this happens, the government must step in. However …. that is also the moment at which the discrepancy between individual and collective interest is widest.”

The word ‘internality’ is new to me – though this is the second time I’ve come across it used by a Francophone author. It refers to the capacity humans have to make decisions that damage their ‘rational’ self-interest. I would think of this as a failure of one of the other assumptions of standard welfare economics, namely individual utility maximisation. The book makes use of Daniel Kahneman’s distinction between System I thinking (emotion, instinct) and System II (reasoned calculation). Market outcomes that satisfy the latter can adversely affect – say – our fairness instinct. “This dissatisfaction creates an opportunity for governments to fill the emotional gap left by the free market and to focus on System I, which steers our emotions. Many emotions find an outlet through government.” Well, most people probably have rather negative feelings about government, but one sees what he means.

The book is an extended reflection on this dual set of market failures, and the inevitable involvement of both (coercive) government actions and individual choices in the economy. I ended up being a bit disappointed, as it does fall between the two stools of accessibility for the general readership and technical rigour for professional economists, so I didn’t feel I got tremendous new insights. It’s also expensive for a very short book (£25 for 160 pages), albeit not in stupid academic book price territory. Still, the framework set out for thinking about the roles of government and market is neat, and I’ll recommend it to students who are particularly interested in the welfare economics but won’t want anything technical.

Practical social welfare

I just finished (re-)reading Amartya Sen’s Collective Choice and Social Welfare. The parenthesis isn’t because I can’t remember but because the original 1970 book has been republished with a chunky new section. It isn’t an easy read, even with the corralling of the technical proofs into alternate, starred chapters. Sen addresses the dilemma raised by Arrow’s impossibility theorem and the wider family of impossibility results, which state that a few totally reasonable-seeming assumptions about principles of social choice end up with no decision rule able to satisfy them. The technical language is that between them the assumptions – transitivity, independence of irrelevant alternatives, unrestricted domain, the Pareto (or unanimity) principle, and non-dictatorship – leave a null set. I’ve always thought of it in the shorthand of there being unavoidable conflicts/trade-offs/dilemmas in social choice. Sen shows that for many social choice questions, the assumptions are too restrictive. ‘Unrestricted domain’ means throwing away relevant information; the Pareto condition forbids interpersonal comparisons such as between the rich and the poor. He argues that welfare economics has been impoverished by the Lional Robbins diktat that interpersonal comparisons could not be permitted: it is bizarre that the subject has had so little to say about the distribution of resources and incomes, self-hamstrung for decades.

The additional chapters extend the original and present in a more rigorous manner some of the material in Sen’s The Idea of Justice. There’s a timely chapter on democracy: “Given the mixed bag of results that we can actually get from majoritarian democracy, its defence, important as it is, needs to be seriously supplmented by probing scrutiny of its limits and conditionality.” This written after last November’s US Presidential election.

Not a book for the general reader – The Idea of Justice is a better presentation of Sen’s important work for that audience. But economists should have read Collective Choice and Social Welfare, especially those working on or in public policy. For all its logical abstractions, this is a very practical book.818GkIguxCL

Economy and society

It’s fair to say the average economist doesn’t pay much attention to sociologists, but to the extent that (s)he does, Mark Granovetter will be a familiar name. His concept of the distinct roles of ‘strong’ and ‘weak’ ties has become widely-cited in the economics literature. Now Granovetter, a Professor of Sociology at Stanford, has published a new book – intended as the first of two volumes – aiming at a synthesis of his views on how the economy and society are enmeshed with each other (it’s out in 2 weeks, can be pre-ordered now)

. Society and Economy: Framework and Principles, sets out at a high level of abstraction definitions and relationships between concepts such as trust, power, norms, values, as they relate to economic decisions and actions.

The book starts out by quite fairly skewering the ‘Just So’ character of some economists’ uses of sociological concepts to explain how economic norms or institutions have come about. The book suggests that if economics wants to use a concept such as ‘social norm’, then it must engage with questions of how norms come about, which will involve cognition and emotion and social relations. Economics has of course started to dabble in psychology with the ‘behavioural’ revolution, but in the limited sense of simply noting behavioural regularities. Here Granovetter echoes Daniel Hausman (Preference, Value, Choice and Welfare) in arguing that it “does not seem a good recipe for scientific progress” to claim that how people reach economic decisions, or how groups settle on social norms, is simply outside the domain of economics.

If this seems a bit high-fallutin, just consider how much influence social norms have on outcomes. In the 1970s, for corporate executives to pay themselves many hundreds of times what they paid their average employee lay outside the ‘moral economy’ of the times; within a generation that norm had shifted entirely. Surely it is important for economists to understand how that came about?

The book has a particularly interesting chapter on trust, which notes that the outcome of trusting behaviour can arise for different reasons. Granovetter argues that many researchers define trust narrowly to be trust due to their favourite reason, whether that’s an internal psychological state, or an expectation of reciprocal behaviour, or risk-taking with regard to others’ behaviour for some expected benefit.

The promised second volume will apply the concepts defined and analysed in this first volume to specific topics such as corporate governance, organisational forms, and corruption. That’s something to look forward to – this first volume is pretty abstract as it concerns definitions and methodological debates in the literature. Still, the challenge to economists is a fair one, I think. We don’t all have to become competent psychologists or sociologists, but I agree that somehow economics does have to take up the methodological challenge of making sure our borrowing of concepts such as trust or norms is meaningful.

61q4jTlHGyL