REU Redux: Allais All Over Again

September 26, 2017

This post is coauthored with Johanna Thoma and cross-posted at Jonathan Weisberg’s personal blog. Accompanying Mathematica code is available on GitHub.

Lara Buchak’s Risk & Rationality advertises REU theory as able to recover the modal preferences in the Allais paradox. In our commentary we challenged this claim. We pointed out that REU theory is strictly “grand-world”, and in the grand-world setting it actually struggles with the Allais preferences.

To demonstrate, we constructed a grand-world model of the Allais problem. We replaced each small-world outcome with a normal distribution whose mean matches its utility, and whose height corresponds to its probability.

Take for example the Allais gamble:

($0, .01; $1M, .89; $5M, .1).

If we adopt Risk & Rationality‘s utility assignments:

u($0)=0, u($1M)=1, u($5M)=2,

we can depict the small-world version of this gamble:

fig1

On our grand-world model this becomes:

fig2

And REU theory fails to predict the usual Allais preferences on this model, provided the normal distributions used are minimally spread out.

If we squeeze the normal distributions tight enough, the grand-world problem collapses into the small-world problem, and REU theory can recover the Allais preferences. But, we showed, they’d have to be squeezed absurdly tight. A small standard deviation like σ = .1 lets REU theory recover the Allais preferences.1 But it also requires outlandish certainty that a windfall of $1M will lead to a better life than the one you’d expect to lead without it. The probability of a life of utility at most 0, despite winning $1M, would have to be smaller than 1 × 10−23.2 Yet the chances are massively greater than that of suffering life-ruining tragedy (illness, financial ruin… Game of Thrones ending happily ever after, etc.).

In response Buchak offers two replies. The first is a technical maneuver, adjusting the model parameters. The second is more philosophical, adjusting the target interpretation of the Allais paradox instead.

First Reply

Buchak’s first reply tweaks our model in two ways. First, the mean utility of winning $5M is shifted from 2 down to 1.3. Second, all normal distributions are skewed by a factor of 5 (positive 5 for utility 0, negative otherwise). So, for example, the Allais gamble pictured above becomes:

fig3

We’ll focus on the second tweak here, the introduction of skew. It rests on a technical error, as we’ll show momentarily. But it also wants for motivation.

Motivational Problems

Why should the grand-world model be skewed? And why in this particular way? Buchak writes:

[…] receiving $1M makes the worst possibilities much less likely. Receiving $1M provides security in the sense of making the probability associated with lower utility values smaller and smaller. The utility of $1M is concentrated around a high mean with a long tail to the left: things likely will be great, though there is some small and diminishing chance they will be fine but not great. Similarly, the utility of $0 is concentrated around a low mean with a long tail to the right: things likely will be fine but not great, though there is some small and diminishing chance they will be great. In other words, $1M (and $5M) is a gamble with negative skew, and $0 is a gamble with positive skew […] (p. 2401)

But this passage never actually identifies any asymmetry in the phenomena we’re modeling. True, “receiving $1M makes the worst possibilities much less likely”, but it also makes the best possibilities much more likely. Likewise, “[r]eceiving $1M provides security in the sense of making the probability associated with lower utility values smaller and smaller.” But $1M also makes the probability associated with higher utility values larger. And so on.

The tendencies of large winnings to control bad outcomes and promote good outcomes was already captured in the original model. A normal distribution centered on utility 1 already admits “some small and diminishing chance that [things] will be fine but not great.” It just also admits some small chance that things will be much better than great, since it’s symmetric around utility 1. To motivate the skewed model, we’d need some reason to think this symmetry should not hold. But none has been given.

Technical Difficulties

Motivation aside, there is a technical fault in the skewed model.

Introducing skew is supposed to make room for a reasonably large standard deviation while still recovering the Allais preferences. Buchak advertises a standard deviation3 of σ = .17 for the skewed model, but the true value is actually .106—essentially the same as the .1 value Buchak concedes is implausibly small, and seeks to avoid by introducing skew.4

Where does the .17 figure come from then? It’s the scale parameter of the skew normal distribution, often denoted ω. For an ordinary normal distribution, the scale ω famously coincides with the standard deviation σ, and so we write σ for both. But when we skew a normal distribution, we tighten it, shrinking the standard deviation:

fig4

The distributions in this figure share the same scale parameter (.17) but the skewed one (yellow) is much narrower.5

Unfortunately, Mathematica uses σ for the scale parameter even in skewed normal distributions, giving the misleading impression that it’s still the standard deviation.

What really matters, of course, isn’t the value of the standard deviation itself, but the probabilities that result from whatever parameters we choose. And Buchak argues that her model avoids the implausible probabilities we cited in the introduction. How can this be?

Buchak says that the skewed model has “more overlap in the utility that $0 and $1M might deliver”:

[…] there is a 0.003 probability that the $0 gamble will deliver more than 0.5 utils, and a 0.003 probability that the $1M gamble will deliver less than 0.5 utils. (p. 2402)

But this “overlap” was never the problematic quantity. The problem was, rather, that a small standard deviation like .1 requires you to think it less than 1 × 10−23 likely you will end up with a life no better than 0 utils, despite a $1M windfall.

On Buchak’s model this probability is still absurdly small: 4 × 10−9.6 This is a considerable improvement over 1 × 10−23, but it’s still not plausible. For example, it’s almost 300, 000 times more likely that one author of this post (Jonathan Weisberg) will die in the coming year at the ripe old age of 39.

But worst of all, any improvement here comes at an impossible price: ludicrously low probabilities on the other side. For example, the probability that the life you’ll lead with $1M will end up as good as the one you’d expect with $5M is so small that Mathematica can’t distinguish it from zero.7 So the problem is actually worse than before, not better.

Second Reply

Buchak’s second reply is that it wouldn’t in fact be a problem if REU theory could only recover the Allais preferences in a small-world setting. We should think of the Allais problem as a thought experiment: it asks us to abstract away from anything but the immediate rewards mentioned in the problem, and to think of the monetary rewards as stand-ins for things that are valuable for their own sakes.

What Risk & Rationality showed, according to Buchak, is that REU theory can accommodate people’s intuitions regarding such a small-world thought experiment. And this is a success, because this establishes that the theory can accommodate a certain kind of reasoning that we all engage in. Buchak moreover concedes that it may well be a mistake for agents to think of the choices they actually face in small-world terms. But she claims this is no problem for her theory:

[I]f people ‘really’ face the simple choices, then their reasoning is correct and REU captures it. If people ‘really’ face the complex choices, then the reasoning in favor of their preferences is misapplied, and REU does not capture their preferences. Either way, the point still stands: REU-maximization rationalizes and formally reconstructs a certain kind of intuitive reasoning, as seen through REU theory’s ability to capture preferences over highly idealized gambles to which this reasoning is relevant. (p. 2403)

But there isn’t actually an ‘if’ here. People do really face ‘complex’ choices as we tried to model them. Any reward from an isolated gamble an agent faces in her life really should itself be thought of as a gamble. This is not only true when the potential reward is something like money, which is only a means to something else. Even if the good in question is ‘ultimate’, it just adds to the larger gamble of the agent’s life she is yet to face. She might win a beautiful holiday, but she will still face 20 micromorts per day for the rest of her life (24 if she moves from Canada to England). Even on our deathbeds, we are unsure about how a lot of things we care about will play out. REU theory makes this background risk relevant to the evaluation of any individual gamble.

So Buchak’s response really comes to this: REU theory captures a kind of intuitive reasoning that we employ in highly idealized decision contexts, but which would be misapplied in any actual decisions agents face in their lives. This raises two questions:

    1. Why should we care about accommodating reasoning in highly idealized decision contexts?

      The original project of Risk & Rationality was to rationally accommodate the ordinary decision-maker. But now what we are rationally accommodating are at best her responses to thought experiments that are very far removed from her real life, namely thought experiments that ask her to imagine that she faces no other risk in her life. If our model is right, then REU theory still has to declare her irrational if she acts in real life as she would in the thought experiment—as presumably ordinary decision-makers do. And then we haven’t done very much to rationally accommodate her. At best, we have provided an error theory to explain her ordinary behaviour: her mistake is to treat grand-world problems like small-world problems. This is, of course, a different project than the one Risk & Rationality originally embarked on. As an error theory, REU theory will have to compete with other theories of choice under uncertainty that were never meant to be theories of rationality, such as prospect theory. Moreover, there is still another open question.

    2. Why should agents have developed a knack for the reasoning displayed in the Allais problem if it is never actually rational to use it?

      As a heuristic to try and approximate the behaviour of a perfectly rational system, at least in the Allais example, agents would do better to maximize expected utility—which is also easier to compute. Moreover, the burden of proof is on proponents of REU theory to show that there are any grand-world decisions commonly faced by real agents where REU theory comes to a significantly different assessment than expected utility theory. Unless they can show this, expected utility theory comes out as the better heuristic more generally. It is then quite mysterious what explains our supposed employment of REU-style reasoning. Why should irrational agents, who employ it more generally, have developed a bad heuristic? And why should rational agents, who never use it in real life, develop a tendency to employ it exclusively in highly idealized thought experiments?

Ultimately, if Buchak’s first reply fails, and all we can rely on is her second reply, Risk & Rationality provides us with no reason to abandon expected utility theory as our best theory of rational choice under uncertainty in actual choice scenarios. Even if we grant that REU theory is a better theory of rational choice in hypothetical scenarios we never face, this is a much less exciting result than the one Risk & Rationality advertised.


  1. Though we need a slightly more severe risk function than that used in Risk & Rationality: r(p)=p2.05 instead of r(p)=p2. See our original commentary for details.
  2. To get this figure we calculate the cumulative density, at zero, of the normal distribution 𝒩(1, .1). Using Mathematica:
    CDF[NormalDistribution[1, .1], 0]
    7.61985 × 10^-24

  3. This is the “variance” in Buchak’s terminology, but we’ll continue to use “standard deviation” here for consistency with our previous discussion and the preferred nomenclature.
  4. In Mathematica:
    StandardDeviation[SkewNormalDistribution[1, .17, -5]]
    0.105874

  5. Skewing also shifts the mean, we should note.
  6. In Mathematica:
    CDF[SkewNormalDistribution[1, .17, -5], 0]
    4.04475 × 10^-9

  7. Here we calculate the complement of the cumulative density, at 1.3, of the skew normal distribution with location 1, scale .17, and skew −5. In Mathematica:
    1 - CDF[SkewNormalDistribution[1, .17, -5], 1.3]
    0.

    Note that Mathematica can estimate this value at the nearby point 1.25, which gives us an upper bound of about 7 × 10−16:

    1 - CDF[SkewNormalDistribution[1, .17, -5], 1.25]
    6.66134 × 10^-16

    For comparison, this probability was about .0013 with no skew and σ = .1:

    1 - CDF[NormalDistribution[1, .1], 1.3]
    0.0013499

Advertisements

Assistant Professorship at the MCMP

October 27, 2016

Ludwig-Maximilians-University Munich is seeking applications for one

Assistant Professorship position in Logic and Philosophy of Language

(for three years, with the possibility of extension)

at the Chair of Logic and Philosophy of Language (Professor Hannes Leitgeb) and the Munich Center for Mathematical Philosophy (MCMP) at the Faculty of Philosophy, Philosophy of Science, and Study of Religion. The position, which is to start on April 1st 2017, is for three years with the possibility of extension.

The appointee will be expected (i) to do philosophical research, especially in logic and philosophy of language, (ii) to teach five hours a week in areas relevant to the chair, and (iii) to participate in the administrative work of the MCMP.

The successful candidate will have a PhD in philosophy or logic, will have teaching experience in philosophy and logic, and will have carried out research in logic and related areas (such as philosophy of logic, philosophy of language, philosophy of mathematics, formal epistemology).

Women are currently underrepresented in the Faculty, therefore we particularly welcome applications for this post from suitably qualified female candidates. Furthermore, given equal qualification, severely physically challenged individuals will be preferred.

Applications (including CV, certificates, list of publications), a description of planned research projects (1000-1500 words), and letters of reference of two referees should be sent either by email (ideally all requested documents in just one PDF document) or by mail to

Ludwig-Maximilians-Universität München

Faculty of Philosophy, Philosophy of Science and Study of Religion

Chair of Logic and Philosophy of Language / MCMP

Geschwister-Scholl-Platz 1

80539 München

E-Mail: office.leitgeb@lrz.uni-muenchen.de

by

December 1st, 2016.

If possible at all, we very much prefer applications by email.

Contact for informal inquiries: office.leitgeb@lrz.uni-muenchen.de

More information about the MCMP can be found at http://www.mcmp.philosophie.uni-muenchen.de/index.html.

The German description of the position is to be found at http://www.uni-muenchen.de/aktuelles/stellenangebote/wissenschaft/20161017140416.html.

 

*****

 


CfP: The Fifth Reasoning Club Conference

October 6, 2016

 

The Fifth Reasoning Club Conference

Center for Logic, Language, and Cognition (LLC)

University of Torino

 

Keynote speakers:

Branden FITELSON (Northeastern University, Boston)
Jeanne PEIJNENBURG (University of Groningen)
Katya TENTORI (University of Trento)
Paul EGRÉ (Institut Jean Nicod, Paris)

Please visit http://www.llc.unito.it/notizie/reasoning-club-2017-llc-call-papers-now-open for further information.

 

Call for Papers

Submissions for the Fifth Reasoning Club Conference are now open. All PhD candidates and early career researchers with interests in reasoning and inference, broadly construed, are encouraged to submit an abstract of up to 500 words (prepared for blind review) via Easy Chair at https://easychair.org/account/signin.cgi?key=43940042.wHGOgwBi6POdkaUz.

We especially welcome members of groups that are underrepresented in philosophy to submit. We are committed to promoting diversity in our final programme.

The deadline for submissions is 1 February 2017. The final decision on submissions will be made by 15 March 2017.

Grants will be available to help cover travel costs for contributed speakers. To apply for a travel grant, please send a CV and a short travel budget estimate in a single .pdf fale to reasoningclubconference2017@gmail.com.

For any queries, please contact Vincenzo Crupi (vincenzo.crupi@unito.it) or Jason Konek (jpkonek@ksu.edu).

 

The Reasoning Club

The Reasoning Club is a network of institutes, centres, departments, and groups addressing research topics connected to reasoning, inference, and methodology broadly construed. It issues the monthly gazette The Reasoner.

Earlier editions of the meeting were held in Brussels, Pisa, Kent, and Manchester.

 

 

 

 

 

 

 


Conceptions of Belief in Philosophy & Science

September 24, 2016

The Regensburg University Department of Philosophy will host a Workshop on

Conceptions of Belief in Philosophy and Science

September 29 – October 1, 2016.

The schedule for the event is below.

Sept 29
14:00 Hannes Leitgeb (München): The Stability of Belief
15:00 Branden Fitelson (Boston): Two Approaches to Belief Revision
16:30 Eric Raidl (Konstanz): Bridging Ranking Theory and the Stability
Theory of Belief

Sept 30
09:30 Thomas Schärtl-Trendel (Regensburg): Faith – Belief – Conviction.
Distinguishing Strategies of Defending the Rationality of Religious Faith
11:00 Hans Rott (Regensburg): Negative Doxastic Voluntarism and the Concept
of Belief
12:00 Niki Pfeifer (München): Psychological Conceptions of Belief
14:30 Igor Douven (Paris): Scoring in Context
16:00 Tim Kraft (Regensburg): Belief and Acceptance. Cohen’s Distinction
Revisited

Oct 01
09:30 Peter Wakker (Rotterdam): Measuring the Subjective Beliefs of Your Bayesian Twin if You Yourself are Ambiguity Averse
10:30 Gregory Wheeler (München): Commitments and Consequences
12:00 Arthur Paul Pedersen (Regensburg): TBA

Venue:
Lecture room H26
Vielberth Building (latitude: 49.0004, longitude: 12.0952,
floor: 2)
University of Regensburg
Universitätsstraße
93053 Regensburg
Germany

The conference is hosted by the chair or theoretical philosophy and
sponsored by the Hans Vielberth University Foundation.

Link: http://www.conceptions-of-belief.ur.de .

Everybody interested in attending the conference is cordially invited.
For questions, please contact hans.rott@ur.de or david.deml-mueller@ur.de.


Columbia Workshop on Group Agency & Social Epistemology

March 23, 2016
The Columbia University Department of Philosophy will host a Workshop on Group Agency and Social Epistemology on April 2, 2016. The workshop starts at 10am, and will be held in Philosophy Hall. The schedule for the event is below.
 
10:00Gregory Wheeler (MCMP), Mispriced gambles: What peers learn when they disagree
 
11:30Philip Kitcher (Columbia), Social agnotology
 
2:30Kevin Zollman (CMU), The credit economy and the economic rationality of science
 
4:30Cailin O’Connor (Irvine LPS), Power, bargaining, and evolution
 
Links: [PhilEvents | Facebook]
Organizers:
  • Michael Nielsen (Columbia)
  • Ignacio Ojea Quintana (Columbia)
  • Rush Stewart (Columbia)

Postdoc on shared agency and coordination

March 22, 2016

An interesting postdoctoral position is open at the Center for the Study of Social Action of the University of Milan. Topic: Acting together: Coordination, collective goals, and cooperation (project led by Hykel Hosni and Corrado Sinigaglia). Both formal and experimental approaches are of interest (ideally, they’re looking for someone who attempts to combine them).

Deadline fairly close: April 26, 2016.

All details HERE.

 


Five Years MCMP: Quo Vadis, Mathematical Philosophy?

March 18, 2016

Five Years MCMP

Quo Vadis, Mathematical Philosophy?

June 2-4, 2016

MCMP, LMU Munich

www.lmu.de/5yearsmcmp

The Munich Center for Mathematical Philosophy (MCMP) invites participation in Five Years MCMP: Quo Vadis, Mathematical Philosophy?, a workshop to be held at Ludwig Maximilian University of Munich from June 2 to June 4, 2016.

On the one hand, the workshop will celebrate the five years of existence of the Munich Center for Mathematical Philosophy (MCMP). On the other hand, and much more importantly, the workshop will be devoted to the question of where we should be heading in the future: what next, mathematical philosophy?


Workshop Features.

  • A brief look back at five years MCMP
  • 16 short talks by young mathematical philosophers
  • Three evening lectures on the logical empiricist background to mathematical philosophy
  • Three general discussion sessions
  • An “Ideas Session“ in which the participants will be asked to contribute new ideas for the application of logical and mathematical methods to philosophical problems and questions.

Registration Deadline.

May 1, 2016

Organizers.

Prof. Dr. Hannes Leitgeb
Prof. Dr. Stephan Hartmann

Submitted by Hannes Leitgeb