Chance News 102

Quotations

"Collecting data that can trump a powerful anecdote is the value of the randomized controlled trial, says Amy Finkelstein, an M.I.T. professor and a leader of the Oregon study, which has published a series of papers, most recently on emergency room use."

in: How to arrive at the best health policies, "The Upshot" blog, New York Times, 21 November 2014

Submitted by Paul Alper

“To achieve the goal of making our children happier, this ‘finding’ has led to the suggestion that academic standards should be relaxed. The existence of this suggestion (fn) and that it is being seriously considered lifts the subject of the direction of the causal arrow (as well as the size of the causal effect) out of the realm of the theoretical into that of the immediately practical.

"(fn) This notion falls into the category of ‘rapid idea.’ Rapid ideas are those that only make sense if you say them fast.”

“You can feel the authors’ desire to be causal, and they come very close to making a causal claim .... But the character of the published studies mitigates against the sorts of causal interpretations that seem to be yearned for. Most were observational studies, and the rest might be called ‘some data I found lying in the street.’”

Howard Wainer in “Happiness and Causal Inference”, Chance, v. 27, no. 4, 2014

Submitted by Margaret Cibes

Forsooth

Alas, the graph is not smarter:

-- sidebar on Weather Underground forecast page, 19 October 2014

The nonzero baseline (note the 70% label fading into the background here) is of course a familiar trick for exaggerating comparisons, and examples abound. It just feels worse in a claim about scientific accuracy!

Submitted by Bill Peterson

---

"There’s still time to vote, but with forecasters giving Republicans anywhere from a 75% to 113% chance of capturing a Senate majority, it isn’t too early to explain the result."

in: Nothin’ matters and what if it did, Wall Street Journal op/ed, 4 November 2014

Submitted by Emil M Friedman

---

"Our investigation of government spending in the 24 states that dedicate lottery funds for education yields a stunningly bad report card: the percentage of state spending on education is down or flat in 21 of those states from coast to coast. Lotteries provide no additional funding for education in 21 out of 24 states. As math students in one of those places would put it, that is nearly 50%."

John Oliver (sarcastically) in Last Week Tonight, HBO, November 9, 2014

Submitted by Margaret Cibes

---

“In the dry but appallingly eloquent language of statistics, the historians explain to us that, in eighteenth-century French villages, the median age of marriage was higher than the median age of death.”

The Two Cultures and a Second Look
by C. P. Snow, Cambridge University Press, 1963

Submitted by Margaret Cibes

Ebola quanrantines

How to quarantine against Ebola
by Siddartha Mukherjee, New York Times, 12 October 2014

This op-ed piece dismisses several strategies for containing entry and spread of Ebola in the U.S. in favor of blood-sample screening based on multiplying any genes of the virus present via PCR (polymerase chain reaction).

Author Mukherjee (a professor of medicine at Columbia University) cites a false-positive rate of 3 per thousand and a false-negative rate of 4 per thousand.

Discussion

1. If an average of one person per planeload of 200 people has contracted the Ebola virus, what is the ratio of false positives to true positives in screening such planeloads?

2. If one in 1,000 people screened has the Ebola virus, what is the ratio of false positives to true positives?

3. If one in 10,000 people screened has the Ebola virus, what is the ratio of false positives to true positives?

4. Dr. Mukherjee cites a 2000 study in The Lancet of 24 "asymptomatic" individuals who had been exposed to Ebola. They were tested for the Ebola virus using an earlier version of the proposed screening test. Of the 24:

• 11 developed Ebola, 7 of whom had had positive tests;
• 13 did not develop Ebola, and none of them had tested positive.

From these data, how would you estimate the false-positive rate and false-negative s (with appropriate measures of uncertainty)? (The rates 3/1000 and 4/1000 cited above are for a later version of the method as refined in 2004.)

Submitted by Paul Campbell

Interpreting election forecasts

How not to be fooled by odds
by David Leonhardt, "The Upshot" blog, New York Times, 15 October 2014

Will the midterm elections result in Republican control of the Senate? The latest Upshot forecast gives a 74% chance. Leonhardt observes that the person in the street might interpret this a virtual lock. Nevertheless, he says that people do understand the statement that the chance of rolling a sum of eight or lower with two dice is about 74%: this is a better than even chance, but not a lock. Or, via the complement (26% chance) it is possible to get a sum exceeding eight.

For reference, he gives a list of situations that correspond to the 26% figure. Among these:

• The chances that a blackjack casino dealer busts
• The frequency with which a 25-year-old woman is shorter than 5 feet 3 inches
• The share of Americans who live in California, Texas or New York

Discussion
1. Do you think people misinterpret a 74% win probability as meaning that Republicans are predicted to get 74% of the vote? (The latter would be a landslide victory!)

2. (Chance News reader) Emil Friedman commented that the article "may add to students' confusion. Several of his examples merely state the proportion of something in a population. To turn them into probability statements would require changing the wording to read something like The probability that a randomly chosen woman will be shorter than 5 feet 3 inches."

Followup: Prediction markets

Republicans are surging in the prediction markets
by Justin Wolfers, "The Upshot" blog, New York Times, 15 October 2014

Wolfers writes, "Is there now a clear leader in the race for control of the Senate? I think so, but it really depends on whether you’re listening to the polls or the prediction markets." The surge he refers to is in the Betfair, where chances for Republicans taking the Senate have risen from 69% on October 10 to 86% on October 24. Wolfers adds parenthetically that "The Betfair odds for victory by the Democrats should be ignored, as the bet offered requires that they win without relying on the votes of the two independent senators who typically caucus with them."

Discussion
If this bet is indeed uninformative, do you think its presence on the site might affect overall betting trends?

Submitted by Bill Peterson

Rats! NYC capture-capture experiment

“Does New York City really have as many rats as people?”, Significance, October 2014

“New Analysis Reassesses Size of New York’s Rat Population”, Wall Street Journal, November 14, 2014

Jonathan Auerbach, Columbia doctoral student in statistics, has written an interesting report about a capture-recapture experiment he conducted to estimate the size of NYC’s rat population. For his article, he won first prize in the YSS/Significance Young Statisticians Writing Competition. Interested readers can find his report in Significance magazine, or they can find a briefer summary of his experiment in the Wall Street Journal.

Auerbach’s methodology is quite interesting because he did not actually capture any rats:

NYC’s Department of Health and Mental Hygiene [would have been] unlikely to approve a large-scale rat-releasing experiment (I know; because I asked).

Using the capture-re-capture process, he selected and re-selected geographical locations (city lots), “marked” them, collected data about rat sightings as reported to the city in the first half of 2010, and then compared that data to analogous data in the first half of 2011. He includes in his report all of his assumptions and his own analysis of his assumptions, as well as information about rats.

Submitted by Margaret Cibes

Supply and demand of old magazines

An exploration of the basis for patient complaints about the oldness of magazines in practice waiting rooms: cohort study
by Bruce Arroll, Stowe Alrutz and Simon Moyes, BMJ, 14 December 2014

The BMJ's December issue is famous for this sort of spoof. In the abstract, we read:

Results 47 of the 82 magazines with a visible date on the front cover were aged less than 2 months. 28 of these 47 (60%) magazines and 10 of the 35 (29%) older magazines disappeared (P=0.002). After 31 days, 41 of the 87 (47%, 95% confidence interval 37% to 58%) magazines had disappeared. None of the 19 non-gossipy magazines (the Economist and Time magazine) had disappeared compared with 26 of the 27 (96%) gossipy magazines (P<0.001). All 15 of the most gossipy magazines and all 19 of the non-gossipy magazines had disappeared by 31 days. The study was terminated at this point.

Conclusions General practice waiting rooms contain mainly old magazines. This phenomenon relates to the disappearance of the magazines rather than to the supply of old ones. Gossipy magazines were more likely to disappear than non-gossipy ones. On the grounds of cost we advise practices to supply old copies of non-gossipy magazines. A waiting room science curriculum is urgently needed.

Submitted by Paul Alper