Chance News 32
Quotation
You can prove any silly hypothesis by running a statistical test on tons of data.
Jim Albert
The Numbers Guy
Wall Street Journal. 7 December, 2007
Forsooth
The following Forsooths are from the Dec 2007 issue of RSS NEWS.
The methodology behind the ICS survey is flawed. There were only 2000 respondents, a small number for any statistical survey, who were asked to nominate which firms of services they used and how that rated them.
The Times
22 October 2007
Presenter:
'In statistics, in data which are binomially distributed, individual values may be placed in one of two mutually exclusive categories such that the sum of the probabilities of occurring in the categories is what value?'
Answer given: 'Unity'
Presenter:
'No, it's one, or a hundred percent'
University Challenge BBC2
22 October 2007
This Forsooth was suggested by Paul Alper
The fact is, analysts say, that for all that it has a secular constitution, Turkey remains a relatively conservative country. The word atheist has only recently appeared in Turkish, but "godless" still remains an insult here. "Only 2% of the people we interviewed said they didn't believe in God", says Ali Carkoglu, co-author of a 2006 study of religious attitudes.
"Given that we had a 2% margin of error that could mean nobody", he added. "In any case it takes considerable courage for a Turk to admit to a stranger that they are atheists."
30 November 2007
In Chance News 31 we had the forsooth:
Of Italy's 151 Series A players, 52 are non-white, with Inter fielding, 19,
Juventus 12, AC Milan 13, AS Roma 12 and Udinese 10. Messina has eight.The Times
30 November 2005
Marcello Pagano comments that in Italy there is a saying: L'aritmetica non è un'opinione
Math too hard for this lottery
John Haigh, author of one of our favorite chance books:"Taking Chances: winning with probability" suggested this item.
The following story appeared in the December issue of the London Mathematical Society Newsletter.
From the Manchester Evening News 3 Nov 2007
A Lottery scratchcard – the Cool Cash game – was taken out of shops yesterday after some players failed to grasp whether or not they had won.
To qualify for a prize, users had to scratch away a window to reveal a temperature lower than the figure displayed on each card. As the game had a winter theme, the temperature was usually below freezing. But the concept of comparing negative numbers proved too difficult for some. Camelot received dozens of complaints on the first day from players who could not understand how, for example, –5 is higher than –6.
Tina Farrell, from Levenshulme, called Camelot after failing to win with several cards. The 23-year-old, who said she had left school without a maths GCSE, said: "On one of my cards it said I had to find temperatures lower than –8. The numbers I uncovered were –6 and –7 so I thought I had won, and so did the woman in the shop. But when she scanned the card the machine said I hadn't. I phoned Camelot and they fobbed me off with some story that –6 is higher – not lower – than –8 but I’m not having it. I think Camelot are giving people the wrong impression – the card doesn’t say to look for a colder or warmer temperature, it says to look for a higher or lower number. Six is a lower number than 8. Imagine how many people have been misled."
A Camelot spokeswoman said the game was withdrawn after reports that some players had not understood the concept.
Submitted by Laurie Snell
David Kendall 1918-2007
The London Mathematical December Newsletter also reported the sad news that David Kendall, one of this centuries greatest probabilist, has died at age 90. You can read about his contributions in the Times of London's Obituary .
What do economists know that lawyers don't
Does Death Penalty Save Lives? A New Debate Adam Liptak, The New York Times, November 18, 2007.
Recently a dozen or so studies by economists have shown that the death penalty has a deterrent effect. In one study, each execution was estimated to save five lives.
To economists, it is obvious that if the cost of an activity rises, the amount of the activity will drop.
The legal profession is not so sure.
But not everyone agrees that potential murderers know enough or can think clearly enough to make rational calculations. And the chances of being caught, convicted, sentenced to death and executed are in any event quite remote. Only about one in 300 homicides results in an execution.
The modles used by economists are typically a multiple linear regression model with adjustment for key covariates.
The studies try to explain changes in the murder rate over time, asking whether the use of the death penalty made a difference. They look at the experiences of states or counties, gauging whether executions at a given time seemed to affect the murder rate that year, the year after or at some other later time. And they try to remove the influence of broader social trends like the crime rate generally, the effectiveness of the criminal justice system, economic conditions and demographic changes.
Can you use a regression model here? The answers vary.
Critics say the larger factors are impossible to disentangle from whatever effects executions may have. They add that the new studies’ conclusions are skewed by data from a few anomalous jurisdictions, notably Texas, and by a failure to distinguish among various kinds of homicide.
The recent studies are, some independent observers say, of good quality, given the limitations of the available data. “These are sophisticated econometricians who know how to do multiple regression analysis at a pretty high level,” Professor Weisberg of Stanford said. The economics studies are, moreover, typically published in peer-reviewed journals, while critiques tend to appear in law reviews edited by students. The available data is nevertheless thin, mostly because there are so few executions.
There is additional commentary about death penalty deterrence on the Freakonomics blog.
Questions
1. The bulk of executions in the United States have occurred in Texas. Why might this clustering of executions raise difficulty for the regression model?
2. Can a regression model remove the effect of all of the potential confounding variables that also influence crime rate? Can they remove enough of the effect of confounding to provide a plausible answer?
3. At the end of the Times article, a researcher speculates on how random assignment could allow a caerful study of the deterrence effect of the death penalty. What would a randomized study of death penalty effects look like? What are some of the practical and ethical barriers to such a study?
Submitted by Steve Simon
The Numbers Guy
Carl Bialik writes a column called "The Numbers Guy" for the Wall Street Journal where he "examines the way numbers are used, and abused". He also has a Blog where he discusses his articles and readers comment on them. In the December 3, 2007, of the Wall Street Journal The Numbers Guy's WSJ Column was titled "Is a Carl Doomed to be a C Student?, We Don't Think So". Here the Numbers Guy discussed a study purporting to show a Name-Letter-Effect which was discussed here in Chance News 31 by Paul Alper. As the Numbers Guy's title suggests, he shares Alper's skepticism of the results of the study. On his website Bialik, also discusses the use of the phrase “statistical ties” or “statistical dead heats” in The Wall Street Journal, The New York Times, CNN, and other media in reporting on the Republican and Democratic contests. Bialik comments that statisticians do not like these terms and explains why.
Questions
(1) What do you think news reporters mean by the expressions "statistical ties" and "statistical dead heat"?
(2) Why do you think statisticians do not like these terms?
Submitted by Laurie Snell
Of Mice and Males
Authors are not responsible for what journalists write about a research article. Lacking knowledge of statistics, reporters tend to act like stenographers when they aren't extrapolating far beyond the limits of the research. Take a look at what the lay press had to say about Experimental alteration of litter sex ratios in a mammal which appeared in the Proceedings of the Royal Society (B).
The Daily Mail:
Red meat and salty snacks are said to lead to boys while chocolate is thought to help to produce girls. Now science suggests the stories may be true: mice with low blood-sugar levels - a good indicator of a sugar-rich diet - produce more female than male offspring.
The Independent:
Boy or girl? Battle of the sexes Are you desperate for a daughter or dying for a son? The solution could lie in a mother's diet - before she even conceives.
New Scientist:
Findings lend credence to traditional beliefs that eating certain foods can influence the sex of offspring.
Discover:
The Biology of . . . Sex Ratios. Want a boy at all costs? The secret may lie in your glucose levels.
FoxNews.com:
Can what a mother-to-be eats influence the sex of her unborn baby? Maybe, says new research.
The research itself looks at a very important issue in biology: the influence of nutrition on reproductive strategy and the ensuing evolutionary advantage. To carry out their research, they had 20 female mice in a control group and 20 female mice in the treatment group which was given "a steroid [DEX] that inhibits glucose transport and reduces plasma glucose concentrations." The original paper does not give a table whereby for each of the 40 mice is recorded the number in the litter, number of males and which arm of the study it was in. Instead, we have to relay on the given summary data: average litter size for control is 10.45 with a standard error of .60, and the average litter size for the treatment is 9.17 with a standard error of .62.
According to the article, "The sex ratio differed significantly between the treatment and control groups (rank-sum test: Z= -2.18, p=0.03), with DEX females giving birth to fewer sons (41.9%) than control females (53.5%)." With this information, it would appear that the control group produced a total of 10.45 * 20 = 209 mice resulting in 209*.535 = 112 males. The treatment group is more difficult to determine because two of the 18 "failed to conceive;" thus, if only 18 are relevant, then the treatment group has 9.17 * 18 = 165 mice and 165 * .419 = 69 males. Using these numbers, a Minitab printout yields a (Fisher exact because of the relatively small samples) p-value of .029 which is close to the "p=.03" mentioned in the article.
Test and CI for Two Proportions
Sample |
X |
N |
Sample p |
1 |
112 |
209 |
.0.535885 |
2 |
69 |
165 |
0.418182 |
Difference = p (1) - p (2)
Estimate for difference: 0.117703
95% CI for difference: (0.0165306, 0.218876)
Test for difference = 0 (vs not = 0): Z = 2.28 P-Value = 0.023
Fisher's exact test: P-Value = 0.029
Discussion
1. No confidence interval for the difference in proportion of males is given in the article itself. Does the 95% CI suggest any guarantee for reduction in male mice? Male humans?
2. Regarding the treatment arm, the article states : "42%, two-tailed binomial test, p=.04." Using the summary data, Minitab reports
Test and CI for One Proportion
Test of p = .05 vs p not = 0.5
Sample |
X |
N |
Sample p |
95% CI |
P-Value |
1 |
69 |
165 |
0.418182 |
(0.341979,0.497378) |
0.043 |
Does this 95% CI suggest any guarantee for reduction in the number of male mice? Male humans?
3. Thus far, offspring production has been treated as a Bernoulli process. That is, each offspring is considered to be independent. In other words, no use has been made of the number of female parents (20 in the control and 18 in the treatment arm). Using the summary data given in the article, Minitab obtains for the difference in means of males a somewhat different p-value, .05 rather than the .03 mentioned in the article and thus a wider interval.
Two-Sample T-Test and CI
Sample |
N |
Mean |
StDev |
SE Mean |
1 |
20 |
5.59 |
2.68 |
0.60 |
2 |
18 |
3.84 |
2.63 |
0.62 |
Difference = mu (1) - mu (2)
Estimate for difference: 1.750
95% CI for difference: (-0.000, 3.500)
T-Test of difference = 0 (vs not =): T-Value = 2.03 P-Value = 0.050 DF = 35
Ask a biologist whether or not the Bernoulli assumption is valid.
4. All of the above is from a frequentist point of view. What would Bayesians add to the discussion and why?
5. As noted, two of the 18 in the treatment arm failed to conceive while all 20 in the control arm did conceive. How does this affect your view of the results?
Submitted by Paul Alper
== An almighty coincidence + Plus Magazine, Issue 45, December 2007 John Haigh and Rob Eastaway
<blockquoate> Coincidences can crop up in the strangest places. While Peter Hughes, an accountant from Birkenhead, was at a church service, his eye fell on the board showing the list of hymn numbers for the service. They were 16, 37, 428 and 590.
Mathematicians naturally look on numbers as a goldmine for distraction, maybe seeking to combine them to form an equation, or noting how many are primes. In this case, Peter observed something particularly curious: all ten digits appear exactly once! How likely is that, he wondered? His initial back-of-the-envelope estimate indicated that the chance might be about 1 in 6,000. He then sought our comments.<\blockquote>