Chance News 49: Difference between revisions

From ChanceWiki
Jump to navigation Jump to search
Line 7: Line 7:
Geiger's "biggest contribution: looking for employees who failed to take vacation. This simple metric turned out to have strong predictive power in stopping embezzlement."
Geiger's "biggest contribution: looking for employees who failed to take vacation. This simple metric turned out to have strong predictive power in stopping embezzlement."


==Infuse and Kuklo II==
[http://plus.maths.org/issue9/features/benford/ This web site provides a wonderful pun] regarding Benford’s Law, “Looking out for number one.”  The authors write:
“Go and look up some numbers. A whole variety of naturally-occurring numbers will do. Try the lengths of some of the world's rivers, or the cost of gas bills in Moldova; try the population sizes in Peruvian provinces, or even the figures in Bill Clinton's tax return. Then, when you have a sample of numbers, look at their first digits (ignoring any leading zeroes). Count how many numbers begin with 1, how many begin with 2, how many begin with 3, and so on - what do you find?
You might expect that there would be roughly the same number of numbers beginning with each different digit: that the proportion of numbers beginning with any given digit would be roughly 1/9. However, in very many cases, you'd be wrong!”


Instead, we get
<center>http://www.dartmouth.edu/~chance/forwiki/LeedingDidgit.gif</center>
<center> Figure 1: The proportional frequency of each leading digit predicted by Benford's Law.</center>
Should somebody try “to falsify, say, their tax return then invariably they will have to invent some data. When trying to do this, the tendency is for people to use too many numbers starting with digits in the mid range, 5,6,7 and not enough numbers starting with 1. This violation of Benford's Law sets the alarm bells ringing.”
It is a pity that unlike for accounting data, there is no forensic counterpart to Benford’s Law for determining when a journal article is entirely fraudulent.  As stated in [http://chance.dartmouth.edu/chancewiki/index.php/Chance_News_48#Infuse_and_Kuklo Infuse and Kuklo] you won’t be able to read [on the JBJS website] the fraudulent article, “Recombinant human morphogenetic protein-2 for type grade III open segmental tibial fractures from combat injuries in Iraq” by Timothy Kuklo, et al, which appeared in the JBJS in August, 2008 because it has been retracted.  However, [http://graphics8.nytimes.com/packages/pdf/business/20090513kuklo-journal-article.pdf it is available here.]  The immediate impression is that as far as statistics is concerned, it looks like any other article in the health field.
The important statistics appear in Tables 1 and III
<center>http://www.dartmouth.edu/~chance/forwiki/TableoneKuklo.jpg </center>
<center>http://www.dartmouth.edu/~chance/forwiki/TablethreeKuklo.jpg </center>
Note that there is no claim that everyone in Group 2 (the group using Infuse) did well or that everyone in Group 1 fared poorly.  Further, as in legitimate studies, there are patients who were not included because of an additional problem (head injury) or were lost to follow up.  The data is there for reviewers and others to do the calculations which in this paper are the difference in proportions, a standard statistical technique.  Small but not immodest p-values indicate that statistical significance is obtained; detailed discussion about the fractures indicates that practical significance is also realized.  The bibliography has 39 entries, only one of which has Kuklo as the author; the same entry includes one of the ghost co-authors in the retracted paper.  Nothing statistically or otherwise suspicious whatsoever.
Freudian psychology is currently out of favor but Freud's notion of a [http://www.thetruthseeker.co.uk/article.asp?ID=1602 death wish] still seems plausible.  How else to explain the pushing of the envelope past falsification of data, denial of connection to the manufacturers of Infuse, and forging of not one, not two but four ghost authors?  The aptly titled 1995 book by Feinberg and Tarrant, ''Why Smart People Do Dumb Things,'' attributes such behavior to what they deem “the four pillars of stupidity”: hubris, arrogance, narcissism and unconscious need to fail.  The first three are overwhelmingly obvious, but the last named cause sounds deeply Freudian.
[http://www.nytimes.com/2009/06/06/business/06surgeon.html A New York Times update] appears on June 5, 2009 and shows how Kuklo forged the signatures; “He used a distinctively different handwriting style for each of them, a form he submitted to the British journal shows.”
http://www.dartmouth.edu/~chance/forwiki/Kuklosignatures.jpg <br>
Dr. Timothy R. Kuklo and copies of the signatures of other Army doctors on his study that authorities say he forged.
A putative co-author “suspected that Dr. Kuklo had fabricated the comparison groups, because many soldiers had received both Infuse and a bone graft — not one or the other.”  This person said, “It was like he was comparing apples and oranges.  But there weren’t any apples or oranges to compare.”
Returning to the statistical aspect of the paper, Table III says 19 of 67 (28%) in Group 1 were patients who had further surgery while 5 of 62 (8%) in Group 2 (Infuse group) had further surgery.  Presumably, via a chi-square test, the p-value is listed as .003.  Minitab produces the same numerical result of .003 via the Fisher exact test:
Sample  X    N    Sample p<br>
1        5    62    0.080645<br>
2      19    67    0.283582<br>
Difference = p (1) - p (2)<br>
Estimate for difference:  -0.202937<br>
95% CI for difference:  (-0.330382, -0.0754923)<br>
Test for difference = 0 (vs not = 0):  Z = -3.12  P-Value = 0.002<br>
Fisher's exact test: P-Value = 0.003
Some numerical discrepancies arise, however, for Table I.  Table I says 51 of 67 (76%) in Group 1 had a successful “union” while 57 of 62 (92%) in Group 2 (Infuse group) had a successful union.  Presumably, via a chi-square test, the p-value is listed as .015.  Minitab produces the following indicating that because of the small sample sizes, the Fisher exact test yields .017 instead:
Sample  X        N    Sample p<br>
1      57      62    0.919355<br>
2      51      67    0.761194<br>
Difference = p (1) - p (2)<br>
Estimate for difference:  0.158161<br>
95% CI for difference:  (0.0356210, 0.280701)<br>
Test for difference = 0 (vs not = 0):  Z = 2.53  P-Value = 0.011<br>
Fisher's exact test: P-Value = 0.017
Table I also says 10 of 67 (14%) in Group 1 had post-operative infections while 2 of 62 (3.2%) in Group 2 (Infuse group) had post-operative infections.  Presumably, via a chi-square test, the p-value is listed as .001.  Minitab produces the following quite different p-value of .032:
Sample  X      N    Sample p<br>
1      10      67    0.149254<br>
2        2      62    0.032258<br>
Difference = p (1) - p (2)<br>
Estimate for difference:  0.116996<br>
95% CI for difference:  (0.0210037, 0.212988)<br>
Test for difference = 0 (vs not = 0):  Z = 2.39  P-Value = 0.017<br>
Fisher's exact test: P-Value = 0.032
However, these discrepancies are hardly in the Benford class.  They may merely indicate what happens when a non-statistician medical doctor acts alone.


==item 2==
==item 2==

Revision as of 20:29, 9 June 2009

Quotations

Forsooths

Steven J. Dubner of the New York Times writes about Bernice Geiger, a person who "never took vacations" for fear of her embezzlement being discovered by a fill-in employee; she "was arrested in 1961 for embezzling more than $2 million over the course of many years." Eventually, "after prison Geiger went to work for a banking oversight agency to help stop embezzlement."

Geiger's "biggest contribution: looking for employees who failed to take vacation. This simple metric turned out to have strong predictive power in stopping embezzlement."


item 2

Retrieved from "https://www.causeweb.org/wiki/chance/index.php?title=Chance_News_49&oldid=7655"