Testing

  • The number of degrees of freedom is usually self-evident - except for the analysis of data that have not appeared in a textbook.

    David Durand (1912 - 1996).

  • Lyric copyright by Bret Larget
    May be sung to the tune of "Roll out the Barrel" (Lew Brown, Wladimir A. Timm, Vasek Zeman and Jaromir Vejvoda)

    What's a p-value?
    Test a hypothesis and see.
    What's a p-value?
    It is the probability,
    That a new test statistic,
    Would be at least as extreme as the old,
    Given Ho is true.
    That is what I'm told!

  • Lyric copyright by Jeff Witmer
    may sing to tune of "Let it Be" (Paul McCartney/Beatles)

    When I find myself with normal data,
    William Gosset comes to me
    Speaking words of wisdom, Use a t.

    If my NP plot is linear
    but sigma isn't known to me
    This is not a problem, Use a t.

    Use a t, use a t, use a t, use a t
    Student knows the answer: Use a t.

    And when the broken hearted students
    in a stats class can't agree
    You can show the answer: Use a t.

    Some want to use a Z test,
    and a chi-square is a mystery
    The truth is very simple: Use a t

    Use a t, use a t, use a t, use a t
    Student knows the answer: Use a t.

    And when your thoughts are cloudy,
    RA Fisher may not hear your plea
    But Gosset will deliver, with a t.

    He knows you are trying
    and he wants to set your mind at ease
    Don't think twice about it, use a t.

    Use a t, use a t, use a t, use a t
    Student knows the answer: Use a t.

  • Lyric copyright by Gary Cziko
    may sing to tune of "Mr. Bojangles" (Jerry Jeff Walker)

    Well, I didn't think I'd ever like statistics,
    and I don't know why.
    But I had to take it sometime soon to graduate,
    so I gave it a try.
    And I've changed my mind, yes I've changed my mind,
    'cause it's clear to me now,
    Hypothesis testing, hypothesis testing, hypothesis testing is fun!

    Oh, you state your null hypothesis and don't forget,
    your alternative one, too.
    It may be directional that means it has one tail,
    but usually two.
    You decide on alpha, oh, don't forget alpha,
    to control errors Type I and II.
    Hypothesis testing, hypothesis testing, hypothesis testing is fun!

    Then compute your z or t or F or chi-square,
    and compare it to the table.
    To decide the fate of your own null hypothesis,
    you reject it if you're able.
    If you're lucky you reject it, don't try to accept it,
    it's not logical to do.
    Hypothesis testing, hypothesis testing, hypothesis testing is fun!

    So statistics really can be quite enjoyable,
    if you study all along.
    And I want to world to know about the joy I've found,
    so I wrote this song.
    And I hope you'll sing it, yes hope you'll sing it,
    in a voice clear and strong.
    Hypothesis testing, hypothesis testing, hypothesis testing is fun!

  • Lyric ©2005 Lawrence Mark Lesser;
    May sing to tune of "Row, Row, Row Your Boat"

    It is key to know
    What p-value means --

    It's the chance
    (with the null)
    you obtain
    data that's

    At least that extreme!

  • Lyric copyright by Kate McFarland
    may sing to tune of "I Will Find You" (Peter Hammill)

    Trapped by your habit when you must compare,
    Two-sample t-tests that blind you
    I have a better way;
    each observation pair,
    I'll assess, greater/less; I will find U.

    (For) independent samples X and Y,
    Mann-Whitney's test, I'll remind you,
    Is so simple--add a half for every tie,
    Else just sum, naughts and ones, and you'll find U.

    Far away in a normal test
    You'll find you don't have so much freedom;
    Don't run away to a normal test.

    Don't be afraid should it be unknown
    What distribution's before you.
    Don't be afraid (with) symmetry alone,
    Lose no more, (than) point-one-four, if you find U.

    Far away in a normal test
    Things cannot be much more efficient;
    Don't run away to a normal test...

    Trapped by your habit when you must compare,
    Two-sample t-tests that blind you
    I have a better way;
    each observation pair,
    I'll assess, greater/less; I will find U.

  • Lyric copyright ©2006 by Lawrence Mark Lesser
    may be sung to the tune of "Aquarius" (James Rado, Gerome Ragni, Galt MacDermot)

    When you have qualitative data
    And you need to test goodness of fit
    Or do a test of independence,
    Then this fine tool is it!
    This is the dawning of the age of chi-square for us,
    Age of chi-square for us,
    Chi-square for us!
    Chi-square for us!

    It's the oldest test we use now--
    In nineteen-hundred, Pearson showed us how
    Reasoning with simple rat'os
    yield expected frequencies that go in formula summation
    note degrees of libera-ation:
    chi-square for us, Chi-square for us!

    (repeat first section)

  • Lyric copyright by Marc Coram and Matthew Finkelman
    may sing to the tune of "My Boyfriend's Back" (Robert Feldman, Gerald Goldstein and Richard Gottehre)

    The p-value's low and I'm gonna get it published
    Heh-na, heh-na, it's .05

    The p-value's low and the journal isn't rubbish
    Heh-na, heh-na, it's .05

    Yeah, my paper got accepted
    Null hypothesis rejected
    Heh-na, heh-na, it's .05

    The effect is microscopic but I got four thousand patients
    Heh-na, heh-na, it's .05

    Now people will forget my bad TA evaluations
    Heh-na, heh-na, it's .05

    Yeah, my paper got accepted
    Null hypothesis rejected
    Heh-na, heh-na, it's .05
    Heh-na, heh-na, it's .05
    Heh-na, heh-na, it's .05

  • Lyric copyright by Dennis K. Pearl
    may sing to the tune of "Break on Through (to the other side)" (The Doors)

    You know the tail's to the right
    Root-n divides the s
    Tried the left
    Tried the right
    Test on mu to the other side
    Test on mu to the other side
    Test on mu to the other side, yeah

    We placed our measures here
    valid measures there
    But can you still recall
    Testing just one side
    Test on mu to the other side
    Test on mu to the other side

    Yeah!
    C'mon, yeah

    Both ways reject my null
    Both ways reject my null
    mean was low
    mean was high
    mean was low
    mean was high

    I landed an alternative
    Both ways can give
    Evidence to claim
    The null's a lie
    Test on mu to the other side
    Test on mu to the other side
    Test on mu, oww!
    Oh, yeah!

    Made the mean
    Peak to Peak
    Way to weigh
    Power to Power
    State and negate
    z's the guide
    Test on mu to the other side
    Test on mu to the other side
    Test on mu
    Test on mu
    Test on mu
    Test on mu
    Yeah, yeah, yeah, yeah
    Yeah, yeah, yeah, yeah, yeah

  • Lyrics © by Jen Simonds
    may sing to tune of "Oops! ... I Did It Again" (Britney Spears)

    I think I did it again
    I made you believe,
    I had what I need
    Oh, Chuck, I have run a Z-test,
    But that doesn't mean I know what's best
    But to lo-ose my σ, that is just so typically me
    Oh baby baby

    Oops I did it again
    I picked the wrong test
    Got invalid results
    Oh, baby baby
    Oops I ran a two-tailed
    When I wanted just one tail
    For my hypothesis

    You see my problem is this
    I'm running t-tests
    Wishing my groups they were independent
    I cry watching the curve
    'Cause if I reject, I've got nerve
    But to lose degrees of freedom
    That is just so typically me
    Oh, baby, Oh baby baby

    Oops I did it again, I misread the graph
    Where's the interaction?
    Oh, baby, baby
    Oops, are those parallel lines
    And where are the main effects
    Is this even an ANOVA?

    [Dream Sequence]
    Chuck: Britney, Britney, I got these for you.
    Britney: But I thought the old lady archived these down in the basement of the library
    Chuck: I went down and got them for you.
    Britney: Awww, you shouldn't have...
    Chuck: No, you really need these

    Oops I ran a Pearson's for my test
    I tried to correlate categories
    Oops you think that I needed a Χ²
    For my nominal data

    Oops I did it again, rejected the null
    Didn't understand p
    I thought bigger's better
    Oops I misread the "sig."
    On my SPSS output
    I'm not that innocent

    Oops I did it again
    I picked the wrong test, got invalid results
    Oh, baby baby
    Oops I ran a two-way
    When I wanted a three-way
    For my hypothesis.

    Watch the video

Pages