Sampling & Survey Issues

A cartoon that invites conversation about the type of biases that may result from the way a pollster handles the logistics of taking a survey and thus the importance of careful planning.  The cartoon was used in the February 2022 CAUSE cartoon caption contest and the winning caption was written by Don Bell-Souder a student at University of Colorado, Boulder. Two alternative captions with the same basic learning object are “Selection bias is in the eye of the beholder” written by Sarah Arpin and “ACME polling finds that bootstrapping still reflects self-reporting bias.” Written by Rosie Garris who are also both students at University of Colorado, Boulder. The cartoon was drawn by British cartoonist John Landers (www.landers.co.uk) based on an idea by Dennis Pearl from Penn State University.

A song for discussion of the uses of weighting. In particular, Verse 1 hits the weighted mean (with a nod to Simpson’s paradox), Verse 2 connects with how/why poll data are weighted to help the sample more accurately reflect population characteristics, which can launch a discussion of what we adjust for (probability, sample design, demographics) and how (raking, matching, propensity weighting). This can be supported by examples in GAISE (https://www.amstat.org/docs/default-source/amstat-documents/gaisecollege...) and apps (e.g., https://sites.psu.edu/shinyapps/2018/12/03/weight-adjustment-in-surveys/). Finally, the Bridge touches on weighted regression. Lyrics by Larry Lesser from The University of Texas at El Paso; may be sung to the tune of the 1981 hit "The Waiting" by Tom Petty.  The song received an honorable mention in the 2023 A-mu-sing competition.  Thanks to UTEP’s Jose Villalobos for the song title and for contributing backing vocals and guitar to Larry’s on the recording.

A cartoon that can be used for discussions that compare and contrast survey samples versus a census. The cartoon was used in the August 2019 CAUSE cartoon caption contest and the winning caption was written by Jim Alloway from EMSQ Associates. The cartoon was drawn by British cartoonist John Landers (www.landers.co.uk) based on an idea by Dennis Pearl from Penn State University.

A poem written in 2019 by Larry Lesser from The University of Texas at El Paso to discuss systematic sampling.  Students should be familiar with the lyric being sampled from (though you could provide it to make sure) and verify that the systematic sample involved sampling every third word and starting with the lyric’s first word. Students could create their own poems with different systematic samples (or different text to sample from).  The poem is part of a collection of 8 poems published with commentary in the January 2020 issue of Journal of Humanistic Mathematics.