This collection of datasets was compiled by the Biostatistics Department at Vanderbilt University. They come in R, S, Excel, and ASCII formats. Each also has a description in html format.
This textbook from VassarStats introduces various statistical topics and contains interactive components. Topics include: Measurement Principles; Distributions; Correlation; Regression; Partial Correlation; Rank-Order Correlation; Statistical Significance; Sampling Distributions; Hypothsis Tests; Probability; Chi-Square; Fisher's Exact Test; t-Distribution; t-test; Mann-Whitney Test; Wilcoxon Signed-Rank Test; Analysis of Variance; F-Distribution; Kruskal-Wallis Test; Friedman Test; Analysis of Covariance. Several calculators and generators include: Binomial Probability; Normal Probability; Binomial Sampling Distribution; Chi-Square Sampling Distribution.