Bonus
The study of this problem was popularized after Daryl Bem reported experimental evidence for ESP. For 10 points each:
[10m] What so-called “crisis” in social science is driven by “publish or perish” culture? A John Ioannidis article on this problem claims “Most Published Research Findings Are False.”
ANSWER: replication crisis [or replicability crisis or reproducibility crisis or nonreproducibility crisis]
[10e] A proposed solution to the replication crisis lowers the threshold for this property from “p is less than 0.05” to “p is less than 0.005.” Results with this property’s “statistical” form are unlikely to have happened by chance.
ANSWER: statistical significance [or word forms like statistically significant]
[10h] Due to publication biases, even successful replications typically find lower values of this quantity. Cohen’s d estimator for this quantity equals the difference between two means over the standard deviation.
ANSWER: effect size
<Editors, Social Science>
| Editions | Heard | PPB | Easy % | Medium % | Hard % |
|---|---|---|---|---|---|
| 2 | 74 | 14.32 | 77% | 60% | 7% |
Conversion
Summary
| Tournament | Edition | Exact Match? | Heard | PPB | Easy % | Medium % | Hard % |
|---|---|---|---|---|---|---|---|
| UK (North) | UK | Y | 3 | 10.00 | 33% | 33% | 33% |
| UK (South) | UK | Y | 5 | 16.00 | 80% | 60% | 20% |
| Northern California | US | Y | 2 | 15.00 | 100% | 50% | 0% |
| Southern California | US | Y | 7 | 18.57 | 100% | 71% | 14% |
| Eastern Canada (1) | US | Y | 2 | 10.00 | 50% | 50% | 0% |
| Eastern Canada (2) | US | Y | 5 | 12.00 | 60% | 60% | 0% |
| Florida | US | Y | 2 | 5.00 | 0% | 50% | 0% |
| Great Lakes | US | Y | 10 | 14.00 | 90% | 40% | 10% |
| Lower Mid-Atlantic | US | Y | 6 | 16.67 | 83% | 83% | 0% |
| Upper Mid-Atlantic | US | Y | 1 | 20.00 | 100% | 100% | 0% |
| Midwest | US | Y | 7 | 12.86 | 86% | 43% | 0% |
| North | US | Y | 2 | 20.00 | 100% | 50% | 50% |
| Northeast | US | Y | 6 | 15.00 | 83% | 67% | 0% |
| Pacific | US | Y | 6 | 16.67 | 67% | 100% | 0% |
| Southeast | US | Y | 8 | 10.00 | 63% | 38% | 0% |
| Upstate NY | US | Y | 2 | 20.00 | 100% | 100% | 0% |