Is this a Formal (Statistical) Fallacy?

  • Context: Graduate 
  • Thread starter Thread starter WWGD
  • Start date Start date
  • Tags Tags
    Statistical
Click For Summary
SUMMARY

The discussion centers on the identification of a statistical fallacy related to analyzing non-representative subsamples of a population. Participants explore examples such as the GRE test's predictive power, height's correlation with scoring in basketball, and hand-eye coordination's relationship with batting averages in baseball. The fallacy is linked to concepts like sampling bias and the fallacy of composition, with references to Berkson's Paradox as a related concept. The need for a specific name for this fallacy is emphasized, highlighting its implications in statistical analysis.

PREREQUISITES
  • Understanding of statistical concepts such as sampling bias and correlation.
  • Familiarity with Berkson's Paradox and its implications in statistics.
  • Knowledge of the Fallacy of Composition and its relevance in statistical reasoning.
  • Basic grasp of predictive analytics and its application in standardized testing.
NEXT STEPS
  • Research the implications of sampling bias in statistical studies.
  • Explore the Fallacy of Composition in greater detail and its applications.
  • Investigate Berkson's Paradox and its relevance to non-representative samples.
  • Learn about predictive validity in standardized tests like the GRE.
USEFUL FOR

Statisticians, data analysts, researchers, and educators interested in understanding the implications of statistical fallacies and improving the accuracy of predictive models.

WWGD
Science Advisor
Homework Helper
Messages
7,773
Reaction score
13,008
TL;DR
Fallacy on a supposed falsification of a correlation by looking at a subset of the population.
Hi All,
I have recently read about a fallacy that seems to be based on looking at a non-representative subsample of the population. I would like to know if this goes by a name and if it has been formalized. It just seems the problem is that of considering a variable within a subpopulation and not within the whole population ( here population referring to actual people). It is then concluded that the variable in question has no effect on other variables of interest.

Here are two examples:
1) The GRE test is artificial, without any real predictive power: It does not correlate with GPA in graduate school, nor with other measures of success. But, when considered within the population of , say, adults, a high GRE test does correlate highly with variables as income, job satisfaction, etc.

2) Like in 1), we can argue that height does not highly correlate with the ability to score: even as NBA players differ in several inches in height, their total points totals are the same

3)Hand-eye coordination and batting average in Baseball. Say we could find numerical measures. These do not correlate with batting average, WAR or slugging average.

Does this fallacy have a name? Is it based on other than just considering a subsample, a sort of survivorship bias?
 
Physics news on Phys.org
It isn't the same thing per se, but this feels 'close' to Berkson's Paradox
 
  • Like
Likes   Reactions: WWGD

Similar threads

  • · Replies 40 ·
2
Replies
40
Views
8K
  • · Replies 24 ·
Replies
24
Views
4K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 45 ·
2
Replies
45
Views
6K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 5 ·
Replies
5
Views
5K
  • · Replies 15 ·
Replies
15
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K