Skewness, logarithm and reversing in statistics

  • Context: Graduate 
  • Thread starter Thread starter Drudge
  • Start date Start date
  • Tags Tags
    Logarithm Statistics
Click For Summary
SUMMARY

The discussion centers on the transformation of negatively skewed data in the context of applying parametric tests, specifically Pearson product-moment correlation. Participants clarify that reversing the data (changing its sign) and applying a logarithmic transformation is a method to achieve a more normal distribution, which is necessary for certain statistical tests. It is established that logarithmic transformations do not correct negative skewness, and the reversal is intended to create a positive skew, making the data suitable for analysis. The conversation emphasizes the importance of understanding the assumptions behind parametric tests and the limitations of transformations.

PREREQUISITES
  • Understanding of statistical distributions, specifically skewness
  • Familiarity with logarithmic transformations in statistics
  • Knowledge of parametric tests and their assumptions
  • Experience with Pearson product-moment correlation
NEXT STEPS
  • Research the implications of skewness on statistical tests
  • Learn about different data transformation techniques for normalizing distributions
  • Explore the assumptions of various parametric tests beyond Pearson correlation
  • Investigate the effects of data transformations on confidence intervals and means
USEFUL FOR

Statisticians, data analysts, and researchers involved in quantitative studies who need to understand data transformation techniques for applying parametric tests effectively.

Drudge
Messages
30
Reaction score
0
I need some advice,

What could it possibly mean, in an article I am studying, where the results of a test (visual-spatial working memory) in relation to a variable (Maths skills in kids) is being discussed as follows:

"The distribution of the variable was so negatively skewed, that it was reversed and then logarithm was used to enable parametric tests"

Of course these are in my own words (I´m reading in finnish), but I don´t think I have left anything important out. So I know what skewness and logarithm are, but I am puzzled about the reversing? Why would you reverse a distribution? To enable parametric tests? Why?
 
Physics news on Phys.org
I assume they mean that they "reversed" the data so that it had a positive skew, and then took the logarithm (a common transformation for normalizing positively skewed data).
 
Drudge said:
Why would you reverse a distribution? To enable parametric tests? Why?

I'll guess that the answer to that depends on the particular parametric tests that were used. What were they?

I don't know what "reverse" means. Did they define a new distribution g(x) by g(x) = f(-x) where f was the old distribution?
 
Number Nine said:
I assume they mean that they "reversed" the data so that it had a positive skew, and then took the logarithm (a common transformation for normalizing positively skewed data).

Yes, reversed and then logarithm. But why does it have to be reversed? What´s the idea?

Why can´t parametric tests be applied to negatively skewed data?

Stephen Tashi said:
I'll guess that the answer to that depends on the particular parametric tests that were used. What were they? ?

None are specified. The only thing that is said is that they are using Pearson product-moment correlation (and "partial correlation"?).
 
Yes, reversed and then logarithm. But why does it have to be reversed?

The logarithm will not correct a negative skew.

Why can´t parametric tests be applied to negatively skewed data?

Because all statistical tests have assumptions. Many standard parametric tests don't work well with heavily skewed data.
 
Number Nine said:
The logarithm will not correct a negative skew.

Yes I understand

Number Nine said:
Because all statistical tests have assumptions. Many standard parametric tests don't work well with heavily skewed data.

O, is it to make the distribution more like a normal distribution, or to "normalize" it, because only normal distributions are compatible with parametric tests?

EDIT: No wait, I don´t. you mean logarithm does not fix skewness? If parametric tests don´t work on heavily skewed data, and logarithm does not fix skewness and reversing only changes the sign (from negative to positive) of the skewness, what help was there to reverse and do logarithm?
 
Last edited:
I believe what the authors were attempting to do was to normalize the data, so that they can apply standard statistical test to the data and then transform the information back to the original scale. This is possible for some skew data, but not all. It's impossible for us to say if it was reasonable to do so without looking and understanding the methods used. Nevertheless, the author probably felt that taking the log and applying statistical test could give a reasonable mean and confidence interval. (As far as I know the s.d. should not be transformed.)
 
Drudge said:
because only normal distributions are compatible with parametric tests?

There are many parametric tests that require that the distributions involved be normal. Not all parametric tests require this.
 
Number Nine said:
I assume they mean that they "reversed" the data so that it had a positive skew, and then took the logarithm (a common transformation for normalizing positively skewed data).

So logarithm fixes positively skewed data, but not negatively skewed, and hence the reverse?
 

Similar threads

  • · Replies 14 ·
Replies
14
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 2 ·
Replies
2
Views
1K