Statistical significance

In summary, the conversation discusses the process of estimating the statistical significance of a peak value at 30 Hz compared to other smaller peaks. The speaker suggests estimating the mean values and calculating the standard deviation to determine a 99.97% certainty of a significant difference. However, it is also mentioned that the signals do not follow a normal distribution, and the probability of the peak value being this high by chance should be considered.
  • #1
rnielsen25
25
1
Member warned to use the homework template in future posts
21156kk.jpg


Hi everyone.

What you see here is er Fourier spectra.
If i want to conclude that there is a statistical significance difference between the peak value around 30 hz, and all the other smaller peaks.

Should i do as following.
Estimate the mean value as 2. Estimate the mean peak value to around 3. And last estimate the mean lowest peak value as 1.

Then calculate the standard deriviation to 1,225.

And after that, i could calculate 5 times sigma to 6,124.

And because the peak value is around 13, and therefore is bigger than 6,124. I can conclude with 99,97% certainty, that there is a significance difference between the peak value and the other peak values.

Is it right, what I'm doing here?
 
Physics news on Phys.org
  • #2
This depends on your hypothesis: Did you look specifically for a peak at 30 Hz or do you want to estimate the significance of observing a signal of this intensity at any frequency?
Also, your signals don't seem to follow a normal distribution. Do you know how your intensities should be distributed given the null hypothesis?
 
  • #3
DrDu said:
This depends on your hypothesis: Did you look specifically for a peak at 30 Hz or do you want to estimate the significance of observing a signal of this intensity at any frequency?
@Nicklas , to elaborate on DrDu's point, suppose you had millions of datapoints similar to the general background in your sample. It might not then be surprising that some value somewhere exceeds many sigma. So if this is data mining you should consider the probability that the peak in the whole data would be this high by chance.
 

What is statistical significance?

Statistical significance is a measure of the likelihood that the results of a study or experiment are not due to chance. It indicates whether the observed differences between groups or variables are truly significant or just a result of random variation.

Why is statistical significance important?

Statistical significance helps researchers determine whether their findings are reliable and can be generalized to a larger population. It also allows for the comparison of different studies and helps to identify patterns and relationships between variables.

How is statistical significance calculated?

Statistical significance is typically calculated using statistical tests such as the t-test or ANOVA. These tests compare the observed data to a null hypothesis, which assumes that there is no significant difference between groups or variables. The resulting p-value indicates the likelihood of obtaining the observed results by chance.

What is the significance level in statistical significance?

The significance level, also known as alpha, is the predetermined threshold used to determine whether the results of a study are statistically significant. It is typically set at 0.05, meaning that there is a 5% chance of obtaining the observed results by chance alone. A lower significance level indicates a higher level of confidence in the results.

What are some limitations of statistical significance?

Statistical significance does not necessarily indicate a strong or meaningful relationship between variables, as it only measures the likelihood of obtaining the observed results by chance. It also does not take into account the size of the effect or the practical significance of the findings. Additionally, statistical significance is affected by sample size, so larger studies may be more likely to find significant results even if the effect size is small.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
22
Views
2K
  • Precalculus Mathematics Homework Help
Replies
1
Views
506
  • Precalculus Mathematics Homework Help
Replies
15
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
440
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
1K
Replies
4
Views
939
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
18
Views
3K
Replies
3
Views
2K
Back
Top