Separating background data from expected data

  • Context: Graduate 
  • Thread starter Thread starter majormuss
  • Start date Start date
  • Tags Tags
    Data
Click For Summary

Discussion Overview

The discussion revolves around the challenge of separating background data from expected data in a research context, focusing on statistical methods suitable for this task. Participants explore the characteristics of the data, including the expected behavior and variability of the background.

Discussion Character

  • Exploratory, Technical explanation, Debate/contested

Main Points Raised

  • One participant seeks advice on the best statistical method to distinguish between background data and expected data, noting that the expected data should be approximately constant while the background is more variable.
  • Another participant emphasizes the need for more information about the background, suggesting that estimates for its shape or magnitude are necessary for effective separation.
  • A later reply reiterates the need for background information and clarifies that the background consists of peaks while the expected data is approximately flat.
  • One participant questions the identification of the peaks, suggesting that they may appear as random fluctuations instead. They propose that if a constant signal is expected, the best estimate for the signal could be the average of all points, adjusted for any background offset, while noting that the initial description lacks clarity.

Areas of Agreement / Disagreement

Participants express differing views on the nature of the background data and the expected signal, indicating that the discussion remains unresolved with multiple competing perspectives on how to approach the problem.

Contextual Notes

The discussion highlights limitations in the initial description of the data and the need for clearer definitions of the background and expected data characteristics.

majormuss
Messages
124
Reaction score
4
Hi all,
I was hoping if someone can tell me what's the best way to separate background from expected. I have attached a picture of a representative graph. The data points are not real but the behavior is similar to what I expect to get from my research. The data I expect is supposed to be approximately constant across the graph and the background is more variable. Hence, the background in my picture will probably be the peaks. However, I am not sure what statistical method to use or which would be best suited for my research.
 

Attachments

  • 1212.jpg
    1212.jpg
    3.5 KB · Views: 410
Last edited:
Physics news on Phys.org
You will need more information about the background. Some estimate for the shape, the magnitude or something else.
 
mfb said:
You will need more information about the background. Some estimate for the shape, the magnitude or something else.
I have made changes to my question. The background are the peaks and the expected data is approximately flat.
 
Which peaks? Looks like random fluctuations to me.

Do you expect a constant signal plus random fluctuations around this signal, centered at the signal or at some other value? Then your best estimate for the signal is the average of all those points, minus the offset if the background has one.
The description is still very vague.
 

Similar threads

Undergrad Is there a way to calculate expected value from probabilistic data?
  • · Replies 76 ·
3
Replies
76
Views
7K
Graduate How to set up and interpret Chi^2 test results for my data?
  • · Replies 11 ·
Replies
11
Views
4K
Undergrad Linear Regression, Population, Sample
  • · Replies 4 ·
Replies
4
Views
2K
Undergrad Observational Studies: What to Believe
  • · Replies 3 ·
Replies
3
Views
3K
Graduate Mathematical Connection between Cosmic Expansion and Exponential Growth
  • · Replies 24 ·
Replies
24
Views
3K
Graduate How can background be separated from 1D data with data smoothing/filtering?
  • · Replies 6 ·
Replies
6
Views
3K
Graduate Separating gamma-ray signals from background
  • · Replies 4 ·
Replies
4
Views
1K
Undergrad What are the commonly used estimators in regression models?
  • · Replies 23 ·
Replies
23
Views
4K
Graduate The Blessings of Dimensionality and Hilbert's 6th Problem
  • · Replies 4 ·
Replies
4
Views
3K
Undergrad Linear fit on the difference of data points
  • · Replies 26 ·
Replies
26
Views
3K