Calculating signal to noise ratio for deimos data

Click For Summary

Discussion Overview

The discussion revolves around the quantification of noise in 1D DEEP2 DEIMOS fits files, focusing on defining exclusion criteria for data analysis in Python 2.7. Participants explore methods to identify and handle noisy and unpredictable data behaviors.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant inquires about the best method to quantify noise in the DEIMOS data.
  • Another participant suggests calculating the RMS value as a potential approach to quantify noise.
  • A later reply expresses concern about the unpredictable behavior of the data, mentioning issues such as sudden drops to zero flux and fluxes appearing symmetric about the zero line.
  • There is a suggestion to develop a theory regarding the impact of instrumentation on the data and to create corrections based on that theory.

Areas of Agreement / Disagreement

Participants do not reach a consensus on a specific method for quantifying noise, and multiple competing views regarding data handling and theory development are present.

Contextual Notes

Participants express uncertainty regarding the nature of the noise and its effects on data interpretation, highlighting the complexity of distinguishing between instrumental noise and actual measurements.

Curtnos
I'm currently working with the 1d DEEP2 DEIMOS fits files (see http://deep.ps.uci.edu/deep3/specprimer.html) and am trying to define some exclusion criteria in Python 2.7 for the data based on the noise. What's the best way to quantify the noise in order to do this?

Thank you!
 
Astronomy news on Phys.org
Curtnos said:
I'm currently working with the 1d DEEP2 DEIMOS fits files (see http://deep.ps.uci.edu/deep3/specprimer.html) and am trying to define some exclusion criteria in Python 2.7 for the data based on the noise. What's the best way to quantify the noise in order to do this?

Thank you!
Calculate the RMS value?
 
berkeman said:
Calculate the RMS value?
I should have added, a lot of the data is showing very odd and unpredictable behaviour. I'm unsure how to edit the original question, however I was hoping to find a more general method to both discount noisy data and bad data which fluctuates unpredictably. Some have sudden, repeated drops to zero flux, some have fluxes which appear symmetric about the flux = 0 line, some look like step functions, etc.
 
when separating data that originates in instrumentation, from data that is due to measurement of real things.

develop and justify a theory of what the instrumentation does to the data.

develop corrections that follow exactly that theory.
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 25 ·
Replies
25
Views
4K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 19 ·
Replies
19
Views
8K
  • · Replies 4 ·
Replies
4
Views
8K
  • · Replies 0 ·
Replies
0
Views
3K
  • · Replies 18 ·
Replies
18
Views
4K