How can I simulate voltage data caused by 1/f noise?

  • Context: Graduate 
  • Thread starter Thread starter phys_student2
  • Start date Start date
  • Tags Tags
    Spectrum
Click For Summary

Discussion Overview

The discussion revolves around simulating voltage data influenced by 1/f noise, specifically through the implementation of the "second spectrum" method. Participants explore the technical aspects of Fourier Transform applications, data segmentation, and the implications of statistical methods in analyzing noise in time series data.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant outlines a detailed algorithm for obtaining the second spectrum from a time series, including steps for segmenting data and applying Fourier Transforms.
  • Another participant questions the clarity of the original post, suggesting that a more defined mathematical or practical problem is needed to provide meaningful advice.
  • A different participant discusses the context of their investigation into 1/f noise in solid state materials, emphasizing the need for higher order statistics due to non-Gaussian scattering processes.
  • Another participant suggests that simulation can be a useful approach to tackle practical problems, proposing to think through the design of a program that simulates voltage data caused by 1/f noise.

Areas of Agreement / Disagreement

Participants express differing views on the clarity and purpose of the original question, with some seeking more context about the data and its intended use. The discussion remains unresolved regarding the best approach to segmenting data for the second spectrum analysis.

Contextual Notes

There are limitations regarding the assumptions made about the data types and the specific goals of the analysis, which may affect the applicability of the proposed methods.

phys_student2
Messages
2
Reaction score
0
I am trying to implement what's called the "second spectrum". Basically, you do this:

1. Take a time series of length N.
2. Divide it into m segment, each of length N'=N/m.
3. For each segment m, do a Fourier Transform. The result is the 'first spectrum',S_i^{(1)}(f_1), i=1,...,m
4. Divide each spectrum into n octaves, an octave starts at f_L=f_0 \times 2^p and ends at f_H=f_0 \times 2^{p+1}, where p=0,1,2, etc, and f_0 is the lowest frequency in S_i^{(1)}(f_1). For f_0 = 1 Hz, The octaves will be like: 1-2 Hz, 2-4 Hz, 4-8 Hz, 8-16 Hz, etc.
5. For each octave in each spectrum, sum all spectrum values in that octave.
6. Construct a time-series for each octave. There will be n time series each of length m.
7. Take the Fourier Transform of each time series. This is the second spectrum, S_n^{(2)}(f_2)

I have already implemented this algorithm (in c++), but I have a question about step 7. I implemented a Welch periodogram method for doing an FFT-based Power Spectral Density. This method chops the signal into segments of length L with overlapping D. Then it Fourier Transform each segment, and the final answer is the average of these transforms. The larger the number of segments, the lower the variance obtained.

But in step 7, I typically have a time series of length 32, too short to divide into segments. Should I do the PSD with one segment being the whole data, or I still have to segment it? In that case the resulting second spectrum will have too few data points to have any meaning.

(A version of this question appeared in Stack Exchange, but I got no answers)
 
Physics news on Phys.org
Your post seems to say "I have made some arbitrary decisions about a computer program whose purpose is only known to me. Please advise about what further arbitrary decisions to make."

To get an answer based on mathematics, you either need to state a mathematical question or state a practical problem. In matters involving probability, it's usually easier to state the practical problem! What is the data you are dealing iwth - financial data? electrical currents? solar flares? After you apply your program to the data, what do you intend to do with the output? Invest in the stock market? Publish a scientific paper? Win a bet with a friend?
 
I am trying to investigate 1/f noise in a solid state material across a first order phase transition. Normally, one suffice with first spectrum, but if the scattering processes responsible for the noise are non Gaussian, then you need to investigate higher order statistics. The second spectrum will give you an idea about the correlation that exist, if any, between different scatters in the material/system. The data consist of a time series of voltage fluctuations obtained using a balanced Wheatstone bridge.
 
Someone in communications engineering might give you a quick answer - that wouldn't be me!

I personally find it helpful to approach practical problems by using simulation. Even if no computer simulation is written in the end, just thinking about how to write it forces one to think about specific mathematical models. What would be a computer program to simulate voltage data caused by 1/f noise? - I mean a program that would simulate a specific time series of voltages.

Let's start with the thought of that program and then conjecture some ways it would be modified to simulate the kind of data you have.
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 19 ·
Replies
19
Views
3K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 5 ·
Replies
5
Views
6K
  • · Replies 4 ·
Replies
4
Views
5K
  • · Replies 3 ·
Replies
3
Views
1K