Quantifying Observational Error in FWHM Measurements of Optical Signals

In summary, the author is measuring the width of a white space in a picture and wants to find the error of the average value if they say that accuracy is 1 pixel. They first have to look for specifications for the test from their MLC manufacturer or the literature and then look to the literature for tolerances that are clinically significant.
  • #1
TadyZ
5
0
Hello,

i have a optical signal(x is length in pixels and y is amplitude ) and i have found a number of FWHM values of peaks. The width is measured in pixels, let's say the average width of 50 peaks is 8,7 pixels, standard deviation is 0,6 and the average amplitude of peaks is 38 and standard deviation is 1,2. I want to find what's the error for the average value if i say that accuracy is 1 pixel.

I want to plot a graph with all the peaks, average value and to show if deviations may be caused by observational errors or something else.

I think that my attempt to find it is too simple. I just take 1/8,7 and find that the error is 11,5%.
 
Physics news on Phys.org
  • #2
All your peaks are supposed to be the same (repeated measurements of the same thing)? How did you get FWHM and amplitude? If that was a fit result, the fit result should also include the mean value and its uncertainty for every peak.

Without background, the uncertainty on the mean will follow the FWHM divided by the square root of the number of events used to determine it - with some prefactor depending on what exactly you do.
 
  • #3
No, it's not repeated measurements, in theory values suppose to be the same, but they have deviations. Amplitude is brightness of a pixel, i got FWHM using MATLAB function, this one to be exact.

If you want background:
i'm measuring width of a white space(if it's telling you something, it's picket fence test for QA of LINAC MLC) in the picture that I've attached. I need to measure it on every horizontal line and find which line has the highest deviation with respect to average value. I already did that. But i also need to find out if the deviations are not caused by observational error. In practice i know that it's not, because measurements with slightly different setting show similar results, but i need to prove it in theory.
 

Attachments

  • FiguraRI.111_1_18.png
    FiguraRI.111_1_18.png
    24.7 KB · Views: 1,127
  • #4
Matlab can do a fit to determine the central value of the peak.

Forget "number of events", sorry - I'm too used to have those instead of direct amplitude measurements.
Hmm... it might be possible to derive the expected variation of the peak positions from more fundamental principles, but you could just take the observed variance and look for outliers.
 
  • #5
@Choppy

What are the MLC manufacturers specs?
 
  • #6
I don't have specs easily accessible right now - I'm out of my home country for a couple of weeks.

In a picket fence test you should be looking for two things really:
(1) a deviation in the gap width that's significantly larger than the other gaps, and
(2) a deviation in the peak location that's significantly outside of the rest of the locations in that column. (This second one needs to assume that the mean peak location for the column correct, so it helps to have a means of verifying that.)

So really, as I believe what Gleem is getting at, is you first have to look a the specifications for the test - either from your MLC manufacturer or the literature. In principle, you could use a set of images to determine what a distribution of gap FWHMs and peak locations should look like under proper operating conditions and then use a basic statistical test for each MLC leave at each bar of the fence to see if you have a significant deviation from those, but this won't necessarily give you what you're looking for, since a statistically significant deviation does not necessarily correlate with a clinically significant difference. Instead, look to the literature for tolerances that are clinically significant.

You could start by searching LoSasso, as I believe that name is one of the big ones as far as picket fence testing goes.
 
  • #7
Yes, i know what to look for when you are making Picket Fence test, usually the deviations are visible by eye and it's really easy to spot it. It's even easier to spot when i have numerical data. I my data there are no deviations that are so big that could be considered as something out of Quality Assurance boundaries. MLC is working fine.

But my case is different, there are small deviations and i need to be really specific that I'm measuring actual positioning inaccuracy but not getting observational errors. I need it for my master thesis. So, is there a way to calculate error if I'm using FWHM method to find impulse width?
 
  • #8
So you want to find the "intrinsic" uncertainty ( better word than error) in the position of a peak having measured the width of a the peak?
 
  • #9
Yes, Gleem, you can put it like that.
 
  • #10
TadyZ said:
I want to plot a graph with all the peaks, average value and to show if deviations may be caused by observational errors or something else.

That is you want to graphically show the deviation of each peak's FWHM with respect to the mean of the data set using the this intrinsic uncertainty as a criterion for judging whether or not a peak might be deviating too much from expectation?
 
  • #11
When fitting line center, you can often have much better precision than 1 pixel by modeling the line shape properly (Gaussian, multiple Gaussians, Lorentzian, Voigt, etc.)
I think the best way to estimate the fitting error is by generating a million random lines with Poisson noise, and fitting them, and taking the standard deviation of the difference between your generated centers and your fitted centers. Make sure each generated line has a random center which can be between two pixels.
 
  • #12
gleem said:
That is you want to graphically show the deviation of each peak's FWHM with respect to the mean of the data set using the this intrinsic uncertainty as a criterion for judging whether or not a peak might be deviating too much from expectation?

Yes! :D final graph should look like this:
upload_2015-3-31_10-48-45.png

Each leaf pair(line in image below) is average width of 5 measurements(5 white lines)
figurari-111_1_18-png.81180.png

Each line pixel intensity profile looks like this:
upload_2015-3-31_10-51-49.png


I just don't know how to calculate uncertainty for FWHM.
 

Attachments

  • upload_2015-3-31_10-45-12.png
    upload_2015-3-31_10-45-12.png
    8.9 KB · Views: 593
  • #13
What is the meaning of the y-axis? Is that photon counts?
I would write a simple program that takes your curve and replaces the value at each x location with a new random value, Poisson distributed (assuming those are photon counts), with mean equal to your original curve. Then fit that new curve. Repeat many times. Each trial gives you new fit parameters. The standard deviation among the trials gives you the uncertainty of the fit due to shot noise.
 

1. What is observational error?

Observational error refers to the difference between the actual value of a measurement and the value that is recorded or observed. It is also known as measurement error and is a natural part of any scientific experiment or observation.

2. How does observational error affect scientific data?

Observational error can cause variations and discrepancies in scientific data, leading to inaccurate or imprecise results. It can also introduce bias into the data, making it difficult to draw accurate conclusions.

3. What is FWHM in relation to observational error?

FWHM stands for full width at half maximum and is a measure of the width of a peak in a graph or spectrum. In the context of observational error, FWHM is used to quantify the amount of uncertainty in a measurement due to the precision of the instruments or methods used.

4. How can scientists account for observational error in their experiments?

Scientists can minimize observational error by using precise and accurate instruments, conducting multiple trials, and using statistical analysis to identify and account for any discrepancies. It is also important for scientists to acknowledge and report any potential sources of error in their research.

5. Can observational error ever be completely eliminated?

No, observational error can never be completely eliminated. However, by using careful and rigorous methods, scientists can reduce its impact and ensure that their data is as accurate and reliable as possible.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
849
  • Introductory Physics Homework Help
Replies
15
Views
920
  • Other Physics Topics
Replies
13
Views
3K
Replies
10
Views
6K
Replies
4
Views
893
Replies
1
Views
1K
  • Other Physics Topics
Replies
4
Views
1K
  • Other Physics Topics
Replies
25
Views
3K
  • Electrical Engineering
Replies
13
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
21
Views
1K
Back
Top