Combining data from replicated experiments?

  • Thread starter Thread starter gravenewworld
  • Start date Start date
  • Tags Tags
    Data Experiments
Click For Summary

Discussion Overview

The discussion revolves around the methodology for combining data from replicated experiments, specifically in the context of analyzing fluorescence measurements for CYP activity. Participants explore whether to combine raw data from multiple experiments or analyze each experiment's data separately before combining results.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant questions whether to combine all results into a single dataset or analyze triplicates individually before combining.
  • Another participant asks if the experiments were conducted identically across all trials, seeking clarification on the consistency of the methodology.
  • A participant suggests that combining all nine results could yield the same final results and error, recommending the calculation of the mean and standard error on the mean.
  • Some participants propose examining the variance between experiments conducted on different days compared to the variance within the same day to assess reproducibility.
  • There is a suggestion that if the variance is similar, combining the data is justified, but if not, treating each set of triplicates as independent may be necessary.
  • A later reply raises the question of whether a meta-analysis would be required if treating the experiments as independent measurements due to observed differences in results.
  • One participant notes that if experiments were identical, combining the data as a dataset with N=9 is likely justified, while acknowledging that significant differences between days could necessitate independent treatment of the data.

Areas of Agreement / Disagreement

Participants express differing views on the best approach to data combination, with no clear consensus reached. Some advocate for combining all data, while others emphasize the importance of analyzing variance and considering independent measurements.

Contextual Notes

Participants highlight potential limitations related to the consistency of experimental conditions across different days and the implications of variance in measurements, but do not resolve these issues.

gravenewworld
Messages
1,129
Reaction score
27
How do you go about combining data from replicated experiments?

Should you just combine everything into one big set of data and then analyze it, or do you analyze the data from each experiment, and then combine the analyzed data into one set of finalized data? I'm not too sure on what to do, and have been googling for some answers, but there seems to be no clear consensus I can find. Basically all I did was run an experiment where I tested X compound at only 1 concentration for CYP activity by measuring fluorescence. Each experiment I ran I had triplicates. I ran the experiment 3 times. So do I combine the 9 results or analyze the triplicates individually and somehow combine them? I've never had a stats class so am struggling a bit with biostats/data analysis.
 
Physics news on Phys.org
Each time you ran the experiment did you run it the same way? I mean was each triplicate ran identically, and each of the 3 times run identically too?
 
Rooted said:
Each time you ran the experiment did you run it the same way? I mean was each triplicate ran identically, and each of the 3 times run identically too?

Yes and yes.
 
I'm not familiar with the particular experiment - what kind of output did you get from each run, a single value or a histogram or something?
 
Just a single value for fluorescence. A relative light unit.
 
If it was me I would combine all 9, I think I've done something similar in the past and worked out that either way of combining the results actually gives the same final results and error, but I would do a mean, and standard error on the mean for the 9 results. The standard error on the mean reduces the error on the mean by a factor of sqrt N, where N is the number of readings.
 
Alright thanks.
 
Sometimes it's worth trying different types of analysis to see if they all converge on the same result. For example, you could examine all three sets of triplicates separately. If the variance between the experiments done on different days is similar to the variance within measurements take on the same day, that's good evidence that the experiment is reproducible and you can combine the measurements from the different days (and have a dataset of N=9). However, if you see that the measurements on different days are much less consistent than measurements done on the same day, you may want to use each set of triplicates as an independent measurement (and have a dataset of N=3).
 
Ygggdrasil said:
Sometimes it's worth trying different types of analysis to see if they all converge on the same result. For example, you could examine all three sets of triplicates separately. If the variance between the experiments done on different days is similar to the variance within measurements take on the same day, that's good evidence that the experiment is reproducible and you can combine the measurements from the different days (and have a dataset of N=9). However, if you see that the measurements on different days are much less consistent than measurements done on the same day, you may want to use each set of triplicates as an independent measurement (and have a dataset of N=3).

So would this require a meta analysis in order to combine all of the data if I treated this as 3 independent measurements? 2 of the experiments seem to be close together while the 3rd one seems to be different. The assay was run from the same kit, the same conditions, just on different days.
 
  • #10
If the experiments were pretty much identical on different days, then you are probably justified in combining the data as a data set with N=9.

If there were potentially important differences between the days (for example if the assay involves cells and you grew up different batches of cells for the experiments on each day), it would make more sense to treat the the data from each day as an independent measurement, and calculate the average and standard deviation from the set of three averages obtained on different days.
 

Similar threads

Replies
27
Views
3K
Replies
11
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 12 ·
Replies
12
Views
4K
Replies
9
Views
2K
Replies
3
Views
6K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
Replies
28
Views
4K
  • · Replies 24 ·
Replies
24
Views
2K