Hi -(adsbygoogle = window.adsbygoogle || []).push({});

First timer here. Excuse me if this question is not up to the level i see posted on this forum, but here goes.

I have been asked to provide a daily signal generated from the number of occurrences of a set of specified phrases present in a news data feed. The first thing I did is generate a moving average from the daily count of each phrase in the feed and generate a signal if the current count was above the moving average by a specified percentage. Using this approach I didn't think the signal provided much value beacuse the phrase counts are very bursty. The count can be in the low teens for a number of days in a row and then jump to a 100 for a couple of days and then settle back into the low teens.

What type of statistics should I use to determine a statistically significant event given my scenario described above?

Thanks in advance

**Physics Forums - The Fusion of Science and Community**

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Statistics for bursty data

Loading...

Similar Threads - Statistics bursty data | Date |
---|---|

B The Drunkard's Walk: A Discussion of the Text | Mar 8, 2018 |

A Interpreting Chi Squared ... backward | Feb 11, 2018 |

I R-squared statistic for goodness-of-fit | Nov 28, 2017 |

I Standard deviation of data after data treatment | Oct 15, 2017 |

**Physics Forums - The Fusion of Science and Community**