Rare Entropy and Hidden Markov

  • B
  • Thread starter Kasimir
  • Start date
  • Tags
    entropy
In summary, it is still good entropy if two rare entropy sources can be matched through an applied hidden Markov model.
  • #1
Kasimir
2
0
when selecting rare entropy sources for trng and one can see similarities trough an applied hidden markov model, will it be still good entropy?
(structure is the same, even though type of source input is different)
 
Physics news on Phys.org
  • #2
Fix typos! trng??
 
  • #3
mathman said:
Fix typos! trng??
I know that rng is usually" Random Number Generator" but I am not sure about the t part.
 
  • #4
"True" random number generator: physical source of unpredictable timing pulses. Example, scintillation counter outputs generate the next seed value for a programmable or numeric prng.

Guessing "trough" corrects to "through". Also assuming "similarities" refer to comparing output states of the various "true" or hardware random number generator sources via hidden Markov rules?
 
  • #5
I think he does not need rules. It seems a more basic question about precoditions.
 
  • #6
MarkOW said:
I think he does not need rules. It seems a more basic question about precoditions.

Thank you.

WWGD said:
I know that rng is usually" Random Number Generator" but I am not sure about the t part.

Found a low probability match for string 'rng' from algebra meaning a ring without identity matrix, not a typical beginners topic?
Op needs initial (algebraic) seed conditions?From IT using 'information entropy' sum (p(log(p)) the seed can be selected from the set of expected output values. Crypto requires an input vector seed. Programmers often use synchronization (clock) pulses as (non-crypto classical) seed sources, riding the error rate (so to speak).
 
  • #7
"Programmers often use synchronization (clock) pulses as (non-crypto classical) seed sources"

that's exactly the point. now, we do got two such input sources and apply hidden-markov. Is entropy better?
 
  • #8
Please define 'entropy' as used in question,"better than" what?.

Two homework sources can be combined and compared. Perhaps measure difference of the values, the interval between pulses or variation in pulse arrival from the expected value, to seed your prng. Design depends on requirements. As expressed on your sw/os/hw platform.

I understand commercial functions combine or mix rng outputs and error-check each value in the output buffer, filtering predictable strings. Found good info searching for <random seed> <information theory: entropy> and other concatenations.
 
  • #9
Von Neumann error correction provides measures while potentially increasing 'randomness'.
https://en.wikipedia.org/wiki/Von_Neumann_entropy

Error correction can operate above bit level described in the text but bit flip functions are fast and intrinsic. [citation?]
Emulating a pseudo-Markov-chain to test output buffer contents not difficult particularly if you already use a forward_link (flink) and backward_link (blink) and other pointers. Recursive rng functions workable at least at low frame rate, low output rates, slow applications; also limited by stack but solves 'seed source'. Recursion indicates function_trng () self-referential, also well behaved.
 
  • #10
"Programmers often use synchronization (clock) pulses as (non-crypto classical) seed sources" that's exactly the point. now, we do got two such input sources and apply hidden-markov. Is entropy better? "

I meant cryptographic seed sources and trng. It seems MarkOW was irritated.
 

1. What is rare entropy?

Rare entropy refers to the measure of the randomness or unpredictability of a rare event or occurrence. It is often used in statistical analysis to quantify the likelihood of a rare event happening.

2. What is a Hidden Markov Model (HMM)?

A Hidden Markov Model is a statistical model that is used to model systems that are assumed to be Markov processes with unknown states. It is commonly used in machine learning and data analysis for pattern recognition and prediction.

3. How does rare entropy relate to Hidden Markov Models?

Rare entropy is often used in the context of Hidden Markov Models to quantify the rare events that occur within the system being modeled. It can help identify patterns and predict future states within the model.

4. Can Hidden Markov Models be used in real-world applications?

Yes, Hidden Markov Models have a wide range of applications in various fields such as speech recognition, bioinformatics, and finance. They are useful for analyzing and predicting complex systems with unknown states.

5. Are there any limitations to using Hidden Markov Models?

While Hidden Markov Models have many applications, they do have some limitations. They assume that the system being modeled is a Markov process, which may not always be the case. They also require a large amount of data to accurately predict future states.

Similar threads

  • Thermodynamics
Replies
4
Views
375
  • Astronomy and Astrophysics
Replies
4
Views
981
Replies
12
Views
1K
Replies
13
Views
1K
Replies
17
Views
1K
Replies
1
Views
1K
  • Special and General Relativity
Replies
6
Views
977
  • Thermodynamics
Replies
3
Views
943
Replies
2
Views
2K
Replies
5
Views
1K
Back
Top