Email: Password: Remember Me | Create Account (Free)

Back to Subject List

Old thread has been locked -- no new posts accepted in this thread
???
12/19/07 18:19
Read: times


 
#148521 - Quantifying randomness
Responding to: ???'s previous message
Several years ago I developed a mathematical definition which quantifies randomness using fractal dimension theory. Calculate the information dimension of a finite set of data and the capacity dimension of the space the set occupies. The ratio of those two dimensions, alwaye less than or equal to unity (unity denoting pure or perfect randomness), can be defined as the mathematical randomness of the set.

It's important to distinguish between the randomness of a set of data, and the randomness of the process that generated it. A purely random process, like tossing a hundred coins into the air, could possibly generate a non-random result like one hundred heads-up coins. But if you walk into a room and find one hundred coins all lying heads up, you'll never consider that data set random regardless how it was produced. Similarly, picking lotto balls from the lotto machine could produce a sequence of 1, 2, 3, 4, 5, 6. But if you walked into the room and found the lotto balls 1, 2, 3, 4, 5, and 6 layed out in a row, you'd never consider that set random, again regardless of the process that produced it.

Conversely, there is absolutely nothing random about an algorithm. It is wholly, completely deterministic. There is nothing random whatsoever about which number will be produced next. However, the set produced can be quite random. The problem is that most people still do not divorce the result from the process. Consequently, people are forced to adopt such handwaving "definitions" as pseudorandomness, which are not well defined at all.

My definition, and susequent method of evaluation, divorces the result set from the process which produced it, allowing the randomness of the finite set to be evaluated and quantified.

To evaluate the randomness of a set generated by a given algorithm, simply iterate the calculation for the generated set, adding the next random number generated each time. Plot the ratio on a graph. The slope of the line is the randomness of the data set, and as long as the slope of the graph remains linear, the algorithm is producing numbers of that randomness. This allows you to test a given algorithm, not only to see how random the numbers it generates are, but how long it will contiue to produce them as well.

Some will produce random numbers for a while, but then will become much less random, or non-random, after a certain number. One famous example is RANDU of IBM fame. This test reveals the point at which this happens.

Since it is derived from fractal dimension theory, my definition is a general case which applies to data sets in any R-dimension (R = real number) space, not just in I-dimension (I = integer) space. Interestingly though, in an appropriately restricted case it reduces to the Chi-squared calculation mentioned previously.

Someday I really need to write this up and get it published.

Joe


List of 53 messages in thread
TopicAuthorDate
let's discuss random numbers            01/01/70 00:00      
   Radomness            01/01/70 00:00      
   chi squared....            01/01/70 00:00      
      51 related            01/01/70 00:00      
   how random is "Random"?            01/01/70 00:00      
      Quantifying randomness            01/01/70 00:00      
   Use one table in the memory            01/01/70 00:00      
   no 'mathematical solution can do that            01/01/70 00:00      
      I like your response            01/01/70 00:00      
   ADC and noise            01/01/70 00:00      
      reminds me of a funny story            01/01/70 00:00      
         Simple local shielding would have helped            01/01/70 00:00      
         Bad design!            01/01/70 00:00      
   The counter and button seems perfect to me            01/01/70 00:00      
   Not sure why people have problems with RNG            01/01/70 00:00      
      what I got out of all of this            01/01/70 00:00      
         Not quite?            01/01/70 00:00      
            And if there isn't a button?            01/01/70 00:00      
         no            01/01/70 00:00      
         More Not Quite            01/01/70 00:00      
            chi square isn't enough            01/01/70 00:00      
               Quantified randomness            01/01/70 00:00      
      By Definition            01/01/70 00:00      
      RNG schemes can be malicious!            01/01/70 00:00      
   pseudo IS pseudo, not random            01/01/70 00:00      
   A really good reference            01/01/70 00:00      
   Is radioactive decay truely random?            01/01/70 00:00      
      Correction            01/01/70 00:00      
      Is anything truly random?            01/01/70 00:00      
         Chaos is...            01/01/70 00:00      
            Chaos is not random.            01/01/70 00:00      
               I didnt tell that it is random            01/01/70 00:00      
   Visual randomness test            01/01/70 00:00      
      Las Vegas            01/01/70 00:00      
      Only for an indefinite number of pixels            01/01/70 00:00      
         How about a coin toss experiment, sort of.            01/01/70 00:00      
            Set of what ?            01/01/70 00:00      
               But my point is that you can know.            01/01/70 00:00      
                  This is wrong, sorry!            01/01/70 00:00      
                     Are you even reading what I wrote?            01/01/70 00:00      
                        A random system is....            01/01/70 00:00      
                           AKA the LCE            01/01/70 00:00      
                           Random is            01/01/70 00:00      
                        Of course, I did            01/01/70 00:00      
                           Before we proceed, ...            01/01/70 00:00      
                              Randomness versus determinism            01/01/70 00:00      
                                 Applying the uncertainty principle            01/01/70 00:00      
                                    Thanks            01/01/70 00:00      
                                       You're welcome            01/01/70 00:00      
                  It is still Random            01/01/70 00:00      
            Depends            01/01/70 00:00      
   Normal distribution.            01/01/70 00:00      
   A random # generator circuit.            01/01/70 00:00      

Back to Subject List