| ??? 05/19/06 16:11 Modified: 05/19/06 16:44 Read: times |
#116681 - a loony replies,its all in the entropy. Responding to: ???'s previous message |
The amount of compression which you can apply to any data set depends on its entropy which is basically a measure of randomness or how much information a set of data contains,and has a direct analogue in thermodynamic entropy.
The mathematical definition of entropy in an information theory context if youve got n possible symbols which can occur then the entropy is the sum of the probability of a symbol appearing multiplied by the log of the surprisal of the symbol appearing.Where the surprisal is the inverse of the probability.It can be thought of as a measure of the amount of information carried by each symbol.English has an entropy of about 1.5 bits per charcter.Time for more dried frog. I forgot, this definition is really due to Shannon who was looking at a mathematical treatment of the information capacity of communication channels. http://en.wikipedia.org/wiki/Claude_Elwood_Shannon |
| Topic | Author | Date |
| Ram Compression | 01/01/70 00:00 | |
| Elaborate please ? | 01/01/70 00:00 | |
| Ram compression | 01/01/70 00:00 | |
| What kind of data are we looking at ? | 01/01/70 00:00 | |
| Further elaboration | 01/01/70 00:00 | |
| ram compression | 01/01/70 00:00 | |
| Extra bytes | 01/01/70 00:00 | |
| In that case ... | 01/01/70 00:00 | |
| Yes it can | 01/01/70 00:00 | |
| Information | 01/01/70 00:00 | |
| Err... | 01/01/70 00:00 | |
| Hang on a minute | 01/01/70 00:00 | |
| Information vs. Meaning | 01/01/70 00:00 | |
| How about helping rather than ridiculing | 01/01/70 00:00 | |
| NOT ridiculing | 01/01/70 00:00 | |
| syntax error | 01/01/70 00:00 | |
| a loony replies,its all in the entropy. | 01/01/70 00:00 | |
| sparse data | 01/01/70 00:00 | |
| Run-length encoding? | 01/01/70 00:00 | |
| proper run length coding | 01/01/70 00:00 | |
| But how do you know... | 01/01/70 00:00 | |
| slight mistake | 01/01/70 00:00 | |
| By definition! | 01/01/70 00:00 | |
| go outside the box | 01/01/70 00:00 | |
| Or more RAM | 01/01/70 00:00 | |
if 256 byte not sufficient | 01/01/70 00:00 |