isaac Mao's Library tagged Entropy → View Popular

Filter:
All
Annotated

07 Oct 09

Universe Has More Entropy Than Thought / Science News

www.sciencenews.org/..._has_more_entropy_than_thought - Preview

Universe Entropy

A black hole is the entropy champ because there are myriad ways for all the material that has fallen into it to be arranged microscopically while the black hole retains the same numerical values for its observable properties — charge, mass and spin.

11 Jul 09

untitled

www.speedofcreativity.org/...-with-tmi-too-much-information - Preview

TMI Learning Information Entropy

I recorded the audio from the session and will try to publish that soon in my podcast channel. The Keynote slide deck is available on SlideShare, although we only got through half the 91 slides during the 1.5 hour videoconference.

10 Dec 08

Study: Digital universe and its impact bigger than we thought

Bits Bytes, Atoms and Quantums

www.computerworld.com/...article.do - Preview

Information Singularity entropy

by 2011, the amount of electronic data created and stored will grow to 10 times the 180 exabytes that existed in 2006, reflecting a compound annual growth rate of almost 60%.
by 2023 the number of stored bits will surpass Avogadro's number, which is the number of carbon atoms in 12 grams, or 602,200,000,000,000,000,000,000 (6.022 x 10^23).
1 more annotations...
- The study, "The Diverse and Exploding
  Digital Universe," also found that the rate at which electronic containers for that data — files, images, packets and tag contents — is growing 50% faster than the data itself

14 Jun 08

Future Positive : Front Page

futurepositive.synearth.net/...15 - Preview

ai ann entropy future order research

he concept of the "order" of information is important here, as it is not the same as the opposite of disorder. If disorder represents a random sequence of events, then the opposite of disorder should imply "not random." Information is a sequence of data that is meaningful in a process, such as the DNA code of an organism, or the bits in a computer program. Noise, on the other hand, is a random sequence. Neither noise nor information is predictable. Noise is inherently unpredictable, but carries no information. Information, however, is also unpredictable. If we can predict future data from past data, then that future data stops being information. We might consider an alternating pattern ("0101010. . . .") to be orderly, but it carries no information (beyond the first couple of bits).
but we have not achieved a deeper level of order
3 more annotations...
- Order is information that fits a purpose. The measure of order is the measure of how well the information fits the purpose. In the evolution of life-forms, the purpose is to survive. In an evolutionary algorithm (a computer program that simulates evolution to solve a problem) applied to, say, investing in the stock market, the purpose is to make money. Simply having more information does not necessarily result in a better fit. A superior solution for a purpose may very well involve less data.
- The concept of "complexity" is often used to describe the nature of the information created by an evolutionary process. Complexity is a close fit to the concept of order that I am describing, but is also not sufficient. Sometimes, a deeper order—a better fit to a purpose—is achieved through simplification rather than further increases in complexity.
- Thus improving a solution to a problem—which may increase or decrease complexity—increases order. Now that just leaves the issue of defining the problem. Indeed, the key to an evolution algorithm (and to biological and technological evolution) is exactly this: defining the problem.