Skip to main content

Diigo Home

The Nature of Order - The Diigo Meta page

futurepositive.synearth.net/...15 - Cached - Annotated View

isaac Mao's personal annotations on this page

isaacmao
Isaacmao bookmarked on 2008-02-28 ai ann entropy future order research
  • he concept of the "order" of information is important here, as it is not the same as the opposite of disorder. If disorder represents a random sequence of events, then the opposite of disorder should imply "not random." Information is a sequence of data that is meaningful in a process, such as the DNA code of an organism, or the bits in a computer program. Noise, on the other hand, is a random sequence. Neither noise nor information is predictable. Noise is inherently unpredictable, but carries no information. Information, however, is also unpredictable. If we can predict future data from past data, then that future data stops being information. We might consider an alternating pattern ("0101010. . . .") to be orderly, but it carries no information (beyond the first couple of bits).
  • but we have not achieved a deeper level of order
  • Order is information that fits a purpose. The measure of order is the measure of how well the information fits the purpose. In the evolution of life-forms, the purpose is to survive. In an evolutionary algorithm (a computer program that simulates evolution to solve a problem) applied to, say, investing in the stock market, the purpose is to make money. Simply having more information does not necessarily result in a better fit. A superior solution for a purpose may very well involve less data.
  • The concept of "complexity" is often used to describe the nature of the information created by an evolutionary process. Complexity is a close fit to the concept of order that I am describing, but is also not sufficient. Sometimes, a deeper order—a better fit to a purpose—is achieved through simplification rather than further increases in complexity.
  • Thus improving a solution to a problem—which may increase or decrease complexity—increases order. Now that just leaves the issue of defining the problem. Indeed, the key to an evolution algorithm (and to biological and technological evolution) is exactly this: defining the problem.

This link has been bookmarked by 2 people . It was first bookmarked on 28 Feb 2008, by isaac Mao.

  • 21 Mar 08
    deusx23
    l.m orchard

    kurzweil

  • 28 Feb 08
    isaacmao
    isaac Mao

    ai ann entropy future order research

    • he concept of the "order" of information is important here, as it is not the same as the opposite of disorder. If disorder represents a random sequence of events, then the opposite of disorder should imply "not random." Information is a sequence of data that is meaningful in a process, such as the DNA code of an organism, or the bits in a computer program. Noise, on the other hand, is a random sequence. Neither noise nor information is predictable. Noise is inherently unpredictable, but carries no information. Information, however, is also unpredictable. If we can predict future data from past data, then that future data stops being information. We might consider an alternating pattern ("0101010. . . .") to be orderly, but it carries no information (beyond the first couple of bits).
    • but we have not achieved a deeper level of order
    • 3 more annotations...

Top Tags