Ryanhersha's List: StickyStories

• doomsday scenarios could be prevented if humans can create a virtual prison to contain artificial intelligence before it grows dangerously self-aware.
• proverbial
• "It can discover new attack pathways, launch sophisticated social-engineering attacks and re-use existing hardware components in unforeseen ways," Yampolskiy said. "Such software is not limited to infecting computers and networks — it can also attack human psyches, bribe, blackmail and brainwash those who come in contact with it."
• One starting solution might trap the artificial intelligence, or AI, inside a "virtual machine" running inside a computer's typical operating system — an existing process that adds security by limiting the AI's access to its host computer's software and hardware.
• cryptography
• slow down the AI's "thinking"
• but without the sure knowledge that any of the steps would really work.
• "The Catch-22 is that until we have fully developed superintelligent AI we can't fully test our ideas,
• Never send a human to guard a machine
• That would harness the power of AI as a super-intelligent
• mere human-level intelligence could escape from an "AI Box" scenario
• "If such software manages to self-improve to levels significantly beyond human-level intelligence, the type of damage it can do is truly beyond our ability to predict or fully comprehend," Yampolskiy said.
• oracle

11 more annotations...