The development of superintelligent AI threatens to kick off a new technological Cold War, warned a leading artificial intelligence researcher who foresees the emerging technology tipping the military balance between the U.S. and its rivals.
Dan Hendrycks, the director of the Center for AI Safety, delivered his warning on the Threat Status weekly podcast, explaining how superintelligent AI systems risk destabilizing geopolitics.
He defined superintelligent AI as “smarter than all people at basically all things.”
Along with other prominent AI researchers, he authored a paper titled “Superintelligence Strategy” that proposed a deterrence strategy for AI systems similar to that of the Cold War nuclear strategy.
“In the Cold War, we had deterrence with mutual destruction. We had nonproliferation of fissile materials to rogue actors, and we needed to focus on containment of the Soviet Union,” Mr. Hendrycks said. “And in the case of China, that largely looks like strategic competition. So ours is also about deterrence, nonproliferation and strategic competition.”
This becomes increasingly dangerous, Mr. Hendrycks said, due to superintelligent AI’s potential resistance to modification. According to Mr. Hendrycks, as AI models scale up they have a stronger resistance to having their value systems changed. He says that researchers will need to work hard to create models that reflect the values of the public, especially as AI becomes more powerful.
Complete Article
m.washingtontimes.com
Dan Hendrycks, the director of the Center for AI Safety, delivered his warning on the Threat Status weekly podcast, explaining how superintelligent AI systems risk destabilizing geopolitics.
He defined superintelligent AI as “smarter than all people at basically all things.”
Along with other prominent AI researchers, he authored a paper titled “Superintelligence Strategy” that proposed a deterrence strategy for AI systems similar to that of the Cold War nuclear strategy.
“In the Cold War, we had deterrence with mutual destruction. We had nonproliferation of fissile materials to rogue actors, and we needed to focus on containment of the Soviet Union,” Mr. Hendrycks said. “And in the case of China, that largely looks like strategic competition. So ours is also about deterrence, nonproliferation and strategic competition.”
This becomes increasingly dangerous, Mr. Hendrycks said, due to superintelligent AI’s potential resistance to modification. According to Mr. Hendrycks, as AI models scale up they have a stronger resistance to having their value systems changed. He says that researchers will need to work hard to create models that reflect the values of the public, especially as AI becomes more powerful.
Complete Article
The new Cold War: Superintelligent AI poised to radically change U.S. defense
The development of superintelligent AI threatens to kick off a new technological Cold War, warned a leading artificial intelligence researcher who foresees the emerging technology tipping the military balance between the U.S. and its rivals.
m.washingtontimes.com
