ESTONIAN engineer and entrepreneur Jann Tallinn:
“Evolution is an optimisation process.” Jaan says.
“It is trying to optimise the fitness of organisms against a background of environment and (that’s) also like machine-learning,” he said.
“Evolution actually made a sort of mistake in a sense that it actually created primates with optimisation ability and that optimisation ability got powerful enough to actually understand evolution. It actually created something that was more powerful than itself.”
Jaan’s point is that humans are on the verge of potentially repeating that mistake.
Artificial intelligence, in other words, leading to a “singularity”. The creation of intelligence more powerful than humanity’s represents a point beyond which prediction becomes impossible. Would powerful AI lead to a new technological utopia or humanity’s enslavement and destruction? Hard to say.
How should we think about long-term risk—greater than 30 years out, say—in a world in which the development of powerful AI is a realistic possibility?
Powered by Facebook Comments