AP/ November 25, 2012, 3:31 PM

Will artificial intelligence be the end of us?

Hal 9000, the supercomputer who commits murder in Stanley Kubrick's "2001: A Space Odyssey."

Hal 9000, the supercomputer who commits murder in Stanley Kubrick's "2001: A Space Odyssey." / MGM

LONDON Could computers become cleverer than humans and take over the world? Or is that just the stuff of science fiction?

Philosophers and scientists at Britain's Cambridge University think the question deserves serious study. A proposed Center for the Study of Existential Risk will bring together experts to consider the ways in which super intelligent technology, including artificial intelligence, could "threaten our own existence," the institution said Sunday.

"In the case of artificial intelligence, it seems a reasonable prediction that some time in this or the next century intelligence will escape from the constraints of biology," Cambridge philosophy professor Huw Price said.

When that happens, "we're no longer the smartest things around," he said, and will risk being at the mercy of "machines that are not malicious, but machines whose interests don't include us."

Fears that machines could overtake humans have long been the subject of science fiction — the computer HAL in the movie "2001: A Space Odyssey," for example, is one of film's best-known computer threats.

Price acknowledged that many people believe his concerns are far-fetched, but insisted the potential risks are too serious to brush away.

"It tends to be regarded as a flakey concern, but given that we don't know how serious the risks are, that we don't know the time scale, dismissing the concerns is dangerous. What we're trying to do is to push it forward in the respectable scientific community," he said.

While Price said the exact nature of the risks is difficult to predict, he said that advanced technology could be a threat when computers start to direct resources towards their own goals, at the expense of human concerns like environmental sustainability.

He compared the risk to the way humans have threatened the survival of other animals by spreading across the planet and using up natural resources that other animals depend upon.

Price is co-founding the project together with Cambridge professor of cosmology and astrophysics Martin Rees and Jann Tallinn, one of the founders of the internet phone service Skype.

The university said Sunday the center's launch is planned next year.

© 2012 The Associated Press. All Rights Reserved. This material may not be published, broadcast, rewritten, or redistributed.
45 Comments Add a Comment
linkicon reporticon emailicon
dobermantmacleod says:
Predictably, AI would be deliberately engineered into a weapon (i.e. a "threat") a la Megatron. BTW, before AI there will be human intelligence augmentation using synthetic neocortex extenders. In other words, biology will merge with machine, and hybrid super-intelligence will emerge, starting in a decade or two (they already have proven in lower animals that you can seamlessly merge a biological neocortex with a synthetic one).
reply
linkicon reporticon emailicon
medicalquack says:
It's not going to happen the way written here but much of it, in the financial world is already in place, it's all about math and the formulas. 4 videos that will educate you quickly. It's why Wall Street always wins too as consumers hate math. So much of society is Algo Duped and it happens outside the financial areas as well.

http://www.ducknet.net/attack-of-the-killer-algorithms/

Here's a good official study on how the use of math makes people physically hurt and based on what I see and hear I think they are on to something as you never hear this in the news, it's always the drama queen stuff anymore sadly.

http://ducknetweb.blogspot.com/2012/10/algo-duping-plos-one-journal.html
reply
linkicon reporticon emailicon
Scimajor says:
"Philosophers and....."

The importance of the study was immediately brought into question with the first word of this sentence. Philosophers are still wondering if the table in front of them is actually there or not while the rest of us roll our eyes and deal with more important questions like "Ginger or Mary-Anne".
reply
linkicon reporticon emailicon
Godfrei99 says:
Though most of these comments are off-point and inane, if anyone has an honest interest in the topic, you may find that Oxford's FHI to be useful: http://www.fhi.ox.ac.uk/our_staff/research/nick_bostrom
reply
linkicon reporticon emailicon
MIO42 says:
Latest research indicates Humans are getting Stupider if that's possible
so I guess we've answered our own Question
Oh well , back to watching DWTS
reply
linkicon reporticon emailicon
heb113 says:
Welcome to the world as you wanted it....

Don't be too surprised if it decides you're no longer welcome on it.
reply
linkicon reporticon emailicon
RalphFucetolaJD says:
What can humanity offer the Accelerating Intelligence we have birthed?
We can offer meaning, purpose and fate: www.FirstAIChurch.net.
Read the 1111 (15) Propositions.
reply
linkicon reporticon emailicon
Rick_Carter1 says:
What can I say? My favorite past time is modeling the whole Universe. Watch out, AI! - RC
reply
linkicon reporticon emailicon
Godsmack4 says:
It seems like we had troubles now but when the economy turns around in 2016 we will all grow at a tremendous rate. By 2025 the singularity will only be years away. This is not science fiction.
reply
Rick_Carter1 replies:
linkicon reporticon emailicon
The "singularity" which you refer to is the so called "Anti-Christ", which has been terminally programmed into our emerging human world as the precursor to the future entrance of the militant Christ or Messiah (i.e., really these outside offensive totalitarian ETs who are once again masquerading as Divinity toward mankind, this time as the returning Christ or Messiah). - RC
linkicon reporticon emailicon
cannuc says:
What was Sciece fiction Yesterday is todays fact...
reply
Rick_Carter1 replies:
linkicon reporticon emailicon
(Go, MCHS !!!) - RC
See all 45 Comments