Re: `friendly AI' research (was: Re: JOIN THE EXI)

From: Eliezer S. Yudkowsky (
Date: Wed Oct 25 2000 - 09:19:41 MDT

Damien Broderick wrote:
> I doubt the idea would have much appeal to canonical AI researchers, who'd
> regard it as precipitate, I think, like horse-and-buggy designers making
> sure they put in a windshield secure against going through the sound
> barrier. (This is not *my* view, of course.)

Heh. Sounds to me rather like that old objection to the grey goo scenario:
"For nanotech to escape to the natural environment would be like a car going
wild and learning to live off tree sap." The thought that immediately went
through my mind was "The day cars learn to reproduce, I'll start worrying
about it."

The day they build a self-improving horse and buggy...

-- -- -- -- --
Eliezer S. Yudkowsky
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2b30 : Mon May 28 2001 - 09:50:18 MDT