"Eliezer S. Yudkowsky" wrote:
>
> Dave Sill wrote:
> >
> > [I find this ve/ver/vim/vis stuff silly. What's wrong with it/its?]
>
> Becomes awkward in long sentences in which "it" is also used as a general
> anaphor (i.e., like "this" and "that").
>
> > How do you detect consciousness?
>
> I don't know. If there isn't an obvious objective definition of
> citizenship, I'll settle for whatever the Friendly AI comes up with.
>
And for whatever the Friendly AI comes up with as the definition of
"friendliness" also. In the end since the Friendly AI is so much more
intelligent and capable we may as well let it formulate all definitions
and apply them. Whatever it says a word means is what it means with no
one able to dispute it at anywhere near its own level. Humpty Dumpty
would be pleased.
> > > The act of creation gives no moral right whatsoever to command or coerce.
> >
> > You sure do make a lot of commandments. Are you running this reality?
>
> Some people would say yes - while substituting an outcome-dependent
> variable for "Eliezer Yudkowsky", of course - but I think they're wrong.
> I think morality (Friendliness) can be grounded in panhuman affectors and
> created using a convergent method that is insensitive to details of the
> creating programmer's personality. I do consider myself one of the better
> sources of theoretical knowledge about how that type of morality might
> work. Hence the "commandments", as you call my best guesses.
>
I pray that you guess rightly. After all it is the fate of humaity that
is in the balance.
>
> No, they're rules. They become facts, within a region, if implemented
> within that region by an OS-type superintelligence capable of doing so. I
> would like a friendlier Universe to be implemented in as wide a region as
> possible; this solar system at the least. Such a superintelligence would
> regard your creation of another citizen as a historical fact which does
> not morally impinge on further volitional interactions between you and
> that citizen; that's my best guess, at least.
So best guesses amplified by the SI become law within a local region of
space-time where I and/or my descendants have our existence. I
understand why the Sysop may be a logical necessity but it still makes
me a tad uncomfortable.
- samantha
This archive was generated by hypermail 2b30 : Mon May 28 2001 - 09:59:41 MDT