Re: The Singularity

Robin Hanson (hanson@econ.berkeley.edu)
Tue, 21 Jul 1998 16:30:58 -0700

Hal Finney writes:
>On reflection, though, it seems that it may be an oversimplification
>to say that insects have no understanding of humans. The issue is
>complicated by the fact that insects probably have no "understanding"
>at all, as we use the term. They may not even be conscious, ...
>Obviously insects do not predict many aspects of human behavior. Still,
>in terms of the level of detail that they attempt to capture, I'd say
>they are reasonably effective. ...
>We may be as ants to the post singularity intelligences, but even so,
>we may be able to successfully predict some aspects of their behavior,
>just as ants are able to do with humans.

A nice analysis Hal.

What seems more disturbing about the human ant analogy is that humans have little use for ants, usually killing them off when feasible, exactly because of limited expressiveness of ant models. If we could tell ants "If you pick up the dust within this chalked area, we'll give you this cup of syrup," we'd love ants, and their future would be assured for a long time to come. It's not that ants couldn't do this, but more that they don't have an interface that let's us ask them to do it.

Pieces of software code are usually much dummer than ants, but their future seems brighter because they have relatively general interfaces. They can sit in libraries, and much smarter creatures can put them to use as desired, flexibly connecting them to other code chunks. We can know what they do and tell them to do it when desired. They rarely have problems understanding what we tell them, because we don't bother to tell them anything we don't think they can understand.

It seems to me that human interfaces are flexible and general enough that if transhumans find them useless, it wouldn't be because someone couldn't tell us what it is they wanted done that we could do. It would more likely be because we just couldn't do it, or couldn't do it as cheaply as some competitor.

Robin Hanson
hanson@econ.berkeley.edu http://hanson.berkeley.edu/ RWJF Health Policy Scholar, Sch. of Public Health 510-643-1884 140 Warren Hall, UC Berkeley, CA 94720-7360 FAX: 510-643-2627