Billy Brown wrote:
>I was reading some of the previous debates on the Singularity in the list
>archives recently, when it struck me that there is a major factor that does
>not seem to have been seriously considered.
>Simply put, the more advanced a technology becomes, the more work it takes
>to improve it. As technology advances there is a general tendency for
>everything to become more complex, which means more work for the engineers.
>... Because of these factors, a Singularity is likely to have a slow takeoff.
Similar issues have been considered. For example, here is an exerpt from http://www.extropy.org/eo/articles/vc.html#hanson
Now let me be more critical, starting with "smarter entities reproduce even smarter entities faster." Some people interpret this as imagining a single engineer working on the task of redesigning itself to be 1% smarter. They think of intelligence as a productivity multiplier, shortening the time it takes do many mental tasks given the same other resources, and they assume this "make myself 1% smarter" task stays equally hard, as the engineer becomes smarter. These assumptions allow the engineer's intelligence to explode to infinity within a finite time. If early work focuses on the easiest improvements, however, the task of becoming more productive can get harder as the easy wins are exhausted. Students get smarter as they learn more, and learn how to learn. However, we teach the most valuable concepts first, and the productivity value of schooling eventually falls off, instead of exploding to infinity. Similarly, the productivity improvement of factory workers typically slows with time, following a power law. At the world level, average IQ scores have increased dramatically over the last century (the Flynn effect), as the world has learned better ways to think and to teach. Nevertheless, IQs have improved steadily, instead of accelerating. Similarly, for decades computer and communication aids have made engineers much "smarter," without accelerating Moore's law. While engineers got smarter, their design tasks got harder. Robin Hanson firstname.lastname@example.org http://hanson.berkeley.edu/ RWJF Health Policy Scholar FAX: 510-643-8614 140 Warren Hall, UC Berkeley, CA 94720-7360 510-643-1884