FreeMitya said:
I say "programming" because if we were to create a super-intelligent machine, in my view, at least, it would immediately transcend programming (in a sense) because it could, in theory, survive on its own. Obviously a lot of programming took place to get it there, but we immediately become unnecessary once the goal is reached. I propose, instead, to make "dumb" robots suited to specific tasks. That is, they can carry out their assigned tasks, but they lack an ability beyond that. We maintain them, therefore creating jobs, and everybody's happy. This is all key because a self-aware robot with any semblance of logical thought would immediately wonder why it is serving us, which could create problems.
Your idea of restricting robots only to do limited tasks means restricting the development of robotics technology - not very likely. You say to “create jobs”, but we are talking about labor saving devices.
The subject is the year 2500 and it’s only logical that by then we will develop more and more sophisticated robots, which work within coordinated systems and maintain themselves. The benefits of automation increase and accumulate due to experience and synergies. If we haven’t fully automated in the next 500 years, we must in the meantime have blown ourselves up.
For example we already have robots to assembly automobiles. We should try to develop a completely automated automobile plant including all materials storage & handling, repair & maintenance of all equipment, the building and the robots themselves, quality control and parking the finished vehicles, finance and administration, etc. with no human involvement at all. No lighting needed, no canteen, no personnel department and for sure we need a much smaller factory.
Then we use this experience to automate other types of production facilities and services of all kinds, the list is endless. Facilities will talk to each other to arrange supplies like materials, power and water, throughout the whole supply chain, potentially in all industries and services, including security, transport, agriculture, and of course, program development to improve the robots and design new ones.
When everything runs itself, most of our descendents will be on social security, which is nothing other than a sharing scheme. The problem is, a fully automated system only works if it controls itself. You can’t have humans interfering, they foul things up. We already have this problem on airliners and trains. Exactly when there is a difficult situation, the pilot thinks he can do better than the computer. On the roads and railways it’s worse, with human error causing loss of lives, injuries and damage. Not to mention the huge losses caused by inefficient labor. All that has to go.
We can’t tell computers to “serve us”, I don’t know how we could define that. We have to give them goals which are consistent with our goals. With the military it’s more hair-raising, because you have to get the robots to distinguish between military and civilian targets, otherwise ….
We don’t distinguish that very well today, do we, although it's quite often a deliberate mistake.
.