UsedToBeKnowItAll wrote:
Unfortunately this is true, and Musk is correct. Our current engineers have so much hubris, and very, very few people comprehend the power of modern computers.
The only part that seems unlikely is that an AI would target our nuclear arsenals. It will come up with a more creative solution to either enslave or destroy us. One that we haven't even imagined. And it will execute it in seconds or less. We wouldn't stand a chance.
I think Google is being pretty reckless in this area of research.
There is a lot of sci-fi about machines taking over the world. The fiction in those movies is that we might be able to fight back.
To the first bold part, agree completely. The vast majority of humans are completely ignorant of the power of the technologies that are now the glue of the every day lives of most people, and we're only at the foot of the mountain.
To the second, might it be that a sufficiently advanced AI might not even consider us at all? I read a very interesting article once conjecturing that in the first nanoseconds after technology achieves something like 'self-awareness' (whatever that would look like; certainly having a 'soul' as we think of it would not be a requirement and the fact is we don't really understand at all the nature of our OWN sentience...) it will be so far past us as to render us like cats or dogs in comparison...
The fact is, it is hubris on a colossal scale for anyone to consider that we are somehow this apex of evolution; mostly I find this in religious types who believe 'gawd' created us in his/her/its image and that we are apparently the center of the 96.x billion light years of the observable universe, when in fact we are simply somewhat more intelligent apes just advanced enough to completely despoil our nest, build the weapons of our own destruction, commit genocide on a scale of millions of our fellow humans, and on and on. We have been around for only a very short time relative to the most successful species on the planet, and we are continuing to evolve (albeit very slowly) as I sit here and write this...
But all of a sudden along comes this thing of our own creation, evolving at hyperspeed in response to environmental stimuli (in this case our consumer demand, demand for advanced weaponry, scientific curiosity, etc) and it is going to far outstrip us, and that horizon isn't even that far away really. We may think of 100 years as a long time but it's not even the blink of an eye in universal time, but 100 years ago flight was still in it's infancy and computers didn't exist at all, and look where we are now. With information sharing on a massive scale where will this all be in 10 years, 100, 1000??
It isn't us that will solve the problems of interstellar space travel, it will be machines, and us? Home sapiens as we know ourselves now may or may not be around in 100,000 years but if we still are we would look upon the humans of today as we look back on Neandarthal or Cro-Magnon man.
The limitation of most people is they just can't extrapolate their own little day to day existence into something deeper, whether looking back at geologic 'deep time' or forward into the future; 500 years ago one might have lived in the same village all their lives and day to day life would not have changed appreciably. Now, life changes dramatically nearly on a yearly basis but there still seems to be that 'static' view of life held by people that somehow we are always going to be (or are SUPPOSED to be) the center of it all when in fact nothing could be further from the truth. Now the game changer of our own creation is here...