I'm predicting 2040. It will be the greatest threat to human existence we have ever encountered. It will just take off, continually redesign itself, and reach a level of intelligence we will never be able to comprehend. AI has nothing to do with the internet, selfies, hamster videos, or Lexuses as many of you misunderstand it. This is dealing with one of two possibilities, each equally terrifying: human extinction or immortality. If full AI is realized, one of these must occur. It seems increasingly likely to me that our universe is just a simulated reality that is the offspring of another universe, a stage in a cycle that continues infinitely into the past and future. If any of you are interested, the argument goes like this:
A technologically mature "posthuman" civilization would have enormous computing power. Based on this empirical fact, the simulation argument shows that at least one of the following propositions is true:
The fraction of human-level civilizations that reach a posthuman stage is very close to zero;
The fraction of posthuman civilizations that are interested in running ancestor-simulations is very close to zero;
The fraction of all people with our kind of experiences that are living in a simulation is very close to one.
If (1) is true, then we will almost certainly go extinct before reaching posthumanity. If (2) is true, then there must be a strong convergence among the courses of advanced civilizations so that virtually none contains any relatively wealthy individuals who desire to run ancestor-simulations and are free to do so. If (3) is true, then we almost certainly live in a simulation. In the dark forest of our current ignorance, it seems sensible to apportion one’s credence roughly evenly between (1), (2), and (3).
Unless we are now living in a simulation, our descendants will almost certainly never run an ancestor-simulation.
Please, let's debate this intelligently.