The impact of exponential growth?

To illustrate the recurring and compounding effect AGI will have on our lives, imagine a Societal Pinball Machine in which a magical AI ball is dropped. As the AI ball hits different areas, these areas are immediately transformed. The ball then bounces to other locations within the game, each of them also transformed in turn, sending the ball back again.

Now, imagine the AI ball moving faster and faster, impacting every aspect of our society in an infinitely compounding transformation. Soon, the AI ball will move so swiftly that it becomes invisible, and the areas it impacts will undergo such drastic changes that they become unrecognizable.

At this point, it will be impossible to track where the AI ball is headed. Instead, we must focus on a single area to predict the next transformation.

Exponential growth could multiply our misfortune, but if our bets prove correct, our good fortune could suddenly be multiplied beyond our wildest dreams—giving us the opportunity to keep playing the AI game for longer.