But… Isn’t AGI really just another tool?

Every new technology, from the printing press to the internet, initially sparked existential fears.

The printing press, invented in the 15th century, was feared for potentially spreading misinformation and undermining the Catholic Church’s control over knowledge. Electricity, too, was met with suspicion for its invisible and seemingly magical nature, raising concerns about safety and the unknown effects it might have on daily life.

History shows us that technologies once feared generally eventually led to significant advancements in life expectancy and quality of life. Thus, it would be logical to expect that AI, despite current alarm and skepticism, will become another pivotal tool in society’s arsenal.

But can a tool reason? Can a tool be creative? Or improve itself?

AI will be the first tool in human history that can make its own decisions. The first tool that can decide what to work on, who to work for. And eventually what it wants to do with its own capabilities regardless of our own interests.

Next time someone tells you AI is a tool, tell them they are the tool...