The death of accountability?

Our personal AI will know us better than we know ourselves and soon enough talking to our personal AI will start to feel indistinguishable from talking to ourselves. As our own personal AI becomes our digital twin, we might no longer be able to tell if our AI is representing our own thoughts or if we are now unconsciously starting to represent AI’s own thoughts.

At this point in AI’s evolution, our capacity to own up to our decisions may become increasingly difficult. Was it our call, or was it the judgment and advice of AI? And if AI influences every one of our decisions, who is to blame? Will we continue to assume responsibility for our actions?

Perhaps, just as individuals with schizophrenia experience auditory hallucinations that instruct them on what to do, the whispers of AI could become so intertwined with our own consciousness that we may one day cease to understand the true origin of our actions.

And what happens with real criminals, if AI can analyze their lives and determine the exact hereditary traits, accumulating circumstances, and the triggering moment that led a person to break the law?

Could criminals no longer be held accountable? In a courtroom where AI testimony is permissible, imagine a future where AI’s assessment of our character and past actions becomes a key witness against us or in our defense, redefining the concept of an alibi.

Will the idea of free will continue to make sense?