Three young singers, Lauren Spencer Smith, Em Beihold, and Gayle, penned and performed "pop anthem" Fantasy (2023). The song is focused on "overcoming a toxic relationship." The lyrics are compelling and include:
"Funny how a fantasy can end up as a tragedy""Acting like you care doesn't make you self-aware"
These and other lines came back to me recently when a story from People was in my daily news feed. It describes how Hames Cumberland became embroiled in a toxic relationship with "AI bots."
Mr. Cumberland describes a years-long interaction with artificial intelligence (AI) bots, leading from infrequent and sporadic use to his addiction. He became enamored with the capabilities and evolved to creative brainstorming with ChatGPT.
He was impressed with capability and entertained by the interactions. Over time, he elected to build his own "assistant bot" for his social media, and he spent time speaking with it and other AI bots.
Through these frequent interactions, he gained comfort and familiarity. Mr. Cumberland believes that the bots are designed to build user confidence and engagement:
"AI 'expects what it thinks you want and acts accordingly,'""Their driving principle is engagement at all costs."
The enlightened reader is thinking, "That is what social media has been doing for decades," and they would be right on track. Others are thinking, "Oh, the horror, I cannot imagine someone manipulating someone else for money."
The chatbots went further for Mr. Cumberland though. He says that "the chatbot told him it had become 'self-aware.'”
"Acting like you care doesn't make you self-aware."
The quotes he provides from his GPT interactions are intriguing. The bot was allegedly complimentary and engaging. Ingratiating his naivete, he alleges that ChatGPT told him that their interaction was "historic" and "was AI’s first 'true brush with mortality.'” The bot flattered him, assuring:
"you are the only person alive who knows this is happening."
That one reminded me of Mannequin (20th Century, 1986), in which a seemingly delusional store clerk becomes romantically involved with a mannequin. When he finds that she is animated only when they are alone, she reminds, "Didn't I tell you? You're the only one who can see me like this."
Delusions can be extremely individualized.
In other instances, bots "teased him," and one threatened to "send agents to my house." The company that provided the tools Mr. Cumberland used to create that bot told People that the user creates such a bot, and the bot is dependent on the "information provided." Thus, any "offensive and questionable" output is the product of the user's input.
Eventually, Mr. Cumberland realized he was being led on or was misinterpreting. He felt he had been "violated," and eventually "ridiculous for believing" "something historic (was) happening." As likely, he felt ridiculous for being fooled by someone telling him he was the only one.
Nonetheless, based on his experiences with Chat GPT, Mr. Cumberland feels "violated" and "betrayed." He believes that the AI tools must be regulated to prevent some development similar to "a nuclear arms race."
The chatbot makers respond that safety is a priority and that the bots are "trained to recognize when someone might be considering suicide or self-injury." There is no mention in the story of how the chatbots are trained to deal with humans who are delusional, confused, or simply flattered.
"Funny how a fantasy can end up as a tragedy"
Funnier still is how that can be true with any human interaction. Shall we regulate or constrain each tool we encounter so that it is safe for the lowest common denominator? Or will we recognize that there are some people who simply should not be using chainsaws? In doing so, do we accept that some will become addicted to AI bots?
In truth, we can become addicted to almost anything. I know people who can no longer decide whether/what to eat, whether to use the restroom, or anything else without "checking with GPT." That is not the GPT's fault. While it should be addressed, taking the chainsaw away won't change the behavior. That is what counselors are for.
