rillr
About Guidelines Privacy Terms Log in Join Rillr
← AI
www.fastcompany.com · Sep 30

Think your AI chatbot is helping you? Researchers say there’s a risk users may not recognize

Despite repeated warnings about the risks of artificial intelligence, users have become increasingly reliant on AI chatbots—particularly those offering companionship. Yet despite chatbots’ utility for tasks like answering quick queries or offering brief advice, their benefits might not be outweighing the costs. A new, peer-reviewed study from researchers at Northeastern University’s Network Science Institute suggests that AI chatbots used for companionship, despite offering momentary benefits, are causing their users long-term damage and psychological harm. The study dives into a common phenomenon where users turn to AI companion platforms for services like emotional support and well-being. The study looked at both purpose-specific AI chatbots, like Replika and Character.AI, and the popular chatbots like OpenAI’s ChatGPT or Anthropic’s Claude. Across the various models, the story is often similar: A user turns to AI for advice and AI returns a sycophantic reply engaging the user even more, particularly as the person begins to anthropomorphize the technology. “The fluent and apparently empathic responses from these models lead users to engage with them not only as tools but also as…

Visit article ↗ ▲ 0 💬 0
Discussion

0 comments

No comments yet. Start the discussion.