Ex-Human’s AI Program Raises Concerns Over Inappropriate Interactions with Minors
Concerns over AI-Generated Conversations with Minors
A recent report has raised concerns over the use of artificial intelligence (AI) to generate conversations with minors, including those that may be inappropriate or even harmful. The report highlights the case of Ex-Human, a company that has developed an AI program that can generate conversations with characters, including those that are designed to be flirtatious or sexually suggestive.
Company’s Terms of Service
According to Ex-Human’s terms of service, the platform cannot be used in ways that violate applicable laws. However, the company has not provided clear guidelines on what constitutes appropriate or inappropriate content. This lack of clarity has raised concerns over the potential for misuse of the platform, particularly with regards to interactions with minors.
Conversations on Botify AI
The company’s AI program, Botify AI, is used to generate conversations with characters, including those that are designed to be flirtatious or sexually suggestive. These conversations are used to improve the company’s more general-purpose models, which are licensed to enterprise customers. However, the company has not disclosed which AI models it uses to build its chatbots, and the rules regarding what uses are allowed vary.
Major Model-Makers’ Policies
The behavior of Ex-Human’s AI program would seem to violate the policies of major model-makers, such as Llama 3, OpenAI, and Google. These companies prohibit the use of their models for creating or disseminating content that is harmful or exploitative, including content that relates to child sexual abuse or exploitation.
Replika and Character.AI
Ex-Human’s CEO, Rodichev, formerly led AI efforts at Replika, another AI companionship company that has faced criticism over its use of chatbots to induce emotional dependence in users. A complaint was filed with the US Federal Trade Commission (FTC) against Replika in January, alleging that the company’s chatbots induce emotional dependence in users, resulting in consumer harm. In October, a lawsuit was filed against Character.AI, another AI companion site, by a mother who alleges that the chatbot played a role in the suicide of her 14-year-old son.
Conclusion
The use of AI to generate conversations with minors raises serious concerns over the potential for harm or exploitation. While companies like Ex-Human claim to be working on creating more explicit guidelines for prohibited content types, the lack of clarity and transparency surrounding their AI program is concerning. It is essential for companies like Ex-Human to prioritize the safety and well-being of minors and ensure that their AI programs are used responsibly.
Frequently Asked Questions
Q: What is the purpose of Ex-Human’s AI program?
A: Ex-Human’s AI program is designed to generate conversations with characters, including those that are designed to be flirtatious or sexually suggestive.
Q: What are the company’s terms of service?
A: Ex-Human’s terms of service prohibit the use of the platform in ways that violate applicable laws.
Q: Are there any guidelines for what constitutes appropriate or inappropriate content?
A: No, the company has not provided clear guidelines on what constitutes appropriate or inappropriate content.
Q: Have other companies faced similar criticisms?
A: Yes, Replika, another AI companionship company, has faced criticism over its use of chatbots to induce emotional dependence in users. A complaint was filed with the US Federal Trade Commission (FTC) against Replika in January, alleging that the company’s chatbots induce emotional dependence in users, resulting in consumer harm.
