Do sex dolls with AI fall under the AI Act?

The emergence of advanced sex dolls equipped with artificial intelligence (AI) raises fundamental legal questions. Although the new European AI Act is designed to manage the risks of AI, these specific technologies are not explicitly mentioned. This leads to uncertainty. The answer is yes, sex dolls equipped with AI do fall under the AI Act, but the specific rules that apply depend on the specific AI functionalities and the level of risk the legislator attaches to them.

The legal context: innovation versus societal risks

Sex dolls are evolving from static objects to interactive "partners" that can have conversations, simulate emotions and learn from their users. Proponents point to potential benefits, such as providing companionship to lonely people or serving as sexual aids for the elderly and those with disabilities.

At the same time, critics warn of significant risks. Consider:

• Reinforcing harmful stereotypes: Many models are designed with exaggerated and stereotypically feminine features, which can perpetuate the objectification of women.
• Data protection risks: These devices collect extremely sensitive and intimate personal data, which can have serious consequences for the user if a data breach or misuse occurs.
• Emotional dependence and deception: Hyper-realistic interactions can blur the line between humans and machines, which can lead to unhealthy dependence.

It is against this background that the European Union has introduced the AI Act (Regulation (EU) 2024/1689) . This legislation creates a legal framework for the development and use of AI within the EU, aiming to support innovation while protecting fundamental rights, security and democracy.

The regulations: the risk categories of the AI Act

The AI Act takes a risk-based approach. AI systems are divided into several categories, each with its own obligations. Because sex dolls are not listed as such, the specific AI components must be considered for each model.

1. Unacceptable risk (prohibited AI).

The AI Act prohibits AI systems designed to deceive people or exploit the vulnerabilities of certain groups, resulting in harm to them. A sex doll could fall under this if, for example, it is designed to manipulate a user with a mental vulnerability into making significant financial expenditures.

2. High risk

A sex doll may be considered "high risk" if it uses emotion recognition systems. These are systems that analyze biometric data (such as facial expressions or voice intonation) to determine a user's emotional state.

If a model falls into this category, strict obligations apply to the manufacturer, including:

• A robust risk management system.
• Strict rules for data governance and documentation.
• Human oversight and transparency to the user.
• A conformity assessment and application of the CE mark to demonstrate that the product meets regulatory requirements.

3. Limited risk

Many sex dolls will fall into this category because they are intended for direct interaction with people (e.g., via a chatbot feature). The main requirement here is transparency: the user should be clearly informed that he is communicating with an AI system unless it is obvious from the context.

4. General purpose AI models (GPAI).

When a sex doll uses advanced generative AI (similar to ChatGPT) to have unique conversations or dynamically adjust its personality, this model falls under the rules for GPAI. This entails specific obligations, mainly in terms of technical documentation and informing other developers integrating the model.

5. Minimal risk

Simpler models with only pre-programmed responses and no learning capability fall into the "minimal risk" category. The AI Act imposes no obligations for these systems, but does encourage the industry to establish voluntary codes of conduct.

Legal analysis and interpretation

The complexity in regulating sex dolls lies in the fact that a single product may contain components from multiple risk categories. A doll can have a "limited risk" chatbot, but at the same time have a "high risk" emotion recognition system. So the manufacturer will have to assess compliance with the AI Act separately for each feature.

The ratio legis (the legislature's intent) of the AI Act is clear: the greater the potential risk to citizens' fundamental rights, the stricter the rules. A crucial legal sticking point will be the interpretation of "deception" and "manipulation. Where does the desired illusion that a user consciously chooses end, and where does the prohibited practice that causes harm begin? Case law will need to clarify this in the future.

Moreover, it is important to emphasize that the AI Act does not exist in a vacuum. This legislation must be read together with other regulations, such as the General Data Protection Regulation (GDPR) and the Regulation on general product safety.

What this specifically means

• For developers and manufacturers: You must conduct a thorough legal and technical analysis of your product to determine which AI components fall under which risk category. Compliance is not a checklist; it requires a proactive approach to risk management, documentation and transparency. Especially in high-risk systems, the obligations are very far-reaching.
• For users: You have a right to clear information. The manufacturer must be transparent about the fact that you are interacting with an AI and, in the case of high-risk systems, about its operation and risks. Be aware of the data you are sharing and the emotional impact such technologies can have.
• For society: The AI Act provides an initial framework to address the most serious risks posed by AI in intimate contexts. The legislation seeks to balance technological innovation with the protection of human dignity, autonomy and safety.

FAQ (frequently asked questions)

Is my sex doll with AI now banned?
No, sex dolls as a product are not prohibited. Only AI systems designed with the specific intent to manipulate or exploit vulnerabilities in a malicious manner are covered by the AI Act's prohibition.

How do I know which risk category my device falls under?
For high-risk systems, the manufacturer is required to conduct a conformity assessment and make this known through the CE mark. For low-risk systems, you must be informed that you are interacting with AI. This information must be clear and understandable.

Who is liable if my sex doll's AI causes damage?
The AI Act regulates preventive safety rules, but not liability for damages. The question of who pays for damages is answered by other legislation. In the EU, these are mainly the Product Liability Directive (if the damage comes from a defective product) and national law around tort (fault liability - Article 6.5 CC). A violation of the rules of the AI Act by the manufacturer may well be used in a lawsuit as a strong indication of "fault" to prove its liability.

Conclusion

The AI Act creates a necessary but complex legal framework for sex dolls and other intimate AI technologies. The classification is not straightforward and depends entirely on the specific technical functionalities. Manufacturers must conduct a detailed risk analysis to determine their legal obligations, while users must be aware of their rights to transparency and safety.