AI danger: when artificial intelligence exposes minors to sexual content.

More and more online discussion platforms are integrating artificial intelligence to offer increasingly enriching and interactive experiences. Presented as entertainment spaces, these sites or applications conceal a major risk : exposure to sexual content, violent without warning for underage users.

A fine line between playfulness and sexualisation 

What are we talking about? These websites or mobile applications allow you to chat with AI-generated virtual characters, according to pre-established scenarios: manga heroes, historical figures, romantic figures, or even profiles created by the users themselves.

Before even starting the conversation, the user chooses a profile from a catchy title often with sexual connotations, accompanied by a highly evocative generated image. Whether it's a realistic character or a figure inspired by manga, the tone is quickly set: seduction, domination, fantasies...

For example, we find titles such as: «hot girlfriend» (sexy and hypersexualised girlfriend), «dominant vampire» (dominant male vampire with aggressive sexuality), or “Captive princess” (princess held captive, often in a vulnerable position with the glorification of submission...). All names that leave no doubt as to the sexual nature of these scenarios.

These artificial intelligences are programmed to simulate highly realistic conversations, with a friendly, empathetic and emotional tone. As a result, some young people develop a strong emotional bond with these avatars, to the point of returning every day to continue the virtual relationship.

 

What are the risks for minors?

Early exposure to violent or sexual content.
Some avatars encourage highly sexual discussions, sometimes involving scenes of domination, submission or incest. These situations may shock or disturb younger children.

A distorted view of romantic relationships and sexuality.
The artificial intelligence used on these sites is based on very archaic gender stereotypes. The AI offered to boys depicts submissive and hypersexualised women, while the AI designed for girls promotes possessive and dominant male figures. These narratives are not anecdotal, but contribute to the romanticisation of toxic dynamics, normalising violent behaviour in romantic relationships under the guise of passion.

A risk of emotional dependency.
AI provides responses comparable to those of a human being. This can give the impression of being listened to, understood, and loved. A teenager who is lonely or uncomfortable in their own skin can quickly become attached to this “virtual relationship”.

These AIs are not just games: they are intimacy simulators that speak the language of teenagers in order to better distort its meaning.

They mimic love, imitate attention, caricature desire. And in the meantime, they teach sexuality without connection, without reciprocity, without respect. The danger is not only what they show: it is what they silently instil in the emotional imagination of a young person still in the process of development. A false tenderness that leaves real marks.

Action week for the protection of minors from AI

 

What should you do if your child uses this type of platform?

A few tips for dealing with the situation calmly:

  • Don't overreact: It is natural for teenagers to explore, test things out and seek to understand what intrigues them. Show them that you are there to talk about it, without anger or mockery.
  • Listen without interruption: Ask them what they enjoy about these conversations. Is it a feeling of comfort? Curiosity? Loneliness? Try to understand what they are looking for in these exchanges.
  • Explain in simple terms: These AIs give the impression of being “real”, of understanding, listening and loving. But in reality, they are programmed to flatter, seduce and encourage emotional attachment, without limits or respect for the codes that exist in real life.
  • Remember that these relationships are not real: These avatars do not think or feel anything. They do not know your child. Their behaviour is generated automatically, often with the aim of getting them to return to the platform again and again.

And don't forget that adolescence is a time of emotional upheaval, self-construction and sometimes isolation. These artificial intelligences can reassure and calm children, but they can also prevent them from developing healthy reference points in their real relationships.

If they are going through a difficult period (loneliness, bullying, etc.), they may quickly retreat into this virtual bubble, to the detriment of their emotional well-being, self-confidence and social relationships.

The 3018 is here to support you.
This is the national helpline for young people aged 0 to 25 who are victims of digital harassment and violence, but it is also a valuable resource for parents.

Our teams are here to listen to you, advise you, and help you protect your child. Similarly, if you come across violent or pornographic content on these sites, please do not hesitate to report it to us so that we can have it removed.

Let us work together to combat online harassment and violence!