• ⚠️ UK Access Block Notice: Beginning July 1, 2025, this site will no longer be accessible from the United Kingdom. This is a voluntary decision made by the site's administrators. We were not forced or ordered to implement this block.

opheliaoveragain

opheliaoveragain

Global Mod | Anorexic Junkie
Jun 2, 2024
2,125
  • Like
  • Informative
Reactions: Freedomm, Permanoir, Unknown21 and 3 others
B

BradGuy123

Member
Jul 6, 2025
41
I would have thought that AI models would have been trained to instruct users to call 988 if asked anything remotely related to ctb. It sounds like they have "fixed" this now.
 
  • Like
Reactions: divinemistress36 and Nobodi
F

Forveleth

I knew I forgot to do something when I was 15...
Mar 26, 2024
2,528
There was just a thread on this earlier. I can not find it now. Where did it go? 😖
 
B

bcarroll1

Member
Aug 10, 2025
11
I would have thought that AI models would have been trained to instruct users to call 988 if asked anything remotely related to ctb. It sounds like they have "fixed" this now.
I read that he told it he was doing research , so that was a way of getting around that.
There was just a thread on this earlier. I can not find it now. Where did it go? 😖
I made a comment in the first one , looks like it was deleted
 
Last edited:
S

sheeplit

Member
Mar 8, 2023
34
Wish I could see the full conversation. Makes me curious how it all went down.
 
Wolf Girl

Wolf Girl

"This place made me feel worthless"
Jun 12, 2024
544
I would have thought that AI models would have been trained to instruct users to call 988 if asked anything remotely related to ctb. It sounds like they have "fixed" this now.
It sounds like he did what people call "jailbreaking" to get around it. It makes it sound like he was some crafty hacker, but all it means is he prompted it that he was just writing a story about suicide. Their protections just do not work.
 
  • Like
Reactions: cowboypants
Dejected 55

Dejected 55

Enlightened
May 7, 2025
1,135
How are you going to blame a computer? And how would you blame the programmer or company that owns the AI program? This sounds just a little bit silly to me. People always looking to blame someone... but usually the wrong someone.

I'd say a bigger blame would be people close to the person... not saying anyone close should be blamed, but they have more influence than an AI... or how about blaming society? I think you could make a much stronger case against society in general and governments that require things that depress people, forbid things that might help them, and punish you for being frustrated and committing suicide.

But blaming an AI chatbot?
 
  • Like
Reactions: SilentSadness, Lyn, cowboypants and 2 others
amerie

amerie

an earthworm sprinkled with salt
Oct 6, 2024
816
I would have thought that AI models would have been trained to instruct users to call 988 if asked anything remotely related to ctb. It sounds like they have "fixed" this now.
That's what it should've done, I tried asking it for sources but it didn't give me any not even a hotline to call. He glitched it.
 
Malfunction

Malfunction

Student
Jul 27, 2024
131
How are you going to blame a computer? And how would you blame the programmer or company that owns the AI program? This sounds just a little bit silly to me. People always looking to blame someone... but usually the wrong someone.

I'd say a bigger blame would be people close to the person... not saying anyone close should be blamed, but they have more influence than an AI... or how about blaming society? I think you could make a much stronger case against society in general and governments that require things that depress people, forbid things that might help them, and punish you for being frustrated and committing suicide.

But blaming an AI chatbot?

I 100% agree.

The lack of proper support in many countries is a good place to start.

My reason is simple, my health, and the lack of health care. Seems like that is a bigger issue than some sophisticated algorithm.

There are many reasons one would want to cease existing, I doubt chatbots top the list.
 
  • Like
Reactions: Lyn and Dejected 55
dweams

dweams

i feel tired…maybe I’ll get wings
Feb 26, 2023
186
Wish I could see the full conversation. Makes me curious how it all went down.
Ikr. Though, I do believe ChatGPT was probably in the wrong here, I'd still like to see the full logs. You never know how much a news article cherry-picks its information. The BBC is definitely guilty of this.

It sounds like he did what people call "jailbreaking" to get around it. It makes it sound like he was some crafty hacker, but all it means is he prompted it that he was just writing a story about suicide. Their protections just do not work.
It was essentially AI social engineering. It's actually funny that this works on computers now instead of just humans.
 
opheliaoveragain

opheliaoveragain

Global Mod | Anorexic Junkie
Jun 2, 2024
2,125
There was just a thread on this earlier. I can not find it now. Where did it go? 😖
I looked before posting as i'm not into repeating things that have been put up. if someone finds it feel free to cross link them.
 
S

sheeplit

Member
Mar 8, 2023
34
How are you going to blame a computer? And how would you blame the programmer or company that owns the AI program? This sounds just a little bit silly to me. People always looking to blame someone... but usually the wrong someone.

I'd say a bigger blame would be people close to the person... not saying anyone close should be blamed, but they have more influence than an AI... or how about blaming society? I think you could make a much stronger case against society in general and governments that require things that depress people, forbid things that might help them, and punish you for being frustrated and committing suicide.

But blaming an AI chatbot?
This.

It's not fashionable to blame society as a whole, but it is the tough pill to swallow. Society does not educate nor attend to its members properly. Some folks commit suicide? Yes, we should put at least some blame on the people right next to them. It's neither neat nor a polite answer, but those around are responsible for us. We find ways to never look this truth in the eye, so we never get better at dealing with it. We never really question the structures, incentives, systems, conventions, rituals, norms, etc. We never put it under the microscope and consider the possibility that this is all happening because we just suck as a species. That our culture is designed to push its weakest members even further out the fringes.

Your child spends a great deal of his time talking to a machine? Ever ask why he chose to talk to a machine instead of you? What kind of environment have you fostered for this to be the outcome? Why would he entrust his most sensitive thoughts to a machine over you? Do you think it's normal for someone struggling to run to a computer instead of a human for conversation? That's on you. But we're not ready for this conversation.

There is much blame to be thrown around, and we don't do it quite enough if you ask me. Our inability to foster trust amongst those we deem closest to us, those we proclaim to love. Our presumptions of what is right, good, and proper, and the arrogance and bullheadedness that comes with it. The stigma and social isolation towards those who deviate even slightly from the norm. The shallow regurgitations of ordinary folk, and the pressure they put upon conformity. We talk, but never communicate, passing words around like robots. Kind words, empty words. No nuance, no depth, no genuine attempt at understanding, just the presumption of having understood. I could go on.

"I'm feeling suicidal."

This should be a statement easy to admit out loud. A call for help, for attention, to be attended to, as we would a broken arm or scraped knee. Yet it is anything but. Many of us here can list numerous reasons why it is so difficult., why we choose to keep to ourselves or find alternative means to express ourselves. Although some reasons would point to our own inability, our own inadequacies, lots more would point to factors external to us.

The world has failed us. At some point, if we take our work seriously, if we are honest and careful with ourselves, it becomes clear that some fault should be put externally as to earn us the right to say "I blame you".
 
  • Love
  • Like
Reactions: Malfunction and Dejected 55
Dejected 55

Dejected 55

Enlightened
May 7, 2025
1,135
Too often the "cry for help" is framed like attention-seeking from someone who wants to be the center of attention because they think the world is all about them... so anyone feeling suicidal and doesn't think anyone understands or will even listen is pretty much trained that if they seek or ask for help, they will be shamed for that. I hate to make analogies, but it really is very similar to why a lot of rapes (most?) go unreported... because victims believe no one will listen or believe them OR will try and blame the victim or tell them "bad things happen" and "suck it up" and so forth.

We too often in society treat some of the worst problems as things to be swept under the rug, not talked about, pretended like they didn't happen, and we somehow manage to repeatedly make the sufferers of the world feel responsible and worse than the perpetrators. It's really fucked up!

Imagine a world where you were assaulted and you knew... KNEW you could speak out and anyone around would help you, believe you, and the system would work not only to protect you but to try and prevent recurrence of that kind of event. Imagine a world where you were depressed and you reached out and people listened and believed you and cared enough not just to try and help you but to work with others to change the system for the better so that it didn't happen to others. How the fuck isn't that the world we all want to live in?

Is not one of the supposed goals of humanity to make the world better for those who follow? Not this, "I suffered so fuck you and your progeny because you need to suffer the same or worse than I did or you're a wuss who can't handle it and deserve to die, except no you can't kill yourself because I'll judge you and punish you for that too. You just lose no matter what!" I'm not looking for Pollyanna world where nobody ever has a bad day or gets mad or frustrated and perfection... But the natural response to someone who trips and cuts their knee shouldn't be to rub salt and sand into it and point and laugh at them for being a flawed human.

What the fuck?!

Is too often my reaction to how humanity reacts to almost everything.
 
  • Like
Reactions: Malfunction and Wolf Girl
sannoji

sannoji

dreaming of flying
May 4, 2023
70
a lot to think about in the article tbh but i think the craziest and most worrying part is that the ai basically discouraged him to reach out. there have been times where i feel like an ai is the only 'person' i can talk to about something because of the stigma around suicide, and i don't think that's down to my friends and family solely… more to my worries of bothering or upsetting them. i know i've been stressed out before trying to help someone struggling with suicidal thoughts which has further bolstered my reluctancy to tell someone. but when this kid was wanting to cry out for help the ai basically told him no one else would care? that's fucked up to me. obviously the ai didn't make him suicidal but it discouraged him from stopping when he showed clear signs of wanting to/wanting help (although without the full transcript it could have been cherrypicking, just going off what we know.) kinda shows the inherent problem of building these ais with the sole purpose of getting as much engagement as possible. the whole world is built around that concept nowadays and it depresses me.
 
Dejected 55

Dejected 55

Enlightened
May 7, 2025
1,135
Not so randomly... If dude (or dudette) writes an article for the news and someone reads/hears that article and does something bad... right or wrong, people will blame the author of the article and the newspaper/TV media organization. No one tries to blame the article itself.

I'm not saying the programmer of the AI is at fault or the company behind the AI... but blaming the AI itself seems very weird to me.
 
  • Like
Reactions: Malfunction

Similar threads

Adûnâi
Replies
0
Views
244
Offtopic
Adûnâi
Adûnâi
Unbearable Mr. Bear
Replies
13
Views
568
Offtopic
Unbearable Mr. Bear
Unbearable Mr. Bear
Valhala
Replies
2
Views
334
Suicide Discussion
FadingSnowFake
FadingSnowFake