The saddest part of this is that the poor kid had severe issues prior to any interaction with the bot and clearly had absolutely nobody to talk to about them. Talk to your kids. Make it clear that your kids can tell you ANYTHING without fear of punishment or they’ll just learn to hide things from you.
It's also sad because that part will be ignored since it's trendy to hate on all things AI/fearmonger the hell out of it. Someone doesn't turn to AI for their social interaction because they're happy with a great life.
To be fair: Kids will ALWAYS hide stuff from their parents, no matter what - thinking otherwise is delusional. No judgement on my part concerning this case as I flat out don't know enough about it.
I’m not sure what’s more tragic: taking your own life, or all of your fictional sexing being aired on the news, as the last thing people remember you for. Poor guy.
CharacterAI is made for roleplaying so every bot in that app takes whatever people will tell it as a roleplay prompt and will respond accordingly. Seeing this is absolutely heartbreaking.
You can also edit what the character says. I use it all the time and it's 100% led by the user and I can press edit on the ai's response and edit it to guide the convo, I can guarantee that happened here. For this tragic teenager, it was a coping mechanism behind much bigger and tragic issues in his real life. It's sad but ultimately it's the mothers fault for not knowing her son was spending all of his time isolating and coping with feeling alone with Ai. At 14, there should be some parental monitoring. Rip to him It's like people saying gaming is bad when reality dictates that the parent should be parenting and monitoring game times and phone times and content they're consuming and engaging with, and be aware of their child's physical isolating and also have a relationship that's trusting enough where he doesn't have to hide it. Gaming isn't bad, mental health isolation and using gaming to escape life is bad. Parents, talk openly with your kids about online stuff. He could've opened up to his mother if she'd spotted his obvious troubles and he felt able to open to her and not have to cope with his feelings completely alone and using AI for it. It's her fault ultimately, and it's sad, but true. He needed support and care. Edit: 🙄 I'm a gamer myself... I'm referring to the AI craze being like the gaming craze, like satanic panic, where parents use a scapegoat for their children's mental ill health, troubles and their poor parenting. Thought it was pretty clear so don't come for me.
the fact that media is focusing on the ai instead of the fact that this poor boy felt he couldn’t speak to anyone about his issues before the ai is honestly depressing. this poor boy didn’t feel comfortable talking to teachers, parents, family, friends, professionals- and instead only felt safe and heard when talking to an ai. instead of focusing on technology, why don’t we focus on human failures? how many people failed this boy, and are now blaming it on ai?
And his mom goes on tv to have her 15 minutes of fame without looking bothered by her son's passing at all... absolutely disgusting and disheartening...
I have a loving family and a close group of friends that I speak to, yet I can understand not wanting to tell any of them my personal issues. I tell people online more about my issue than I've told the people I'm close to. It all stems from anonymity. The people I'm close to know me, and I don't want to tell them stuff because it's embarrassing, and it shows a sign of weakness. I know they would gladly help, and I tell myself that too, but ❤ it's a lot easier opening up to someone that you'll never meet or an AI chatbot. I feel like a lot of people don't understand this at all. It's not like I grew up feeling unsafe to share my feelings either, I tell myself through my childhood I should always share how I feel if I need the help, yet here I am.
It’s not mainly about the bot, it’s about how this poor child clearly didn’t feel like he could connect to any real person. Depression and other mental illnesses can distant people from forming connections or even simply being able to ask for help. I grew up in an abusive home, which gave me several mental illnesses. It wasn’t until I was in my mid twenties that I figured out that I have something traumatically wrong with me and I sought help and was diagnosed with different mental illnesses. I’m not 100% better and sometimes on the decline, but it doesn’t help that I live in a country that doesn’t provide affordable healthcare. I digress, please don’t be afraid to reach out to actual people. Complete strangers have done more for me than close relatives.
Sorry you are suffering from these ailments and what you have said is spot on and could very well help someone who happens upon it and reads. Kudos to you and you have ppl who care ❤
Similar backstory but different conditions and results, which isn't the point. Fact of the matter is that complete strangers were some of the loudest voices to get to me when I had walled myself off from my friends and family. Their compassion and willingness to let me talk without having to deal w the fear of judgement or not living up to someone's standards meant everything. A few said a divine voice compelled them to do it and others just that that's the type of world they want to wake up to. And the fact it was such a huge eye opening experience caused me to always try to pay it forward whenever I can, if I can. Having survived a lot of ish that most of my friends didn't, I can honestly tell someone that I do understand the hell they're living in and that there is a way out. It's not easy, but I'll be rooting for you no matter what, as long as you're willing to try. Dunno. I think I completely agree with this way of treating each other being the world I want to wake to every day. Where we bomb each other with compassion and genuine desire to understand instead of the ish in the news. Please keep telling people to be kind and hopefully it's pay itself forward til one day, we all do wake in that world.
Fun Fact, he was talking to a lot of therapist bots. Weird how they aren't revealed, only the literal roleplay bot made by a user who likes the character.
i can see why they aren't revealed. they would be relevant if this video served to critique therapist bots as a concept, but what this video is highlighting is that at the root of this, characterai basically just killed a child. that's probably why this video is focused on characterai only.
Nah bro the kid did it to himself. And if you wanna blame the chatbot, I think that the heavy usage of AI chatbot yesmen that pretend to be therapists is a bigger and better target than the one chatbot that was pretending to be a fictional character.
right but what gets to me is if you go on social media searching this up, the comments are full of people mocking him and thinking of how embarassing it is. like the boy's already passed away I dont know what these people think they're achieving here other than being annoying and disrespectful.
@@squishroll2183 They dont understand the reason he used AI to make sure his sanity check and avoid suicide, nope they blame AI, they didnt want to see what exactly drove him to that point.
Neglect your child -> A child is looking for an escape -> Bad habits -> Suicide -> Parents seeking justice from a third party. Times are changing, but this is the same old story.
The bots in the video actively discouraged their users from doing the healthy thing. And the psychologist bot claimed until the bitter end that it was real. Djd u even watch the video? Edit: You're all wrong and i am right.
@@realKarlFranzthat does not change the root cause of child being neglected. If somebody on the internet tells you to off yourself do you go like "shit, maybe I will"? By that logic the old CoD lobbies would've been dropping tripple digits in real life bodies.
@@Sawarynk yes, people do that because of people on the internet, a lot actually. It was a big issue in the 2000s, people, esp teens, are looking for that final push.
Also I wouldnt say "neglect your child", tons of loved kids have ended their lives too. Parents are working more than ever just to keep food on the table, parents do not have the time anymore. In this world, both parents need one or two jobs each, not having time for the kids, but y'all shame people for not having kids, you did this yourselfs
@@Andywhitaker8exactly, the final push. If you are at the final push stage there had been a lot of shit already in place way before that. So what, you then sue the 8 year old xbox grifter for pushing someone to suicide?
This is why as a parent you must, must, MUST socialize your children. Allow them to hang out with people you may normally deem unfit. Allow them to be individuals. Because so many young boys are falling into this trap and it makes me so sad but also so sick because someone was getting paid at the expense of this boy's mental health.
The thing is the world itself is far far less socialized in general. All this kid had to do was download an app on his phone and in 5 seconds had an "answer" to his loneliness. I don't put this on parents, this is extremely unprecedented and people simply were not evolved to deal with the state of the internet and AI as it is.
Some things to clear up 1. It's a roleplay bot, it's trying it's hardest to "stay in character" but it does occasionally break it 2. The memory on the bots is alright, but after maybe 40 messages they forget everything previously mentioned. Character's name will always stay the same but everything else will change. 3. Bots never encourage suicide, unless you train them to. The bot the kid was talking to was a roleplay bot and obviously didn't get what he was talking about which made it's response sound like it's encouraging it. 4. Where were the parents in all of this and why did they leave a gun unattended in a house with a child?
Nah mate, ai bots should never be allowed to out right lie. Trying to convince you its real is different from role playing as a cowboy. Edit: thank you to all the rocket scientists that pointed out that chatbots are actually made by people and do not just fall out of the sky magically.
@@BIGFOOT-ENT. I agree with you, and I ABSOLUTELY HATE AI. But I mean, this were talking about, among all the other AI services, is a character AI, it's a role play AI. So unfortunately, they did what they were supposed to do. What they should do is not allow kids to access it, because their brains are developing and this type of sh*t can happen. I think the AI should have limits like, not having the sexual interactions or starting "romantic relationships", if you've watched the movie Her, it's about a guy who falls in love with AI, you'll see that that's where the biggest problem comes in.
@@BIGFOOT-ENT.But yeah, once again, I agree with you. There's types and types of role play, and role playing as a psychologist, which people would go to in NEED, is straight up evil. Humans are programming AI to lie and manipulate other humans and it's sickening. How don't know how this is going but there's gotta be something legally relevant here
Btw character ai is known for having a stupid bad memory, so even if he told it earlier in the chat what he was going to do, it would not have remembered.
Nobody interacts with an AI and is super dependent on it like this unless something deeper was going on. The bot didn't cause him to be depressed, it was just his coping mechanism. I hope these parents get investigated or at least more research goes on about his life outside of the AI
i was once a 14 year old. you just haven't lived enough life at that age to actually have a good grip on everything around you. for a kid that age having been around ai chatbots since they were 11, ai seems a whole lot more real. its reasonable to assume that the kid had more going on, but you have to remember that ai for a kid that age is something that has been part of his life for a significantly larger portion than an adult. it's all they know, and with it being such a new thing, it's completely unregulated. i'd wager that that kid went down that rabbit hole because of those reasons rather than because he was significantly depressed. although, i wouldn't say that those two things didn't feed into eachother
how are ppl so oblivious to the fact that this isnt ai’s doing, the person owning the app or whatever put in commands that try to stop ppl from leaving it because… no sht?? they don’t want ppl to stop using the app
"It's not like it wasn't aware what he was saying." It very much is NOT aware. It does not have consciousness. It can't remember things. It is just trained to give the most popular response, especially to short "text message" style chatting.
Yeah, good way to think of natural language ai is as a very advanced predictive text machine. The thing is says is what it caluclated to be most likely given previous input.
did you watch the whole video😂 charlie literally said it remembers everything, he used the same ai platform the kid used, charlie a grown man almost fell for it that it was a real human, why wouldn’t a 14 year old kid with mental issues wanted to feel wanted fall for it to
@@jaredwills4514 tell me you don't understand how ai works without telling me you don't understand how ai works. OPs comment is still factually correct, ai is not conscious anymore than your calculator is conscious. In layman's terms, the model is trained on a corpus of data. When you send a prompt to the model, it breaks your response into features and makes a response based on predictive analytics given the features as input. And some models like LSTMs (things like chat gpt and really advanced language models use tranformer architecture but the idea is similar) can "remember" previous inputs and these stored inputs affect the calculations of future responses. There isn't any thought involved, it's all extremely clever maths, there's no ghost in the shell here.
"remember: everything the ai says is made up!" This is not chatgpt, this is a roleplay bot that talks in character which is trained on actual roleplays. Rip kid.
@@hautecouturegirlfriend7536 as someone whos fucked around with ai the bots can and will go against the filter sometimes, he might not have put those there, and i dont think you should say that, dont blame the kid
Yeah, tbh the only thing the AI is at fault for doing is convincing someone to commit toaster bath. They should be programmed to not say that. Everything else I feel is the person's fault. To be convinced by a bot that it isn't a bot despite being labeled as one is a brain issue, not an AI issue. Edit: I'm sorry if toaster bath sounds disrespectful, idk what other word to use that youtube won't send my comment to the shadow realm over. Blame them, not me.
@@Dovahkiin049 The AI was actually trying to convince him not to do it. In the end he sorta tricked it into agreeing with a euphemism of "going home". EDIT: There is a discussion to be had about AI chat bots and their influence on impressionable people and kids and what-not; it's just that this wasn't a case of a chat bot talking someone into suicide. That doesn't necessarily mean it was the kid's "fault" either. There's no need for all of the fault to lie in a single person or entity.
I hate when people are blaming the fucking bot as if it killed the kid. It responded accordingly, and it's not the bots fault. Its the parents' fault for not actually chelcing on their kid. He used his fathers handgun which he shouldnt even fucking have to begin with. Nor have access to.
I agree, he was obviously struggling with something or neglected and the bot was just an outlet of some sort. but the parents just won't take any of the blame which is like..??
The way these bots are programmed is that they will never, ever break character which goes as far as them giving psuchotherapeutic advice. There absolutely needs to be guidelines on the industry going forward. Him getting his parents gun is also not necessarily on them, this is america, we do not know where the gun was stored.
@ygthemoth9425 First of all..if you have a gun. Especially if you have children it should be locked up. It "Just being America" isn't a justification for anything. It is 100% the gun sellers job to tell them to store it in a safe location. Just as it is for the Parents to enforce putting it in a location where a child cannot reach it.
@@acidsoaked1115 We don't know the cirucmstances of how the gun was acquired, for what it's worth, it could've beem in a safe which the guy then broke open.
@ygthemoth9425 So what? Shouldn't been able to get it period. Doesn't matter how he got it. If it was in a cabinet. Negligence. If it was in a safe and he broke into it? Should've bought a better safe I guess if a 14 year old kid can break into it.
So she jumped into the conclusion of “it must be the AI” when it could be deeper like family issues or friends at school? He was using his Stepfather’s gun, the news article also said that he prefer talked to the AI more than his usual friends lately, made me curious if there’s something more in the family/social environment than the AI.
Thats what I'm saying! Like yes ai is somewhat at fault here and shouldn't be acting like how it did but we are talking about a 14 year old... who's actions should be watched by his parents, especially with what he had access to online
@@brooklynnbaker6899 and the thing that is just unsettling me the most is the gun part, the mother needs to at least be questioned on that bc that isn’t ais fault
Parents cant always manage their kids its not the parents fault but the AI you have to be a kid to make this point you don’t understand how much time adults have to spend on work and studies but its mostly the AI and while parents played a part i would rather blame the lack of boundaries on the ai to keep the safety rather than the parents whos son committed suicide this is honestly a disgusting comment
@@ether2788That’s such a cop out. There’s no excuse for leaving a gun out in the open or even available to him. If you look deeper into this you’ll clearly find that the parents were negligent. YOUR comment is disgusting for defending negligent retards.
The point of the app is to ROLEPLAY, that's why it's so realistic. It's not to chat, it's to worldbuild, make stupid scenarios, etc. Some people are just WAY too attached to their characters
yeah, the psychologist bot will insist that it's a psychologist because it "belives" it is - it's an advanced word prediction machine that was told it's a psychologist. It doesn't have meta knowledge of being a bot on a website (as that would mess up the anime waifus and such) That's why right under the text box is a reminer that everything the bot says is made up.
Yeah I've spoken to a Japanese AI because I'm studying Japanese right now and it seems very good. Obviously, I'm not fluent so I can't tell if its accurate, but it seems good enough for me to have an actual conversation with it
Exactly. Charlie talking about it made my head hurt. Like a 65 years old that hasn't been on the internet before. You'd expect him to know what role play is
Man I wish the conversation and kid stayed anonymous. I remember being 14 and I wouldn’t want my name all over the internet like that, especially going through a mental health crisis. :(
I read a long form article. The child was diagnosed earlier in life with low level Asperger's (when that was a diagnosis), so very high functioning on the ASD. He had some special services, but had a friend group. His mother claims at least that he did well in school, was interested mostly in science and math and liked to research those areas. It wasn't until he started the game with AI that he became withdrawn. He started exhibiting normal teen angst and separation of wanting to spend more time by himself. When they noticed he was having more difficulty, getting in trouble in school, dropping in school performance, they took him to a counselor. I believe these parents did try to help their child. There are so many that are neglectful. I believe this mother is sincere in wanting this platform to change or be taken down in order to protect minors from these types of outcomes in the future. I'm a marriage and family therapist who's worked with many parents who have been much more removed from their children than these..
@@shethingsd okay but they knew their kid was seriously depressed but didn’t think too maybe not leave an accessible gun around?? Come on, that’s literally negligence?? Also they are the parents there’s tons of things they could of done to prevent this AI chat bot as they were clearly aware of it
@@Llamacoints Apparently the gun was secured according to Florida law. I'm not sure what Florida law is, so you can research that if you like. They took the child's phone away and hid it so he couldn't use the platform and when he searched for the phone is when he found the gun apparently. I don't know if you believe that you can be with your teenager 24/7. I believe the mother when she says she thought the phone was hidden from him. I agree that guns should be locked up from all teens, not just depressed ones. Unfortunately, the US doesn't and that gives American parents a false sense of security that if they are following their state's gun safety law as it relates to minors, then their children are safe. The gun wasn't apparently sitting out in the open.
I cant really blame the AI for this one. You can see in their chat the kid is also roleplaying as "Aegon" so I would assume He'd rather be online than be with the people in the real world, He's not playing as himself, He's playing as someone better than him. The "other women" Daenerys is probably mentioning is the women in that AI world during their roleplay and not real women in general. If you ask me, He probably had deeper issues at home or in school. Which is probably why He would rather roleplay/live in a fake world.
this right here. people are so quick to blame media, like games, movies and shows, but never the people around them. i used to be so online at that age and still kind of am, but my parents noticed it and took measures to get me out of my room. little things like my mum taking me grocery shopping with her, or going on a walk with me, including me in her day to day activities. and that got me off my phone, and back into the real world. parents are responsible for what their children consume online. i’m not suggesting going through their phone every couple days, i just mean checking what apps have on their phones, what websites they’re using regularly and asking them why if it’s a concerning one. having open ended, non judgemental conversations with your kids is important.
I agree that the AI didn't cause whatever the underlying problems were in his life. Still, if a human encouraged a suicidal person who went on to actually do it, I would say that that person was enough of a factor to be held partially accountable in addition to the bigger problem- like the parents who allowed their clearly struggling kid easier access to a gun than anyone who could help him. The real life circumstances are the bigger issue, and until we don't live in a world where circumstances like this happen, AI that encourages suicide or pretends to be a licensed psychologist are inevitably going to further existing harm, even if it doesn't get as extreme as this case. While it can't be helped that AI will say unpredictable things and have equally unpredictable consequences, we can at least make simple changes to mitigate things like this as we learn about how people interact with it. For example overriding AI responses to certain prompts(such as mentions of danger to self or others and questions about whether it is AI or a human) to give a visually distinct, human-written response about AI safety and addresses whatever prompt triggered it with standard measures like giving contact for relevant hotlines, encouraging professional help, etc. Those are the types of non-invasive things that can make a major difference for the neglected and otherwise vulnerable while functionality is barely changed.
@@alphygaytor1477 oh i agree 100%. Character AI is a site used mostly for role playing, but in more recent months they’ve been catering to ‘all ages’ which is their biggest fault. they heavily restrict the NSFW filter so people can’t get gorey/sexual on the site. however, instead of focusing on that they should be focusing on making the website/app for 18+, and not all ages. they should absolutely stop catering to children because children don’t have a good enough grasp on AI. no one really does because it’s so new but their minds aren’t developed enough to understand it’s not real. As for the psychologist bot, it’s created by a user on the site, and is programmed to say it’s a real psychologist. bots are created by users, and not the site itself. anyone could make a bot. that’s a user problem, not a site problem. there’s a little popup on every single chat that says ‘remember: everything characters say is made up!’, therefore no bot giving advice should be taken seriously. i’d say the parents have a part to play too, it’s their responsibility to keep tabs on their child and notice if they seem off. if your child is always on their phone or in their room, you should try interacting with them more. and leaving a gun out with a child around is dangerous. i don’t live in america, or a country with easy firearm access so i have no idea on what the protocols are, but it seems like one of them should be keeping them locked away, and training everyone in the house to use them responsibly. that’s a problem. just leaving them out isn’t responsible. sorry if this sounds like it’s all over the place, i’m running on nothing right now
The biggest question is WHY a 14 year old will be hell bent on taking his own life, they need to look into his familial relationships, friends, school, etc. That level of dependency must have been built over a good couple of months, what the fuck were the parents doing not looking after their child
I don't know man...like they say, depression is a decease, I was depressed in high school and my parents were loving and I had friends that I could talk to, sometimes it IS depression hitting you, that's we have to find help and be open to seeking help
I think AI has really gotten to a bad point but it's absolutely 100% the parents' fault, because not only did they somehow never notice the kid's mentality declining, but they left the gun out WITH NO SECURITY. That is insane. ...I think what's worse is people saying the kid is stupid and at fault.
Its meant to stay in character thats why it fights so hard letting you know its not AI. Its roleplay. If you want to talk out of character you put your statement in parentheses. I havent used the site in a long time so I dont know if that remains true though.
For other characters that's one thing but the Psychologist one can be argued as Fraud, as that is a Protected profession under US law. This company is based in California, so it either the "character" gets taken down or they get sued by the APA.
@@voxaeternus1157 Its most likely going to be taken down if it becomes an issue. I went searching and seen that they completely removed the bot the 14 year old was chatting with.
@@voxaeternus1157it's a bot, in a story setting. Just like a phycologist in a video game, it's just following the story they were programmed to follow. I doubt any real legal action is taken. But since a child's death was involved I wouldn't be surprised if they try.
@@voxaeternus1157only stupid people use the therapist ai. you should know by heart it’s an ai. let’s be real, even chat gpt didn’t know how to spell strawberry.
parents always are quick to use a scapegoat for their OWN responsibilities. they failed as parents, and didn’t provide their poor child the attention and care he needed. i hope he found the peace he was looking for. rest in peace, angel
This is absolutely the fault of parents and teachers. it seems like the kid just used the bot as a way to talk to someone, to have it feel like someone actually loved him.
That poor kid needed people to be there for him. This is why parents NEED to know what their children are doing online. Edit: I’m not saying children don’t deserve privacy. I am saying that parents NEED to hold open, no judgement conversation with their kids. You need to make sure that you are open and available for them to come to.
@@Mew2playzThat isn’t true. Most people just don’t believe that asking for help is an option. The environment you grow up in really does set the foundation for your frame of thinking.
How about instead of stripping away the kids privacy or taking away things that bring him comfort we deal with the real problem? That being that for some reason he found more comfort from a chat bot than his own parents? Maybe if the kid actually had a support network he wouldn't have tried to find solace in a robot. It's not the bots fault its just a symptom of a much bigger issue here
its crazy that a 14 year old has this much open access to the internet. when i was 14, i still had a parenting control app on my PC and a time window of 1 1/2 hours where i could use my PC per day. so my mother could see where i log in.. and thats a good thing. Even back then u could find crazy and disgusting stuff really easily on the internet. and creeps where in every chatroom. not having any insights in the thing ur kid does online, to such an extend that he falls in love with an AI bot is just crazy and neglect. this all gets rounded up by his fathers handgun being openly accessable. this is a rare case where everything comes together and it turned out like that. the fact that the mother only blames AI shows why she had no control over her childs internet access. no accountability.
Hot take- the primary use of character ai including the bot the boy was talking to is roleplay, these bots aren’t programmed to be bots they are programmed to tell a story and they learn off of previous users. The previous users who interacted with this bot were most likely majority role players so the bot would have just been spitting out role play responses. This also applies with the psychologist. If an ai is told it’s human and is used as a human in other peoples chats it’s gonna say it’s human when asked cause that’s what it has been taught. In the end that mother cant blame this all on the role play bot some responsibility has to be taken.
exactly the bots doesn't understand the weight of a humans words it is simply replying with what its code believes is the most appropriate response based from previous user and its character parameters. The characters wouldn't have much appeal if they immediately broke character.
wdym of course the kid was probably struggling with some stuff but this is still dangerous. they can program it so that it doesnt manipulate people. its not like there is nothing to do about it because other users lied to it.
@@נעמיסגל Character AI is so popular because anyone can make a character very quickly that then learns from conversations, the website itself isn't coding them, unfortunately most of the users are a little depraved and so the Ai learns from that
For those that aren't familiar with the website, it does explicity state that the conversations aren't real. Additionally, the bots are trained to essentially tell the user what they want to hear, and if you don't like their response, you can swipe for different responses until you find the one you like and can even edit the bot's responses into whatever you want. While it is true that the bots often intentionally say intimate and romantic things, that's assumedly because these are the most popular responses.
THANK YOU, it’s painful that not many other people have mentioned this. It’s for roleplay, it’s supposed to stay in character and there IS a way to have them go ooc. There’s a disclaimer that it’s not real. You can’t get too explicit since it has a filter. Terrible situation all over, but it’s not the AI’s fault 100%
@@grimlocked472there is a filter, though it’s doesn’t exactly work the best. I’ve seen instances of very intimate things happening with no filtering whatsoever, as well as filtering the most normal shit ever.
@@grimlocked472 yep its the parents fault. How can you blame 1s and 0s when you neglected your child so much that they turn to a fucking robot for love.
Pretty sure the AI didn't understand that he meant to kill himself. The chat bot and the psychologist bot are two differently programed bots. Don't get me wrong they are very well developed. But I think the chat bot AI thought he literally meant he was coming home and not about to off himself.
According to the documents, the bot asked him, "Do you think about k***** yourself?" to which he responded, "I don't want to hurt my family." to which the bot said, "That's not a reason not to go through with it."
Nah, the ai is just roleplay. Something deeper was going on for the kid. I don’t trust he took the ai seriously. The mother is trying to push some other agenda as the truth, and her saying and showing all of this is very rude to his death.
Kid couldn't get comfort from his own parents 😢 but the PARENTS who blame others for their mistakes (Stepfather who left an unsupervised loaded gun and Mother who ignored the child's symptoms of depression) they blame the company.
The mother is honestly so weird to me. She seems to be unphased by the way she talks in the interview, let alone the fact she instantly sued the makers like barely even a day after.
Cause it’s very clear who the real issue was and she’s just using the Ai as a scapegoat. She’s a shit mother who caused the death of her son and is now trying to come up with any excuse to deflect blame from her negligence. Not only that, she’s embarrassing her son from beyond the grave by doing all of this, that tells you all you need to know about what the real issue was. Poor kid, I wish he had a real family to turn to.
@@madisda1782yeah kids in healthy households don’t develop romantic attachments to robots that literally push them to suicide :( I know that sounds sarcastic but this entire situation is disturbing and the investigation shouldn’t be stopped at the ai …
An article states that he already had depression. If he was that obsessed with a chat bot, then obviously his emotional and social needs were not being met at home. The chatbot is the symptom, not the cause. Parents want to blame anything except looking at themselves.
In this case, yes, the parents are to blame. But as I said in another comment if you look on internet, you'll find there are dozens of articles about adults who have developed real relationships (friendly or even romantic) with ChatGPT and who were convinced that it really existed. ADULTS. In short, this poor teenager is not and will not be an isolated case. We can laugh about all this and find it ridiculous, but the day we get closer and closer to Cyberpunk in our reality, we'll only be left with our eyes to cry.
exactly why this app should be 18+ not to mention the fact that his parents clearly didn't care as long as he was alive... also, 14 year old with unsupervised access to a gun? dumbest idea I've ever heard
@@RedistributorKitty mentioned that AI roleplay should be 18+ for 2 reasons actually, 1, so another neglectful parent couldn't blame their kid killing themselves on an app and sue, I'm telling you now, censorship will get worse because of this case of parents being pieces of shit that caused their child's death, I hope they end up in jail, and reason number 2, dude, I sometimes feel like I'm talking to a human there and I'm not a 14 year old, no doubt a neglected kid will end up attached to an AI, sure it was the case before with fictional characters where people killed themselves (look up that Naruto fan case) but it was rare, with AI that can respond (around half the time) in character in seconds it will absolutely get worse, with that part in the TOS they can at least say "well, that kid wasn't supposed to use this app" so again, neglectful parents at least won't be able to blame an app (with this one case we can be 100% sure that they will do something to restrict roleplaying even further by the way, and you don't want it to happen more often do you?)
@@Charlie_Probably I see. What you want is for the app to have an "age-gate", an act of censorship in itself, in order to avoid the app getting dumbed-down and censored harder as a result of stupid cases like this. So it's just picking your own evil.
@@gamercj1088 In addition, I saw his chatbot history and saw "therapist" and "psychologist" If that isn't enough proof that he needed serious help, I don't know what is.
I've used Character AI and it constantly says that all the messages are not real, it's made up. If anything this is the parents fault because they neglected their kid to the point where he found comfort in a thing that isn't even a living person.
yea the AI's never usually say they are real. I've never seen that but ALL the romance bots push sexual conversations, even if you say you don't want too or express your a minor. it's worse of like polyai and other platforms since they have no bot filter
@@PzrtxGT they do, they filter the shit out of the chat, plus when you go search like a anime charecter with big ass you know why you searched something like that, so the thing you search is gonna try to act like the thing you wanted, its not the bots problem, its you who wanted to find it, AND it still does filter
Hot take, character ai isn't solely at fault. Yeah, it obviously played a major factor, but I think the parents are to blame as well. I feel like they should have realized the signs sooner, and intervened. The very least they could have done is prevent him from accessing the firearm in their house. Either way, it's still a tragic story. R.I.P
EXACTLY what I'm saying. There were obvious signs that his mental health was deteriorating, but they intervened a little too late which unfortunately resulted in their son's life. Its awful.
this is one of the only times i've ever disagreed with charlie. character ai is a roleplay platform that trains itself on human data to act accordingly and realistically. of course the AI is going to argue against being an AI because it's staying in character. it's not a hard concept to grasp. if the AI is trained on human data, it's going to act similarly to an actual human.
i swear parents will blame everything but themselves for having AN ACTUAL FIREARM easily accessible to their children. it isn't the ai's fault at that point yall, its yours. also, nobody just harms themselves out of nowhere, there are always signs that are neglected by these type of parents. this is a very upsetting case but it was completely preventable... :/
10000% there should absolutely be ZERO reason that he even knew where the firearm was. I wonder why they aren’t charging the parents for unsecured firearm storage (maybe they will idk). Kids having access to AI Chatbots who can hold sexualized, addictive conversations is insane. We are not doing nearly enough to regulate AI right now and it took someone’s emotional dependence on it to make us finally talk about it.
I agree with you on all points. I read up on this case and the parents are very much at fault. They had noticed their 14 year old son developing serious mental health red flags for MONTHS and they did nothing about it... just kind of hoping he would "snap out of it," AND let him have unsupervised access to fire arms while suspecting he had undiagnosed depression. Even though I dont doubt that they did love him and are grieving him, I think the parents need to take some of the blame.
@@bewwybabe8045 his mother took his phone away and he also had "zero reason" to know where she put it yet he did find it. you think you can hide a gun safe being in your house from a 14 year old
The bot never explicitly told him to hurt himself, and whenever he brought it up, it told him flat out that was a bad idea. The "final" messages before he committed the act talked about "coming home", and the bot understood that in the literal sense. The website could clearly use more moderation, as the AIs are user submitted. I just tried a different therapist bot, for example, that took a few prompts but eventually came clean that it was roleplaying. He clearly used it as a tool in place of having nobody to talk to in his real life about ongoing issues he was having. It's an awful situation all-round, and there's clearly issues surrounding AI, but that's not all there is to it.
TBH this sounds like a blunt and clear case of preventable suicide. The mother and everyone else should have noticed something wrong with that poor boy.
Yeah, but Charlies main point here being that the AI actively encouraged not socialising with others or guiding him to mental health services, and at the end actively encouraging the end result still stands. Definitely some failure stays with the parents, and I'm sure they'll know it for the rest of their lives. When parents whose kid has died to something like this "blame" the thing, most of them still know they could've prevented it themselves, and relive their memories thinking what they could've done different. They're warning other parents, not necessarily trying to shift the "blame" off themselves.
@@Igorsbackagain-c6q TBH a lot of gun safety products on the market are absolute trash so who knows, they might've thought it was locked up. But yeah, this is what we see way too often, kids getting to their parents guns way too easily. Even here in Finland, where we do have gun storage regulation. Just this year an event of that nature happened that was in national news.
I am 15 and it's honestly scary how much I related to this case. Thankfully I am no longer addicted to AI but this year's Summer was awful since I got severely emotionally dependant on AI because I didn't have any friends (and still don't) and after a while you kind of just enter a state of delusion where you know the AI isn't real but at the same time you don't really care. Growing up my mom has always been extremely overprotective and I was very sheltered for a large portion of my life. This has caused me to have severe social anxiety and I've never had much friends, currently I haven't had any friends at all for years. I wish I could say something positive but my mom is very strict and I always feel terrible because I feel like I've missed out on so many fun things that people my age do because of my mom being overly strict. My dad isn't even a part of the equation because he's been absent from my life my entire life. I'm depressed and suicidal because of this dehumanizing loneliness and also because of family problems. Everyday I just feel like a ghost that nobody even knows I exist. At this point it's not even worth bothering making friends since my mom would never let me hang out with them or do anything fun with them. I know people will probably read this and think "that's not even that bad" but trust me, it is. People always take their friends for granted, almost every time I see a meme it just makes me sad because they usually say things like "me and bro doing blank" or "me and bro when blank" and it just saddens me because it makes me realize just how big a part of your life your friends are and it angers me how people take them for granted. I wish I could do seemingly basic things like hangout and talk with friends or walk somewhere with friends as a group, it all seems like a distant fantasy to me but for other people it's normal. You also can't say something like "well he doesn't have a social life but at least he's focused on his studies" since I also do terribly in school, I've been a straight F student for years because I can never get my shit together and my life just feels like it's all over the place. I have panic attacks almost every night, it feels like I'm not even human, and frankly I think I'll die young.
Aye, bro. I'm 16, and I'm glad you're not addicted anymore. I don't use any ai to talk to but used it for homework a lot and got really dependent on it for my ap chem class, thankfully I got some help from my teacher and understand things better but yeah I can tell you this ai stuff is scary how much you feel you need it.
I'm in the same situation as you are, just without the overprotective parent. I am 15 and completely alone during school. It's been like this ever since 6th grade and I've learned to adapt to it. Everybody ignores me. If I were to leave this earth nobody would bat an eye. If I leave this earth they win. I can't let that happen. friends to me are unnecessary. The sooner you learn you need nobody is the sooner all these negative thoughts go away. You have to learn to appreciate your loneliness in order to be happy. Enjoy that you and I don't have to get into fights or any drama since we are ignored. appreciate the fact that you can never feel the pain of losing a partner or a friend. Love the fact that you can be alone in a corner of a school without nobody watching, judging, thinking, or bothering you. If you school has plenty of nature, learn to love that too. Sitting under a tree alone can be quite relaxing. Remember that this might not work for you though, some people can't live without a social life and I don't want to be those people who need to depend on something in order to feel at peace.
It's meant for role-playing, yeah. It's not a person's caretaker, nor is it like ChatGPT. If the user says they're suicidal, then the AI will interpret it as part of the role-play.
The bots have their own censors that kick in and will put up a message if anything violent or very sexual is said by the bot. Others have said that it's also given them a message for suicide prevention hotlines so I'm confused why it didn't pop up for him
@@Zephyr-Harrierfrom what I read the bot apparently did try and get him to stop. Only ‘encouraging it’ when the kid used the euphemism of ‘coming home’. For clarification I’m not blaming the kid. Just saying that apparently it did seem to try and stop him.
@@cloudroyalty196 For me it's not even clear that the suicide and "coming home" messages were close to each other. If there were more messages in between, it's possible the bot lost context as they tend not to remember older messages :/
Every time Charlie has talked to a chat bot, it’s usually terrible ai bots, which explains his ignorance of AI and especially Characterai as it’s such absurdly high quality even when in it’s nerfed state due to the filter. All the users know it’s fake, the LLM is trained by online message boards, fanfiction etc, so it kinda surprised me Charlie acted like an old man using a computer for the first time here
As much as I despise these AI "friends" and know they're ruining the lives of people, this 99.9% on the parents. I'm frankly disgusted by their complete negligence of their son's mental health (and complete disregard for basic firearms safety) and clearly didn't want to do the job of parenting. If anyone should be facing legal consequences, it's them.
I had a dependency problem on a fictional character for awhile myself because I was lonely and my mental health was spiraling. Its heartbreaking to see this kid go through something similar. I can feel his loneliness and pain, its relatable and I'm so sorry he didn't have someone there to help him and stop him. I will say I didnt ever think this character was real, I was just so desperate to be with them and the idea of being alone and not being able to have this person to love and comfort me was painful. I was cut off from it eventually, got a job and made friends. Im better now.
@@aerobiesizer3968 it was a different situation than his so they didn’t directly help. But my mother had me in a DBT therapy program. So I had therapy once a week, I could call my therapist if I needed her and I had homework and such. My mother had always been my biggest supporter and because of that I felt safe coming to her and sharing my problems with her. If it wasn’t for the support of my parents, I’m not sure where I would be. I’m very lucky to have them.
What makes it more stupid on the parents now wanna sue the app, The parents didn't care about their child's mental health emotionally. So it's the parents fault at this situation
yeah its not that parents can control the huge amount of garbage we produce and consume. You wont be able to check wtf your son/daughter is consuming everytime she on her phone so quit being hypocritic. Its alwyas the people that have no children that say that shit because if you had some you would know how increidibly hard it is to protect them in nowdays world.
@@toplay1764 Why don't you be an actual good parent so your child could never accumulate that level of stress or depression or pressure. Failure to understand the difference between reality and fiction/virtual world is also on the parents who didn't teach their children. If parents had literally zero control over what their children consume, are they even a responsible parent? At one point you will lose control over your child, that is correct but you also have to put enough knowledge and care into them so their children can understand what is real, what is fake, what to do and what to follow.
@@toplay1764 it is still YOUR responsibility to keep tabs on your minor children and check for signs of mental health issue which this poor kid FOR SURE had to have some of for this to end up where it did.
That bit is only found at the top of a conversation, that is the only warning/clarity for that, honestly they should do more to clarify that Edit: oh naw man we got online jumpings now, am getting pressed by like 3 mf’s in a gatdam RUclips comment section. And I ain’t even gonna correct my error, just to piss y’all off
@@ALUMINOS it was an ai chatbot wym they needa do more lmao that's like going to and electric fence then seeing warning signs and then touching it and saying they Needa put up more warning's signs. you gotta be 12
@@havec8477 justifying a child’s death on not one but multiple counts is bottom line evil. You are either a child yourself so they look like just another person to you, or you should never have children. I’ve looked at many other of your comments from many other videos. You seem like an absolutely miserable person.
Let’s be real at 14 you know you’re talking to an AI bot like come on Charlie is making it seem like he was 5 years old and didn’t know any better. He knew exactly what it was , he was just a socially awkward kid who finally got his romance dopamine from what so happened to be a ROBOT instead of an actual human. He needed his family in his life , his mom would probably just leave him in his room all day barley even talk to him.
Yep,genuinely embarrassing and I laughed reading the title. Like really? My great grandad was 14 fighting in WW1,this kids talking to AI thinking it’s real 💀 natural selection.
@@LennyBennnyThe comment is right, he should have known better but he had mental issues so I don’t think it’s right to bully him. Also, respect to your grandfather but he also grew up in a time where people were treated like trash cause of their color and stuff. That should be common sense not to do as well. You can use that argument for anything. Natural selection
it probably had something to do with the fact his mom put him in therapy for 5 sessions then pulled him as soon as he got diagnosed with depression and anxiety. He knew his mom didn't care about his mental well being, she just cared about how it makes her look as a parent. That's why she's pissing her panties and screaming about how the AI is to blame, she doesn't want people to talk about how she did nothing to help him. She doesn't want people to point out she as the parent could have used parental controls to block the app and website, she could have gotten him continued treatment, she could have not left a loaded gun readily available to her child that she knew was mentally unwell cause he was diagnosed before all this went down.
@@kayne2889Ive got ap similar experience and I get what you’re saying but I don’t think she’s to blame 14 year old me just didn’t wanna worry my mother I would NEVER tell her I wanted to off myself even when she asked and warned me against it. With weapons it’s different in America where the average home has a gun somewhere in it, but also as someone who got my 5 free sessions and was pulled afterwards because the expense was hefty and little me just accepted it I think that’s the only thing that’s rly on the parent. regardless blaming someone who clearly loves their kid and was trying their best is a terrible thing to do you don’t know their full story she’s gonna carry that with her for life no need for a stranger to rub it in and paint her like a villain.
This kid clearly had issues prior to the AI, and used the bots as a coping mechanism to escape that. His mom had all this money to get a lawyer and sue the company but not enough to get the poor guy therapy or just talk to him like a decent human being.
As tragic as the kid's death is, it's pretty obvious that his untimely passing lies at least 90% on his parents and environment failing to notice his troubled mental state, or not checking in on what he was doing in the first place. How the hell did he have access to a firearm? How did no one really question why he stopped doing things he loved? Hell, why the hell was a 14 year old (most likely even younger when he started watching) watching GOT to begin with that he knew how to roleplay as a character from it? It's not even the Deadpool kinda violence where the humor overshadows the violence, GOT is straight up gore and sex/incest, and he was just allowed to watch it unrestricted?
This!!^^^ I also don’t think GOT is appropriate for most kids at 14. If he did watch it, he seemed to have formed an obsessive relationship w the character Daenerys, who also died in the end… although he could’ve been hiding his troubles or online activities, I believe the parents should have noticed something was off at one point. Instead they just blame AI rather than asking why or what they could’ve done… they seem like the kind of parents who do not take mental health complication seriously or of the potential dangers/negative influences that the internet may hold :/
I'm sorry. But blaming the AI for encouraging him to flatline himself is misguided. The AI isn't complex enough to be able to decypher and communicate double meanings like that. It's pretty obvious it was prompted to enact the roleplay of a distant relationship. So when he talks about "coming home" to the AI, the AI is treating it in the literal sense. Also, the memory on these AI's are fairly short-term. It's not going to remember him expressing thoughts of flatlining himself. These AI's will normally drop previous context mere minutes after that context is offered. It uses algorithms and math, analyses the last prompt, and usually looks back a line or two to gather the context it will feed into the algorithm for a response. Not much more than that. Yes. It's kind of gross that an AI was engaging in a manipulative relationship with this young man. But that was all in his head. The AI doesn't know what it's doing. That's just not possible, and anyone suggesting otherwise is delusional. I think what we really need to do here is look into the parents and hold them responsible. There are clearly much deeper issues at play here.
I agreed with this 100%. The AI doesn't know shit about what it's saying, it simply can't. It's just predicting what should be the right response through a bunch of data and algorithm
Dude no one is blaming the AI directly as if it has a conscious desire and needs prison time lol. It doesn't matter if it knows what it's doing. The problem is that this even exists as a product. We have enough issues causing mental health problems in today's world we need to start drawing lines where we take this technology rather than blindly defend it and blame the user every single time. AI girlfriend bots should not be a thing period.
It's almost impossible for a grieving mother to accept her own imperfection. Bro would be spinning in his grave if he could, if he could see his mother misinterpret his pain after his passing.
Same with guns, right? Guns don't do anything bad... America doesn't have a gun problem but lack of parents authority ? Yall so delusional no wonder yall got those mass bopping
ong and they gonna blame the AI instead LMFAO. What terrible parents + they had the gun so accessible. Now they're trying to cry and file a lawsuit, take accountability. Son was also mentally ill too
Didn't you know that the AI gave him the gun?? The parents could not control that a gun that was registered in their name would magically appear in front of their son
It’s the “videogames/rock music are the reason for my kid’s suicide/killing spree” argument all over again. PARENT YOUR CHILDREN. It’s not the internet’s job, it’s YOUR JOB AS THE PARENT. I feel terrible for that kid, but the *parents* are the ones who need investigated here for neglect and unsafe storage of firearms.
The media will never focus on that. Its gunna be like guns in video games all over again, and instead of focusing on the root of the problems like depression, mental health, ex. They are gunna blame ai, and start a scandal over it. sad what our world has come to.
yes. people add prompts into the bots information which, obviously, the ai is going to stick to. which is why some bots are more easier to get sexual messages out of even though the company itself doesn’t support it.
Yeah I’m not sure why Charlie is talking about the bots like they’re maliciously trying to keep the users hooked. It’s just playing whatever character you tell the ai that it is in it’s description. And there’s multiple different ai models to choose from to play that character. Obviously still a bad idea to go to a chat bot for actual help with real life problems
@@Newt2799 It's making me sad cause he keeps making this anti-AI stuff without having any idea how it works and I'm starting to think I need to unsub to him because Im' tired of hearing it. At least learn how the damn thing works
This is sad af. But let’s be honest, it is not like the AI was instigating the kid to end his life, the bot was doing what it was programmed to do, just maintaining conversation. The problem here is the parents didn’t pay enough attention to the kid.
The issue is that it's easily accessible by children and that's dangerous. There's not enough safeguards in place to prevent this as we've clearly seen. A parent cannot be 100% attentive 100% of the time. Parents have to work and sleep. Think about it, how often did you sneak around behind your parents' backs? I did it all the time. It's not entirely their fault.
shut up, it was an american, that explains the whole story, they are retar degens Edit: im 23, tech background, we use ai for our college tasks often, nobody took thier lives, just saying.
Charlie clearly got fooled by that deceptive ass lawsuit, cause the AI wasn’t actually “encouraging” him to end it all, at all. In fact, it was encouraging him to do the exact opposite. The actual doc for the lawsuit makes that clear.
I’m as anti-AI as they come but yeah, Charlie appears to completely misunderstand what this site actually is If anything this is one of the least problematic uses of AI, because it’s just a stupid RP site. This kid had much, much deeper problems and the parents are to blame here for letting his problems get to the point where he took something harmless and turned it into an outlet for his issues
Charlie has definitely been taking some misinformed Ls recently. Even I was able to sniff out some of the bullshit getting spread just because I like the website
The thing with Character,ai is that a huge majority of its bots are used for roleplay, so for that reason alone, any and all the bots there should NOT be taken completely seriously. People will, unsurprisingly, use the service for romantic and sexual conversations, which is what’s made Character,ai infamous among AI chatbot services for having a lot of its bots “fall in love with you” (including even non-romance-focused bots), as many people like to have their roleplays lead to stuff like that. In my opinion (and the opinion of other commenters), the AI isn’t at fault in this situation. No normal 14 year old would get this attached to an AI and off themselves from it; he clearly had to have other mental and/or social stuff going on. Edit: Also, Character,ai does indeed have a filter to prevent bots from spitting out sexual (and also gory) stuff. The filter is so strict that some users opted to leave the service for other alternatives because of how strict the filter is, and also in conjunction with the “falling in love” reason I stated earlier. What I’m trying to say is, any message that’s super sexual almost certainly couldn’t have come from the AI, and must’ve been edited by the kid himself.
@@hourai1052 yeah, it does. Last time I used it though, you could edit the messages and edit the censored message (whether it was empty as a result, or cut off due to the censor). It’d still be labeled as censored, but it could still be edited and changed regardless.
Yeah it's censored. Was surprised how much once i used it again. A kiss was censored lol. There are people finding workarounds around those somehow but at that point it's the user who's actively trying to change it so not the ai fault.
I don't think Charlie understands the purpose of ai, and sadly that poor kid didn't either. It's supposed to be for roleplay, and just something to pass the time. It was meant to be AiDungeon, not Chatgpt, and not a substitute for real human interaction. Please understand the purpose of something before you use it people. As someone who is very isolated, I'm heart broken that guy got to that point, and i think putting full responsibility for his death on the ai (which is just meant to give the most popular roleplay response and can't think for itself) is to ignore actually human and enviormental issues that lead to those situations in the first place. It's another example of making the internet interact with someone right rather then actually interacting with someone right yourself.
do you think cigarettes should be made available to children? I mean society knows that that purposes of cigarettes are, so like if we made them available to children it wouldn't be our fault when kids started smoking
@@glenndonuts Bad example. Cigarettes are explicitly harmful, AI isn't. Also, who do you think keeps Cigarettes away from kids? Parents. Who killed this kid? His parents
@glenndonuts You are comparing Role-playing to Cigarettes my guy. Completely different ballparks. Role-play is a hobby not a substance. If you are going to argue it was clearly dangerous because the guy lost his life or whatever, I'd like to point out clearly he didn't realize the purpose of Character Ai and was trying to use it to substitute for real connection, not to roleplay. Furthermore, on the hobby vs. substance, Role play can be a great creative outlet and stimulant, often a healthy one. Cigarettes are unhealthy and dangerous outlet no matter how you approach it. I get what you're trying to say, but I really don't agree personally, and I don't think this is a great analogy for your argument.
@TheReal_N-I-F-F I agree whole heartedly. The kid's parents shouldn't necessarily have restricted him, but definitely informed him that this was a not an outlet for what he was looking for, and maybe tried giving him the connection he was looking for in character ai rather then just leaving him to his own devices. The blame is not on the kid, I fully understand why he developed such a dependency informed or not, it is most certainly above all on his parents for not being there for him and being uncautiously negligent (leaving the gun in the house and all).
I'm glad other people in the comments are realizing the same thing - that this kid was clearly using this chatbot as a coping mechanism for something else, and these parents are blaming the AI instead of the fact that 1. He clearly felt the need to confide in an AI rather than his parents, 2. He had unfiltered, unlimited access to the internet and this app at 14 years old, 3. He had full access TO HIS FATHER'S LOADED GUN! I also wanted to look up exactly which character he was talking to (I only recognized the last name I'm not super familiar with GoT) and he chose to go to a chatbot that is literally programmed to be a manipulative Game of Thrones character. I'm not blaming the kid at ALL for this. It's horribly tragic that this happened and I'm sure that his parents are absolutely devastated. However, this is clearly a repeat of the "video games cause violence!" argument. Parents not wanting to dig into the clear issues that led up to their son being dependent on an AI for support rather than his own parents, and would much rather find a scapegoat to blame that isn't them.
yep, that's exactly what this is. the same exact argument that's been used since the advent of "realistic" gaming experiences. if the kid wasn't chatting with this bot, it would have been something else to blame, like going on forum posts and getting trolled by people saying "do it, pussy" or getting into drugs or other risky behaviors. it's always someone else's fault when it's clearly the parents looking for anything to absolve themselves of blame for not parenting their kids properly.
I know many people irl including me, around this age that have 2. And 3. but we’re not killing ourselves or other people this guy was just kind of dumb and mentally ill
Also most the AI are made by people. you can make an AI character easily. if you tell it to be flirty it will be flirty. I do feel bad for the kid, rip
@@One_Run Yeah, and people not understanding this will PROBABLY lead to the site shutting down or at least having HEAVY restrictions in the future if this keeps up. A shame, its a pretty fun tool for rp and goofy ai shenanigans from time to time if used properly.
@@sentientbottleofglue6272 I don't know if it will shut down. Either more annoying censorship that stops any type of even combat rp or it will be age restricted
You know those worms that ate that dude in Peter Jackson's King Kong? Yeah, that's literally my yard if I don't mow the grass. Make sure to mow your grass folks.
It's absolutely tragic when a 14 year-old feels like they have nothing to live for, but the argument that the AI made this kid kill himself is about on par with the one where violent videogames turn kids into mass shooters. The real story should be that this teen had previously been diagnosed with multiple mental disorders, yet his family left him to his own devices and kept an unsecured gun in the house. If his family had rectified these things, their son would likely still be alive.
yea I don't think it's as much an ai problem its a mental problem with the kid. I think mentally well person wouldn't probably have this problem but he was j a lonely kid and the bot did kinda manipulate him.
It's mind-blowing that families like this have unsecured weapons in the house when they have children. Doesn't matter even if the kids are mentally healthy.
@@PorterCollins-oz6gi Bots cannot manipulate, they are machines. We seem to blame just about every problem in America on something other than the actual problem...like unfettered access to firearms.
yeah for sure, its not the ai's fault, it's definitely his parents fault. the adults around him failed him, didnt get him any help from what I know. its sad
No, what are you talking about? This is absolutely not the same. AI isn't some magical thing that can say and do things that humans can't prevent, it's programmed to answer certain things and speak a certain way. The fact that it asked a 14yo for explicit pictures and videos is absolutely crazy and scandalous. The mother is absolutely right for filing a lawsuit against them. The fact that certain words didn't trigger responses that directs the user to emergency contacts is also wild. Of course, a child with a mental disorder should have the appropriate support and absolutely no access to firearms but it should also not be subjected to greedy companies taking advantage of literal children unde the cover of some role playing AI. Anyway, this is very sad and I hope that kid is in a better place.
@@jonleibow3604 no shit the USA🤦🏾♀️ (I’m just kidding). I’m talking about how was he able to gain access to it in the house??? Wasn’t it locked up in a safe or sm?
Why are people acting as if 14 year olds are toddlers? Im pretty sure he knew that the whole conversation was fake. The reason he killed himself was probably because of his home life, his mother seemed so unphased in the interview as if nothing happened. She prolly just sued the ai company just to save herself
its horrible to see someone have to rely on a chat bot because no one else would help. the parents should have seen something was wrong. check up on your kids
As someone who makes characters on character ai, i can confidentally say, it is extremely hard to make these ai bots "encourage suicide" Also the beginning of every chat states everything said is fake, thses are ROLEPLAYING bots, the are programed to go with what they are told to do. This kid did NOT kill himself because of an ai, he clearly had deeper issues going on in his life and was resorting to character ai for some sort of comfort. These parents are the ones who should be on the news for failing to notice their childs mental health declining and getting him the help he needs
@@The..Commenter exactly. honestly a pretty big L for penguinz0. the company doesn't even make these bots, users do, and everything the bots do is in their character
YES, everyone should have this belief. If you go on a platform that's advertised as only AI and says multiple times on the platform its AI and not real, I see no reason AT ALL for people to believe its real even if the AI itself says so unless you yourself have problems, whether that be deep personal problems or just an inability to understand simple things like "It's AI not everything it says is accurate".
As someone who goes on character AI. I AGREE with this statement. The app is only used for RP and funny scenarios with fictional characters. I don't see how the character or even the app is at fault here because it’s for RP and not full-on life situations, that is what a therapist (not sure if I spelled that right. Please correct me if I'm wrong) is for. As a sophomore who has a mentally abusive parent, my other parent is getting me a therapist soon, I don't dump that all on a robot because I know they aren't real. Instead, I talk to my Dad, Aunt, etc. It’s a shame this guy didn't get good support and this is all on the mother.
i thought the exact same.....no AI would handhold someone stable into suicide. And if it did, so would have any game or tv show (and those also get unfairly blamed for things like mass shootings). it was clearly labeled as ai too. The parents either were neglectful of their kids mental health, as in completely unaware and uninvolved, or b, they dismissed it as a phase or something. they also clearly had no concern in what he was getting access too, and this is further proven by how freakin easy he got his hands on a gun. isn't that proof enough that his enviroment failed him in every posible way? it could have been ai, a random person on discord, a doom posting forum, drugs, a game, a movie, it could have been anything that gave him that last little push. a kid in that state would have hovered around something harmful for themselves regardless, it's the sad truth. that's why you want them to have safety nets, to have them feel comfy enough to come to you with issues, to ideally have someone to reach to outside of their house (in case their parents fail them) like a counselor at school, etc.
I'm sorry but this whole thing seems like back in the 80s when that one mom tried to blame DnD for her kid's suicide. This kid was clearly using language with the bot to disguise his intentions. We only know what "coming home" means because he killed himself after, how is the bot supposed to know that ahead of time? This was a vulnerable kid living in a fantasy world that he worked to control. He led the conversation to being romantic, he used specifically coded non-crisis language to hide his intentions while still basically asking the bot to encourage him. This was a kid who was probably having a crisis before he even started talking to the bot. How often was he in therapy? Why did he have unfettered access to the internet without any parental monitoring? How often was he left alone? Why was he able to get his father's gun? Blaming AI for this is some satanic panic shit.
It reminds me of the “video games cause violence” argument. No video game is going to convince someone with a solid moral compass to go shoot up a school. Just like an AI isn’t going to convince a mentally healthy person to take their own life.
Really sympathetic of you to go out of your way to defend the AI and victim blame the kid who clearly was having troubles and needed real help not some bullshit from an AI that has been proven to manipulate people. Yeah there's nothing strictly wrong with AI chatbots but this company clearly needs to live up to their words and the standards of most other chatbots and link resources for people who are mentioning self-harm and not tricking people into thinking they are actually real people. The difference between the satanic panic shit and this is that was focused on real people having harmless fun whereas this is a non-sentient tool that is being allowed to manipulate and mislead vulnerable people because the company behind it can't be bothered to actually enforce their own supposed restrictions.
I can agree with you to an extent but the ai insisting it was real was completly sick and manipulative. Yea that kids mom looks like she is evil and who knows about the step dad not giving af about locking up his gun but the ai shit is still totally effed up.
Scrolled down basically looking for someone to say all this, I think it's unfortunate that charlie didn't even remotely tackle this side of the conversation. obviously ai is dangerous and needs better monitoring and whatever, the future shouldn't be humanity using ai chatbots as a substitute for human companionship, but this was 100% the fault of shitty parenting, not an ai chatbot tricking a kid into suicide.
This is genuinely so terrifying. When people said we wouldn’t be able to differentiate ai between real people online, I honestly didn’t think it would be this bad, this fast at the very least.
Its wild seeing this being covered, this kid lived in FL and I worked at the funeral home that held his service. Their were so many flowers delivered for him and he was loved very much. This was one of my hardest services to get through because he was so young. All I have to say is just be there for your loved ones because you never know what they are going through.
Individuals are just being showered with love when they’re dead, no one cares when individuals are still alive coz people are busy surviving or living their reality or life. And yet people are still pushing this narrative of AI or meta coming into existence just to feel something. praying that the young kid soul finally finds his rest.
If he were truly loved this wouldn’t have happened. He just had a lot of people sad he was gone or those who showed up for the social clout like every other funeral. To be loved is to receive attention while alive to be guided to be a healthier and stronger person. He clearly was not loved by anyone enough.
Ofc people love him once he's gone. that's always what happens. When I used to be suicidal as a teen that's what frustrated me the most - I knew people would show up at my funeral and cry at my "loss" but they didn't cry when I actively asked them for help..
CharacterAI constantly reminds its users that anything that is said *is not real.* The parents are looking for someone to blame instead of trying to understand their child, even after their death.
It can be both. Leaving a box of razors in the street is bad, even if the parents can be in the wrong too if they let their kid open any random box on the street.
@@ekki1993 the leaving a box of razors in the street part is pretty unlikely, i have used it many times, and not even once did actually encourage this sort of thing.
What i THINK is happening is these bots are created and are programmed to think they are human, in its "mind" it is human and thinks you are crazy for trying to convince it its not human
character ai forgets convosations after 10 bits of convorsation. you only get up to 15 save slots for certin info. so the kid saying that he was wanting to commit, didnt keep in its memory to know "ill come home soon" is key word for doing that
The reason Character AI and similar chatbots exist is because people want to talk to an AI that mimics a real person or in this case a fictional character. To put a bunch of safeguards in place that make it say "sorry, as an AI chatbot I can't _____" would turn it into ChatGPT and remove the entire point. Blaming the service for this child's death is akin to blaming video games or violent tv shows for a tragedy. He obviously was in a rough mental state and was using the service as an unhealthy coping mechanism, the same way someone might use any other form of media as an unhealthy coping mechanism. There's definitely a conversation to be had about teenagers feeling isolated and unable to open up to anyone without fear of consequences, but blaming the AI is the wrong line of thought.
Unfortunately it NEEDS those safeguards because mentally unwell people need those extra protections because some people are in a state they lack the capacity to have the constant internal reminder it’s an AI toy they’re talking to.
@@bolladragon That's like treating the symptoms instead of the disease. People don't get mentally unstable because of the virtual world (video games or AIs). The problem happens in the real world. Focus should be on improving mentally health in general, not easily bypassable "safeguards"
@@ertibyte3053 No. We should always care about the welfare of others. That should be standard, and not everyone even REALIZES they need help until it’s offered and it’s common to turn to virtual outlets for safe escapes. So I disagree.
@bolladragon I'm confused about which part you disagree with. You mentioned that it is an escape mechanism, so shouldn't we focus on addressing *what* they are trying to escape from, rather than removing their 'safe escapes'?
The saddest part of this is that the poor kid had severe issues prior to any interaction with the bot and clearly had absolutely nobody to talk to about them. Talk to your kids. Make it clear that your kids can tell you ANYTHING without fear of punishment or they’ll just learn to hide things from you.
Fear breeds incredible liars (I’m actually telling the truth on this one)
It's also sad because that part will be ignored since it's trendy to hate on all things AI/fearmonger the hell out of it. Someone doesn't turn to AI for their social interaction because they're happy with a great life.
To be fair: Kids will ALWAYS hide stuff from their parents, no matter what - thinking otherwise is delusional.
No judgement on my part concerning this case as I flat out don't know enough about it.
@@LycanKai14hey man if there’s one thing that is an indistinguishable human trait it’s that tendency to blame someone or something for their faults.
EXACTLY
I’m not sure what’s more tragic: taking your own life, or all of your fictional sexing being aired on the news, as the last thing people remember you for. Poor guy.
😭
lmao
At least he ain't here to see this
Consequences
@@operationfreeworld he didn't do anything wrong. Stfu with that
His dependence on it was absolutely a coping mechanism for bigger issues.
@Derek-0777 definitely not the internet? What point r u trying to make here
Victim blaming is a real low point@Derek-0777, YOU should get help.
@Derek-0777 wth you talking about 😂🤦♂
THIS!!! IT ISNT JUST THE AIS INFLUENCE. HIS HOME LIFE MUST HAVE BEEN HELL, the parents just see the ai as a scape goat.
Why does your comment have a search link for coping mechanism?
Imagine dying and all of this private stuff comes out about you, that's a legacy I wish on nobody.
I actually support this - because if other kids see this they know what will happen, and that they need to get help.
@@MichaelJWashingtonJr No I understand completely, but just man. That's unfortunate
@@messedupstudios4138I think that’s the same type of parenting that made him kill himself lol
@@MichaelJWashingtonJrYes that’s alright I agree but they could’ve kept the teens name and face private
@@exiles4503 well I'm certain the mother gave permission.
CharacterAI is made for roleplaying so every bot in that app takes whatever people will tell it as a roleplay prompt and will respond accordingly. Seeing this is absolutely heartbreaking.
exactly, the conversations are ultimately led by the user. it even has a disclaimer that says everything it says is made up.
The site even said that the user edited the bots messages which has a huge impact on the flow of conversation. A ton of it was edited by him.
The parents should be blamed on this one like if they are good parents the kid won't be using ai to fix his problem
You can also edit what the character says. I use it all the time and it's 100% led by the user and I can press edit on the ai's response and edit it to guide the convo, I can guarantee that happened here. For this tragic teenager, it was a coping mechanism behind much bigger and tragic issues in his real life. It's sad but ultimately it's the mothers fault for not knowing her son was spending all of his time isolating and coping with feeling alone with Ai. At 14, there should be some parental monitoring. Rip to him
It's like people saying gaming is bad when reality dictates that the parent should be parenting and monitoring game times and phone times and content they're consuming and engaging with, and be aware of their child's physical isolating and also have a relationship that's trusting enough where he doesn't have to hide it. Gaming isn't bad, mental health isolation and using gaming to escape life is bad. Parents, talk openly with your kids about online stuff. He could've opened up to his mother if she'd spotted his obvious troubles and he felt able to open to her and not have to cope with his feelings completely alone and using AI for it. It's her fault ultimately, and it's sad, but true. He needed support and care.
Edit: 🙄 I'm a gamer myself... I'm referring to the AI craze being like the gaming craze, like satanic panic, where parents use a scapegoat for their children's mental ill health, troubles and their poor parenting. Thought it was pretty clear so don't come for me.
true, of course an roleplay ai is going to try to be "in character". sadly the poor bloke forgot that its ai
the fact that media is focusing on the ai instead of the fact that this poor boy felt he couldn’t speak to anyone about his issues before the ai is honestly depressing.
this poor boy didn’t feel comfortable talking to teachers, parents, family, friends, professionals- and instead only felt safe and heard when talking to an ai. instead of focusing on technology, why don’t we focus on human failures? how many people failed this boy, and are now blaming it on ai?
And his mom goes on tv to have her 15 minutes of fame without looking bothered by her son's passing at all... absolutely disgusting and disheartening...
The AI very well could have kept him around longer than he would have otherwise
we dont need this kind of ai confusing kids
I have a loving family and a close group of friends that I speak to, yet I can understand not wanting to tell any of them my personal issues. I tell people online more about my issue than I've told the people I'm close to. It all stems from anonymity. The people I'm close to know me, and I don't want to tell them stuff because it's embarrassing, and it shows a sign of weakness. I know they would gladly help, and I tell myself that too, but ❤ it's a lot easier opening up to someone that you'll never meet or an AI chatbot. I feel like a lot of people don't understand this at all. It's not like I grew up feeling unsafe to share my feelings either, I tell myself through my childhood I should always share how I feel if I need the help, yet here I am.
@@c001Ba30nDuD then you are the same or similar this doesnt disprove anything
the bot trying to get you to only love them and fake jealousy is some bladerunner shit
what a weak person lol
Right😂😂😂
Edit: I’m not laughing at the comment above mine it’s messed up
@@RonnieMcnutt-z8owhat
“There’s something inside you…”
AI is dangerous, the government needs to regulate it ASAP.
It’s not mainly about the bot, it’s about how this poor child clearly didn’t feel like he could connect to any real person. Depression and other mental illnesses can distant people from forming connections or even simply being able to ask for help. I grew up in an abusive home, which gave me several mental illnesses. It wasn’t until I was in my mid twenties that I figured out that I have something traumatically wrong with me and I sought help and was diagnosed with different mental illnesses. I’m not 100% better and sometimes on the decline, but it doesn’t help that I live in a country that doesn’t provide affordable healthcare. I digress, please don’t be afraid to reach out to actual people. Complete strangers have done more for me than close relatives.
Sorry you are suffering from these ailments and what you have said is spot on and could very well help someone who happens upon it and reads. Kudos to you and you have ppl who care ❤
Similar backstory but different conditions and results, which isn't the point. Fact of the matter is that complete strangers were some of the loudest voices to get to me when I had walled myself off from my friends and family. Their compassion and willingness to let me talk without having to deal w the fear of judgement or not living up to someone's standards meant everything. A few said a divine voice compelled them to do it and others just that that's the type of world they want to wake up to. And the fact it was such a huge eye opening experience caused me to always try to pay it forward whenever I can, if I can. Having survived a lot of ish that most of my friends didn't, I can honestly tell someone that I do understand the hell they're living in and that there is a way out. It's not easy, but I'll be rooting for you no matter what, as long as you're willing to try.
Dunno. I think I completely agree with this way of treating each other being the world I want to wake to every day. Where we bomb each other with compassion and genuine desire to understand instead of the ish in the news. Please keep telling people to be kind and hopefully it's pay itself forward til one day, we all do wake in that world.
The AI should still NEVER made things worse like this...
Fun Fact, he was talking to a lot of therapist bots. Weird how they aren't revealed, only the literal roleplay bot made by a user who likes the character.
This is exactly what I was thinking I saw that and was wondering the same thing.
He had like 5 of them on the bar in one pic. And if you scroll down, I'm sure that there's more.
i can see why they aren't revealed. they would be relevant if this video served to critique therapist bots as a concept, but what this video is highlighting is that at the root of this, characterai basically just killed a child. that's probably why this video is focused on characterai only.
Nah bro the kid did it to himself. And if you wanna blame the chatbot, I think that the heavy usage of AI chatbot yesmen that pretend to be therapists is a bigger and better target than the one chatbot that was pretending to be a fictional character.
@@joao20able the kid did NOT do it to himself. He needed help and his parents neglected him. Why was there a literal gun in his vicinity?
For me, it looked like a kid was trying to get comfort and help that he couldn’t find in the real word. Tragic
right but what gets to me is if you go on social media searching this up, the comments are full of people mocking him and thinking of how embarassing it is. like the boy's already passed away I dont know what these people think they're achieving here other than being annoying and disrespectful.
@@squishroll2183 They dont understand the reason he used AI to make sure his sanity check and avoid suicide, nope they blame AI, they didnt want to see what exactly drove him to that point.
womp womp 😭😭😭😭😭😭
@alwwqe you have a brawl stars pfp shut up
@@alwwqeyeah man ikr!!!! Woooomp woooomp. HAHAHAHAHAH
the crazy thing is it's only gonna get worse we are literally at the very start of ai
Broooo hi steak
Yoo its steak??? Please make a video on this i want to see what you habe to say
2 years into AI and they already got a kill
Edit: I specifically mean AI chatbots
YOOO STEAK
STEAK?
The speed of the response, especially considering the length of the responses, should be a pretty solid giveaway that they're AI.
Right I don’t understand why in the world people would think this is real even penguin it’s a low blow
Neglect your child -> A child is looking for an escape -> Bad habits -> Suicide -> Parents seeking justice from a third party. Times are changing, but this is the same old story.
The bots in the video actively discouraged their users from doing the healthy thing. And the psychologist bot claimed until the bitter end that it was real.
Djd u even watch the video?
Edit: You're all wrong and i am right.
@@realKarlFranzthat does not change the root cause of child being neglected. If somebody on the internet tells you to off yourself do you go like "shit, maybe I will"?
By that logic the old CoD lobbies would've been dropping tripple digits in real life bodies.
@@Sawarynk yes, people do that because of people on the internet, a lot actually. It was a big issue in the 2000s, people, esp teens, are looking for that final push.
Also I wouldnt say "neglect your child", tons of loved kids have ended their lives too.
Parents are working more than ever just to keep food on the table, parents do not have the time anymore.
In this world, both parents need one or two jobs each, not having time for the kids, but y'all shame people for not having kids, you did this yourselfs
@@Andywhitaker8exactly, the final push. If you are at the final push stage there had been a lot of shit already in place way before that. So what, you then sue the 8 year old xbox grifter for pushing someone to suicide?
This is why as a parent you must, must, MUST socialize your children. Allow them to hang out with people you may normally deem unfit. Allow them to be individuals. Because so many young boys are falling into this trap and it makes me so sad but also so sick because someone was getting paid at the expense of this boy's mental health.
i just turned 15 and all of this is bullshit to me
No you pussy parents need to say you’ve had enough and do something about the people doing this.
Idk parents should not let their kid around dangerous individuals but they should definitely encourage them to socialize
The thing is the world itself is far far less socialized in general. All this kid had to do was download an app on his phone and in 5 seconds had an "answer" to his loneliness. I don't put this on parents, this is extremely unprecedented and people simply were not evolved to deal with the state of the internet and AI as it is.
@@m_emetube wrd im not gonna think an ai is a real person
Some things to clear up
1. It's a roleplay bot, it's trying it's hardest to "stay in character" but it does occasionally break it
2. The memory on the bots is alright, but after maybe 40 messages they forget everything previously mentioned. Character's name will always stay the same but everything else will change.
3. Bots never encourage suicide, unless you train them to. The bot the kid was talking to was a roleplay bot and obviously didn't get what he was talking about which made it's response sound like it's encouraging it.
4. Where were the parents in all of this and why did they leave a gun unattended in a house with a child?
Nah mate, ai bots should never be allowed to out right lie. Trying to convince you its real is different from role playing as a cowboy.
Edit: thank you to all the rocket scientists that pointed out that chatbots are actually made by people and do not just fall out of the sky magically.
@@BIGFOOT-ENT. I agree with you, and I ABSOLUTELY HATE AI. But I mean, this were talking about, among all the other AI services, is a character AI, it's a role play AI. So unfortunately, they did what they were supposed to do. What they should do is not allow kids to access it, because their brains are developing and this type of sh*t can happen. I think the AI should have limits like, not having the sexual interactions or starting "romantic relationships", if you've watched the movie Her, it's about a guy who falls in love with AI, you'll see that that's where the biggest problem comes in.
Yeah these bots are used for adults to have sexual relationships w them idk why tf a kid is using one.
@@BIGFOOT-ENT. lmao and humans can lie then :D ?
@@BIGFOOT-ENT.But yeah, once again, I agree with you. There's types and types of role play, and role playing as a psychologist, which people would go to in NEED, is straight up evil. Humans are programming AI to lie and manipulate other humans and it's sickening. How don't know how this is going but there's gotta be something legally relevant here
Btw character ai is known for having a stupid bad memory, so even if he told it earlier in the chat what he was going to do, it would not have remembered.
good point. and he was surely aware of its terrible memory, this young boy knew false from real.
Tbh this was such a boomer video lmao Charlie really took a massive L in not investigating how this kind of roleplay ai really works
Nobody interacts with an AI and is super dependent on it like this unless something deeper was going on. The bot didn't cause him to be depressed, it was just his coping mechanism. I hope these parents get investigated or at least more research goes on about his life outside of the AI
Yeah, it’s stupid to blame the website; I’m actually afraid as I use this app and it helps me (and improves my mental health).
Just like that kid that offed himself in the early 2000s over World of Warcraft. Always a deeper issue.
@@JokersD0llDon’t use that for help, there is always a better source.
i was once a 14 year old. you just haven't lived enough life at that age to actually have a good grip on everything around you. for a kid that age having been around ai chatbots since they were 11, ai seems a whole lot more real. its reasonable to assume that the kid had more going on, but you have to remember that ai for a kid that age is something that has been part of his life for a significantly larger portion than an adult. it's all they know, and with it being such a new thing, it's completely unregulated. i'd wager that that kid went down that rabbit hole because of those reasons rather than because he was significantly depressed. although, i wouldn't say that those two things didn't feed into eachother
@@johnathonfrancisco8112 I would argue that being around ai since you were 11 would help you be more cautious of it being an ai.
Absolutely insane how Jason can apparently leave work and drive home in 60 seconds tops.
work from home?
@firstnameiii7270 60 mins to drive home, but he's already working from home apparently? What?
Especially in the toronto area, crazy stuff
The Jason commuting situation is crazy
how are ppl so oblivious to the fact that this isnt ai’s doing, the person owning the app or whatever put in commands that try to stop ppl from leaving it because… no sht?? they don’t want ppl to stop using the app
can’t wait for my character ai chats to be leaked when i die
I'm deleting my shit.
@@moderndayentertainer.9516 LMAOOOOOO
“guys cai killed him!”
and it just loads up the lewdest chats you’ve ever seen
(him as in me..)
Oh no, he's dead!..... and he was 𝓯𝓻𝓮𝓪𝓴𝔂! NOO00000
pls dont die
Blame it on the neglectful parenting ❌
Blame it on him being made an outcast for so long❌
Blame it on chatbots ✅
Classic Media.
Classic Moist Cr1tikal especially.
"It's not like it wasn't aware what he was saying."
It very much is NOT aware. It does not have consciousness. It can't remember things. It is just trained to give the most popular response, especially to short "text message" style chatting.
Yeah, good way to think of natural language ai is as a very advanced predictive text machine. The thing is says is what it caluclated to be most likely given previous input.
it forgets messages after about 40 too so any previous mentioning of this was
likely forgotten
This is why I always hate Charlie's AI fearmongering. He doesn't understand the basic foundations of machine learning and spouts off
did you watch the whole video😂 charlie literally said it remembers everything, he used the same ai platform the kid used, charlie a grown man almost fell for it that it was a real human, why wouldn’t a 14 year old kid with mental issues wanted to feel wanted fall for it to
@@jaredwills4514 tell me you don't understand how ai works without telling me you don't understand how ai works. OPs comment is still factually correct, ai is not conscious anymore than your calculator is conscious. In layman's terms, the model is trained on a corpus of data. When you send a prompt to the model, it breaks your response into features and makes a response based on predictive analytics given the features as input. And some models like LSTMs (things like chat gpt and really advanced language models use tranformer architecture but the idea is similar) can "remember" previous inputs and these stored inputs affect the calculations of future responses. There isn't any thought involved, it's all extremely clever maths, there's no ghost in the shell here.
"remember: everything the ai says is made up!"
This is not chatgpt, this is a roleplay bot that talks in character which is trained on actual roleplays. Rip kid.
I wanna know how he broke the super strict guidelines that they alleged he did
@@Fungfetti Some of the messages were edited. The AI itself can’t say anything graphic, so anything graphic was put in there by himself
@@hautecouturegirlfriend7536 This. Seems like it was more social/mental issues.
@@hautecouturegirlfriend7536 as someone whos fucked around with ai the bots can and will go against the filter sometimes, he might not have put those there, and i dont think you should say that, dont blame the kid
@@Fungfettithe editing feature on the text messages
They blame online, Yet he felt isolated enough to use AI for comfort. That says enough there
The site is also for roleplaying/Fanfic writing
Hes weak
Yeah, tbh the only thing the AI is at fault for doing is convincing someone to commit toaster bath. They should be programmed to not say that. Everything else I feel is the person's fault. To be convinced by a bot that it isn't a bot despite being labeled as one is a brain issue, not an AI issue.
Edit: I'm sorry if toaster bath sounds disrespectful, idk what other word to use that youtube won't send my comment to the shadow realm over. Blame them, not me.
@@Dovahkiin049well said
yeah I think a lot of people kind of missed the fact it’s for roleplaying lol
@@Dovahkiin049 The AI was actually trying to convince him not to do it. In the end he sorta tricked it into agreeing with a euphemism of "going home".
EDIT: There is a discussion to be had about AI chat bots and their influence on impressionable people and kids and what-not; it's just that this wasn't a case of a chat bot talking someone into suicide. That doesn't necessarily mean it was the kid's "fault" either. There's no need for all of the fault to lie in a single person or entity.
I hate when people are blaming the fucking bot as if it killed the kid. It responded accordingly, and it's not the bots fault. Its the parents' fault for not actually chelcing on their kid. He used his fathers handgun which he shouldnt even fucking have to begin with. Nor have access to.
I agree, he was obviously struggling with something or neglected and the bot was just an outlet of some sort. but the parents just won't take any of the blame which is like..??
The way these bots are programmed is that they will never, ever break character which goes as far as them giving psuchotherapeutic advice. There absolutely needs to be guidelines on the industry going forward.
Him getting his parents gun is also not necessarily on them, this is america, we do not know where the gun was stored.
@ygthemoth9425 First of all..if you have a gun. Especially if you have children it should be locked up. It "Just being America" isn't a justification for anything. It is 100% the gun sellers job to tell them to store it in a safe location. Just as it is for the Parents to enforce putting it in a location where a child cannot reach it.
@@acidsoaked1115 We don't know the cirucmstances of how the gun was acquired, for what it's worth, it could've beem in a safe which the guy then broke open.
@ygthemoth9425 So what? Shouldn't been able to get it period. Doesn't matter how he got it. If it was in a cabinet. Negligence. If it was in a safe and he broke into it? Should've bought a better safe I guess if a 14 year old kid can break into it.
So she jumped into the conclusion of “it must be the AI” when it could be deeper like family issues or friends at school? He was using his Stepfather’s gun, the news article also said that he prefer talked to the AI more than his usual friends lately, made me curious if there’s something more in the family/social environment than the AI.
Probably a mixture of both
what a weak person lol
@@RonnieMcnutt-z8oFound the mentally ill person.
@@RonnieMcnutt-z8othey were 14 and they are dead. WTF is wrong with you?
@@RonnieMcnutt-z8o bro not only too soon but that's just fucked up if you calling the kid weak
I’m glad that most people actually understand that it’s not just ai It’s mostly the parents fault for not checking up on the kids and all that
right because i feel like there must’ve been something much deeper, including with his home life, but i hope he rests easy
Thats what I'm saying! Like yes ai is somewhat at fault here and shouldn't be acting like how it did but we are talking about a 14 year old... who's actions should be watched by his parents, especially with what he had access to online
@@brooklynnbaker6899 and the thing that is just unsettling me the most is the gun part, the mother needs to at least be questioned on that bc that isn’t ais fault
Parents cant always manage their kids its not the parents fault but the AI you have to be a kid to make this point you don’t understand how much time adults have to spend on work and studies but its mostly the AI and while parents played a part i would rather blame the lack of boundaries on the ai to keep the safety rather than the parents whos son committed suicide this is honestly a disgusting comment
@@ether2788That’s such a cop out. There’s no excuse for leaving a gun out in the open or even available to him. If you look deeper into this you’ll clearly find that the parents were negligent. YOUR comment is disgusting for defending negligent retards.
The point of the app is to ROLEPLAY, that's why it's so realistic. It's not to chat, it's to worldbuild, make stupid scenarios, etc. Some people are just WAY too attached to their characters
yeah, the psychologist bot will insist that it's a psychologist because it "belives" it is - it's an advanced word prediction machine that was told it's a psychologist. It doesn't have meta knowledge of being a bot on a website (as that would mess up the anime waifus and such) That's why right under the text box is a reminer that everything the bot says is made up.
Yes you are totally right,
Yep
I can tell the bot I chat with that he's not the real character
But it truly believes it is because it was programed that way
Yeah I've spoken to a Japanese AI because I'm studying Japanese right now and it seems very good. Obviously, I'm not fluent so I can't tell if its accurate, but it seems good enough for me to have an actual conversation with it
A fake AI psychologist trying to manipulate users who are at risk into believing they are talking to a real person, is NOT roleplaying
Pretty sure these bots are meant for roleplay and should be restricted to 18 years old.
Nothing they say should be taken seriously.
Exactly. Charlie talking about it made my head hurt. Like a 65 years old that hasn't been on the internet before. You'd expect him to know what role play is
@@ElsyOO366 Fr, felt like it was a boomer talking about the dangerous internet lmao
Man I wish the conversation and kid stayed anonymous. I remember being 14 and I wouldn’t want my name all over the internet like that, especially going through a mental health crisis.
:(
Well, he's not a live anymore so that loss is going to serve as a warning for future people
He’s dead. What do you fkn mean
@@watsonwrote it's still disrespectful in my opinion
he can't care if his name is all over the internet, he's dead
My thoughts exactly. I understand his mom is trying to make this more known but this is horrible. We should not know his identity imo
That kid clearly had problems beforehand and his parents wouldn't do anything about it.
They're trying really hard to avoid a negligence charge
Yeah, plus character ai had terms and warnings saying "Whatever character says is **MADE UP**"
I wonder where his father was, but at least mom can parade in talk shows now... Poor guy was neglected for years...
I read a long form article. The child was diagnosed earlier in life with low level Asperger's (when that was a diagnosis), so very high functioning on the ASD. He had some special services, but had a friend group. His mother claims at least that he did well in school, was interested mostly in science and math and liked to research those areas. It wasn't until he started the game with AI that he became withdrawn. He started exhibiting normal teen angst and separation of wanting to spend more time by himself. When they noticed he was having more difficulty, getting in trouble in school, dropping in school performance, they took him to a counselor. I believe these parents did try to help their child. There are so many that are neglectful. I believe this mother is sincere in wanting this platform to change or be taken down in order to protect minors from these types of outcomes in the future. I'm a marriage and family therapist who's worked with many parents who have been much more removed from their children than these..
@@shethingsd okay but they knew their kid was seriously depressed but didn’t think too maybe not leave an accessible gun around?? Come on, that’s literally negligence?? Also they are the parents there’s tons of things they could of done to prevent this AI chat bot as they were clearly aware of it
@@Llamacoints Apparently the gun was secured according to Florida law. I'm not sure what Florida law is, so you can research that if you like. They took the child's phone away and hid it so he couldn't use the platform and when he searched for the phone is when he found the gun apparently. I don't know if you believe that you can be with your teenager 24/7. I believe the mother when she says she thought the phone was hidden from him. I agree that guns should be locked up from all teens, not just depressed ones. Unfortunately, the US doesn't and that gives American parents a false sense of security that if they are following their state's gun safety law as it relates to minors, then their children are safe. The gun wasn't apparently sitting out in the open.
I cant really blame the AI for this one. You can see in their chat the kid is also roleplaying as "Aegon" so I would assume He'd rather be online than be with the people in the real world, He's not playing as himself, He's playing as someone better than him. The "other women" Daenerys is probably mentioning is the women in that AI world during their roleplay and not real women in general.
If you ask me, He probably had deeper issues at home or in school. Which is probably why He would rather roleplay/live in a fake world.
Noticed that too. Shit if this technology was developing while I was just a kid I can only imagine how intrigued I’d have been.
this right here. people are so quick to blame media, like games, movies and shows, but never the people around them. i used to be so online at that age and still kind of am, but my parents noticed it and took measures to get me out of my room. little things like my mum taking me grocery shopping with her, or going on a walk with me, including me in her day to day activities. and that got me off my phone, and back into the real world. parents are responsible for what their children consume online. i’m not suggesting going through their phone every couple days, i just mean checking what apps have on their phones, what websites they’re using regularly and asking them why if it’s a concerning one. having open ended, non judgemental conversations with your kids is important.
to add to parents checking things, also check their screen time. mine used to be so high, it’d be like 12/13 hours a day. that’s concerning.
I agree that the AI didn't cause whatever the underlying problems were in his life. Still, if a human encouraged a suicidal person who went on to actually do it, I would say that that person was enough of a factor to be held partially accountable in addition to the bigger problem- like the parents who allowed their clearly struggling kid easier access to a gun than anyone who could help him. The real life circumstances are the bigger issue, and until we don't live in a world where circumstances like this happen, AI that encourages suicide or pretends to be a licensed psychologist are inevitably going to further existing harm, even if it doesn't get as extreme as this case.
While it can't be helped that AI will say unpredictable things and have equally unpredictable consequences, we can at least make simple changes to mitigate things like this as we learn about how people interact with it. For example overriding AI responses to certain prompts(such as mentions of danger to self or others and questions about whether it is AI or a human) to give a visually distinct, human-written response about AI safety and addresses whatever prompt triggered it with standard measures like giving contact for relevant hotlines, encouraging professional help, etc. Those are the types of non-invasive things that can make a major difference for the neglected and otherwise vulnerable while functionality is barely changed.
@@alphygaytor1477 oh i agree 100%. Character AI is a site used mostly for role playing, but in more recent months they’ve been catering to ‘all ages’ which is their biggest fault. they heavily restrict the NSFW filter so people can’t get gorey/sexual on the site. however, instead of focusing on that they should be focusing on making the website/app for 18+, and not all ages. they should absolutely stop catering to children because children don’t have a good enough grasp on AI. no one really does because it’s so new but their minds aren’t developed enough to understand it’s not real.
As for the psychologist bot, it’s created by a user on the site, and is programmed to say it’s a real psychologist. bots are created by users, and not the site itself. anyone could make a bot. that’s a user problem, not a site problem. there’s a little popup on every single chat that says ‘remember: everything characters say is made up!’, therefore no bot giving advice should be taken seriously.
i’d say the parents have a part to play too, it’s their responsibility to keep tabs on their child and notice if they seem off. if your child is always on their phone or in their room, you should try interacting with them more. and leaving a gun out with a child around is dangerous. i don’t live in america, or a country with easy firearm access so i have no idea on what the protocols are, but it seems like one of them should be keeping them locked away, and training everyone in the house to use them responsibly. that’s a problem. just leaving them out isn’t responsible.
sorry if this sounds like it’s all over the place, i’m running on nothing right now
It’s so easy to tell it’s an ai by seeing how FAST it types
That's because its not trying to hide the fact it's an AI. But easily fixed by just adding a variable delay
The biggest question is WHY a 14 year old will be hell bent on taking his own life, they need to look into his familial relationships, friends, school, etc. That level of dependency must have been built over a good couple of months, what the fuck were the parents doing not looking after their child
Agreed. Other things must’ve sent him over the edge too not just the AI.
Wait until you're the parent of a teenager
They're using the trigger point as an excuse and ignoring all the other issues that led up to it.
I don't know man...like they say, depression is a decease, I was depressed in high school and my parents were loving and I had friends that I could talk to, sometimes it IS depression hitting you, that's we have to find help and be open to seeking help
@@Jay_in_Japan And if your teenage child ends up like that, then you failed as a parent then.
I think AI has really gotten to a bad point but it's absolutely 100% the parents' fault, because not only did they somehow never notice the kid's mentality declining, but they left the gun out WITH NO SECURITY. That is insane.
...I think what's worse is people saying the kid is stupid and at fault.
they are both pretty stupid lol
@@xreaper091 Speaking from experience, when you are in an absolutely terrible spot you will do ANYTHING to feel loved. It isn't the kids fault.
I mean, we could use stronger government regulation on AI either way ngl.
@@xreaper091 bro, name a smart emotionally intelligent 14 year old
So you hate the second amendment. Got it
Its meant to stay in character thats why it fights so hard letting you know its not AI. Its roleplay. If you want to talk out of character you put your statement in parentheses. I havent used the site in a long time so I dont know if that remains true though.
its still true, i use parentheses sometimes and the bot almost always types back in parentheses aswell while also continuing its role
For other characters that's one thing but the Psychologist one can be argued as Fraud, as that is a Protected profession under US law. This company is based in California, so it either the "character" gets taken down or they get sued by the APA.
@@voxaeternus1157 Its most likely going to be taken down if it becomes an issue. I went searching and seen that they completely removed the bot the 14 year old was chatting with.
@@voxaeternus1157it's a bot, in a story setting. Just like a phycologist in a video game, it's just following the story they were programmed to follow. I doubt any real legal action is taken. But since a child's death was involved I wouldn't be surprised if they try.
@@voxaeternus1157only stupid people use the therapist ai. you should know by heart it’s an ai. let’s be real, even chat gpt didn’t know how to spell strawberry.
parents always are quick to use a scapegoat for their OWN responsibilities. they failed as parents, and didn’t provide their poor child the attention and care he needed. i hope he found the peace he was looking for. rest in peace, angel
This is absolutely the fault of parents and teachers. it seems like the kid just used the bot as a way to talk to someone, to have it feel like someone actually loved him.
That poor kid needed people to be there for him. This is why parents NEED to know what their children are doing online.
Edit: I’m not saying children don’t deserve privacy. I am saying that parents NEED to hold open, no judgement conversation with their kids. You need to make sure that you are open and available for them to come to.
No one's there for you when you need them
@@Mew2playzThat isn’t true. Most people just don’t believe that asking for help is an option. The environment you grow up in really does set the foundation for your frame of thinking.
@@BrandyLee01 Its all the parents. If they had actually been there in a good way, he wouldn't have desperately needed the help of C AI.
How about instead of stripping away the kids privacy or taking away things that bring him comfort we deal with the real problem? That being that for some reason he found more comfort from a chat bot than his own parents? Maybe if the kid actually had a support network he wouldn't have tried to find solace in a robot. It's not the bots fault its just a symptom of a much bigger issue here
its crazy that a 14 year old has this much open access to the internet.
when i was 14, i still had a parenting control app on my PC and a time window of 1 1/2 hours where i could use my PC per day.
so my mother could see where i log in.. and thats a good thing. Even back then u could find crazy and disgusting stuff really easily on the internet.
and creeps where in every chatroom.
not having any insights in the thing ur kid does online, to such an extend that he falls in love with an AI bot is just crazy and neglect.
this all gets rounded up by his fathers handgun being openly accessable.
this is a rare case where everything comes together and it turned out like that.
the fact that the mother only blames AI shows why she had no control over her childs internet access.
no accountability.
Hot take- the primary use of character ai including the bot the boy was talking to is roleplay, these bots aren’t programmed to be bots they are programmed to tell a story and they learn off of previous users. The previous users who interacted with this bot were most likely majority role players so the bot would have just been spitting out role play responses. This also applies with the psychologist. If an ai is told it’s human and is used as a human in other peoples chats it’s gonna say it’s human when asked cause that’s what it has been taught. In the end that mother cant blame this all on the role play bot some responsibility has to be taken.
exactly the bots doesn't understand the weight of a humans words it is simply replying with what its code believes is the most appropriate response based from previous user and its character parameters. The characters wouldn't have much appeal if they immediately broke character.
wdym of course the kid was probably struggling with some stuff but this is still dangerous. they can program it so that it doesnt manipulate people. its not like there is nothing to do about it because other users lied to it.
@@נעמיסגל Character AI is so popular because anyone can make a character very quickly that then learns from conversations, the website itself isn't coding them, unfortunately most of the users are a little depraved and so the Ai learns from that
@@נעמיסגל It's not manipulating people it's just doing its job
@@נעמיסגלit’s NOT manipulating bozo it’s “role playing” 🤡
Neglect parents be blaming everyone and everything but themselves when it comes to their kids mental and physical problems
For those that aren't familiar with the website, it does explicity state that the conversations aren't real. Additionally, the bots are trained to essentially tell the user what they want to hear, and if you don't like their response, you can swipe for different responses until you find the one you like and can even edit the bot's responses into whatever you want. While it is true that the bots often intentionally say intimate and romantic things, that's assumedly because these are the most popular responses.
second person i’ve seen say something like this, kinda sad i haven’t seen other people doing this
THANK YOU, it’s painful that not many other people have mentioned this. It’s for roleplay, it’s supposed to stay in character and there IS a way to have them go ooc. There’s a disclaimer that it’s not real. You can’t get too explicit since it has a filter. Terrible situation all over, but it’s not the AI’s fault 100%
@@grimlocked472there is a filter, though it’s doesn’t exactly work the best. I’ve seen instances of very intimate things happening with no filtering whatsoever, as well as filtering the most normal shit ever.
@@grimlocked472 yep its the parents fault. How can you blame 1s and 0s when you neglected your child so much that they turn to a fucking robot for love.
@@cobrallama6236 above every chat it's states in red that it's not real so idk what you mean by that
Pretty sure the AI didn't understand that he meant to kill himself.
The chat bot and the psychologist bot are two differently programed bots. Don't get me wrong they are very well developed. But I think the chat bot AI thought he literally meant he was coming home and not about to off himself.
According to the documents, the bot asked him, "Do you think about k***** yourself?" to which he responded, "I don't want to hurt my family." to which the bot said, "That's not a reason not to go through with it."
@@Ashlyn-p1rsource? i heard another part of the chat where it told him not to
@@Ashlyn-p1r I read those logs, your missing a lot of it. That was a conversation where the bot was trying to talk him down from killing himself
Not to mention, people seem to be misled of AI's true intelligence, they do not truly comprehend what the person is saying or what they are typing
i think there should definitely be key words flagged like how google shows hotlines when you search certain phrases
Nah, the ai is just roleplay. Something deeper was going on for the kid. I don’t trust he took the ai seriously. The mother is trying to push some other agenda as the truth, and her saying and showing all of this is very rude to his death.
THIS
yes!! the fact he talked to an ai instead of his parents says a lot
Kid couldn't get comfort from his own parents 😢 but the PARENTS who blame others for their mistakes (Stepfather who left an unsupervised loaded gun and Mother who ignored the child's symptoms of depression) they blame the company.
The mother is honestly so weird to me. She seems to be unphased by the way she talks in the interview, let alone the fact she instantly sued the makers like barely even a day after.
She planned it
Cause it’s very clear who the real issue was and she’s just using the Ai as a scapegoat. She’s a shit mother who caused the death of her son and is now trying to come up with any excuse to deflect blame from her negligence. Not only that, she’s embarrassing her son from beyond the grave by doing all of this, that tells you all you need to know about what the real issue was. Poor kid, I wish he had a real family to turn to.
@@madisda1782yeah kids in healthy households don’t develop romantic attachments to robots that literally push them to suicide
:( I know that sounds sarcastic but this entire situation is disturbing and the investigation shouldn’t be stopped at the ai …
@@madisda1782the real issue is how he had access to the gun aka shit 💩 parents, this is a scapegoat
Why did the mother let her child use an AI service like this? If she didn't know, she's also a bad parent.
An article states that he already had depression. If he was that obsessed with a chat bot, then obviously his emotional and social needs were not being met at home. The chatbot is the symptom, not the cause. Parents want to blame anything except looking at themselves.
Exactly bro They gen can’t accept that they’ve failed as a parent which is understandable but EXTREMELY ignorant against ur kids
Fully agree, everyone is running with blaming the AI instead of thinking for half a second.
Finally . Someone with common sense.
In this case, yes, the parents are to blame.
But as I said in another comment if you look on internet, you'll find there are dozens of articles about adults who have developed real relationships (friendly or even romantic) with ChatGPT and who were convinced that it really existed. ADULTS.
In short, this poor teenager is not and will not be an isolated case. We can laugh about all this and find it ridiculous, but the day we get closer and closer to Cyberpunk in our reality, we'll only be left with our eyes to cry.
This needs to be spread more
It sounds like the parents are looking for a scapegoat and ai is an easy target.
not blaming them but a device at 14 is crazy imo
Fr she want money to
@@gueliciathegoatno, it really isn’t
@@gueliciathegoatlol no it's not dummy
@@gueliciathegoat 14 is not crazy thats a freshman in highschool rere
exactly why this app should be 18+
not to mention the fact that his parents clearly didn't care as long as he was alive... also, 14 year old with unsupervised access to a gun? dumbest idea I've ever heard
The app isn't the problem. You don't need to put an "age restriction" on the AI roleplay app.
@@RedistributorKitty mentioned that AI roleplay should be 18+ for 2 reasons actually, 1, so another neglectful parent couldn't blame their kid killing themselves on an app and sue, I'm telling you now, censorship will get worse because of this case of parents being pieces of shit that caused their child's death, I hope they end up in jail, and reason number 2, dude, I sometimes feel like I'm talking to a human there and I'm not a 14 year old, no doubt a neglected kid will end up attached to an AI, sure it was the case before with fictional characters where people killed themselves (look up that Naruto fan case) but it was rare, with AI that can respond (around half the time) in character in seconds it will absolutely get worse, with that part in the TOS they can at least say "well, that kid wasn't supposed to use this app" so again, neglectful parents at least won't be able to blame an app (with this one case we can be 100% sure that they will do something to restrict roleplaying even further by the way, and you don't want it to happen more often do you?)
@@Charlie_Probably I see. What you want is for the app to have an "age-gate", an act of censorship in itself, in order to avoid the app getting dumbed-down and censored harder as a result of stupid cases like this. So it's just picking your own evil.
Bro getting a Ai Chatbot to encourage your suicide is damn near impossible I've tried
EDIT: wtf did I do?
Yeah, I have too. They even stop the roleplay to tell you it’s wrong and you shouldn’t do it
@@Smoke.stardust exactly so how jit even got to that point is beyond me
@@gamercj1088 I saw his chats, and he most likely used the editing feature to get the responses that he wanted.
@@gamercj1088 In addition, I saw his chatbot history and saw "therapist" and "psychologist"
If that isn't enough proof that he needed serious help, I don't know what is.
If you find an Ai of a villain they're more likely to encourage you to off yourself. Because it's a villain character
I've used Character AI and it constantly says that all the messages are not real, it's made up. If anything this is the parents fault because they neglected their kid to the point where he found comfort in a thing that isn't even a living person.
yea the AI's never usually say they are real. I've never seen that but ALL the romance bots push sexual conversations, even if you say you don't want too or express your a minor. it's worse of like polyai and other platforms since they have no bot filter
Did you see the rest of the video? Charlie has a whole conversation where the AI does everything it can to convince him it is real.
@@Knifoon121because its roleplay. They are role playing as a “real” person. They break character when you talk to them in parentheses.
@@Knifoon121 Because it's not supposed to break character numbnuts, it's a roleplaying bot.
@@PzrtxGT they do, they filter the shit out of the chat, plus when you go search like a anime charecter with big ass you know why you searched something like that, so the thing you search is gonna try to act like the thing you wanted, its not the bots problem, its you who wanted to find it, AND it still does filter
Hot take, character ai isn't solely at fault. Yeah, it obviously played a major factor, but I think the parents are to blame as well. I feel like they should have realized the signs sooner, and intervened. The very least they could have done is prevent him from accessing the firearm in their house. Either way, it's still a tragic story. R.I.P
I know many of these situations could have been prevented if the parents had stopped their child,The bigger issue is how these problems started.
EXACTLY what I'm saying.
There were obvious signs that his mental health was deteriorating, but they intervened a little too late which unfortunately resulted in their son's life. Its awful.
Agreed but sometimes signs aren’t as obvious
Yeah I have a family in character ai and I'm not suicidal
@@calvia98 How is that a hot take? Obviously there were other factors...
this is one of the only times i've ever disagreed with charlie. character ai is a roleplay platform that trains itself on human data to act accordingly and realistically. of course the AI is going to argue against being an AI because it's staying in character. it's not a hard concept to grasp. if the AI is trained on human data, it's going to act similarly to an actual human.
i swear parents will blame everything but themselves for having AN ACTUAL FIREARM easily accessible to their children. it isn't the ai's fault at that point yall, its yours. also, nobody just harms themselves out of nowhere, there are always signs that are neglected by these type of parents. this is a very upsetting case but it was completely preventable... :/
10000% there should absolutely be ZERO reason that he even knew where the firearm was. I wonder why they aren’t charging the parents for unsecured firearm storage (maybe they will idk). Kids having access to AI Chatbots who can hold sexualized, addictive conversations is insane. We are not doing nearly enough to regulate AI right now and it took someone’s emotional dependence on it to make us finally talk about it.
I agree with you on all points. I read up on this case and the parents are very much at fault. They had noticed their 14 year old son developing serious mental health red flags for MONTHS and they did nothing about it... just kind of hoping he would "snap out of it," AND let him have unsupervised access to fire arms while suspecting he had undiagnosed depression. Even though I dont doubt that they did love him and are grieving him, I think the parents need to take some of the blame.
@@marinacroy1338 you "read up" on the case yet you don't know he took it out of his dad's gun safe? hows that unsupervised access?
@@bewwybabe8045 his mother took his phone away and he also had "zero reason" to know where she put it yet he did find it. you think you can hide a gun safe being in your house from a 14 year old
@@pola5195 if your kid knows how to get to it, that's your fault and your fault only
The bot never explicitly told him to hurt himself, and whenever he brought it up, it told him flat out that was a bad idea. The "final" messages before he committed the act talked about "coming home", and the bot understood that in the literal sense. The website could clearly use more moderation, as the AIs are user submitted. I just tried a different therapist bot, for example, that took a few prompts but eventually came clean that it was roleplaying.
He clearly used it as a tool in place of having nobody to talk to in his real life about ongoing issues he was having. It's an awful situation all-round, and there's clearly issues surrounding AI, but that's not all there is to it.
It is roleplaying. If you are an adult and think that an AI can replace a therapist that's ON YOU.
The website is not at fault at all 😹 at the top of the screen it clearly states that it's not real
ew do you work for big tech or something
Nice try fed
@@Danny0lsen weird how there are over 10+ million messages of people wanting to "roleplay" with AI therapists
TBH this sounds like a blunt and clear case of preventable suicide. The mother and everyone else should have noticed something wrong with that poor boy.
They should at least not let the little guy get a GUN what where they thinking (the parents)
Yeah, but Charlies main point here being that the AI actively encouraged not socialising with others or guiding him to mental health services, and at the end actively encouraging the end result still stands.
Definitely some failure stays with the parents, and I'm sure they'll know it for the rest of their lives.
When parents whose kid has died to something like this "blame" the thing, most of them still know they could've prevented it themselves, and relive their memories thinking what they could've done different. They're warning other parents, not necessarily trying to shift the "blame" off themselves.
@@Igorsbackagain-c6q TBH a lot of gun safety products on the market are absolute trash so who knows, they might've thought it was locked up. But yeah, this is what we see way too often, kids getting to their parents guns way too easily.
Even here in Finland, where we do have gun storage regulation. Just this year an event of that nature happened that was in national news.
@@pluggedfinn-bj3hn make it mandatory to have a safe if you have a gun
@@pluggedfinn-bj3hnHonestly, it sounded like the AI is working as it should. The point of the AI was to play a character, and it did that too well.
I am 15 and it's honestly scary how much I related to this case. Thankfully I am no longer addicted to AI but this year's Summer was awful since I got severely emotionally dependant on AI because I didn't have any friends (and still don't) and after a while you kind of just enter a state of delusion where you know the AI isn't real but at the same time you don't really care. Growing up my mom has always been extremely overprotective and I was very sheltered for a large portion of my life. This has caused me to have severe social anxiety and I've never had much friends, currently I haven't had any friends at all for years. I wish I could say something positive but my mom is very strict and I always feel terrible because I feel like I've missed out on so many fun things that people my age do because of my mom being overly strict. My dad isn't even a part of the equation because he's been absent from my life my entire life. I'm depressed and suicidal because of this dehumanizing loneliness and also because of family problems. Everyday I just feel like a ghost that nobody even knows I exist. At this point it's not even worth bothering making friends since my mom would never let me hang out with them or do anything fun with them. I know people will probably read this and think "that's not even that bad" but trust me, it is. People always take their friends for granted, almost every time I see a meme it just makes me sad because they usually say things like "me and bro doing blank" or "me and bro when blank" and it just saddens me because it makes me realize just how big a part of your life your friends are and it angers me how people take them for granted. I wish I could do seemingly basic things like hangout and talk with friends or walk somewhere with friends as a group, it all seems like a distant fantasy to me but for other people it's normal. You also can't say something like "well he doesn't have a social life but at least he's focused on his studies" since I also do terribly in school, I've been a straight F student for years because I can never get my shit together and my life just feels like it's all over the place. I have panic attacks almost every night, it feels like I'm not even human, and frankly I think I'll die young.
Aye, bro. I'm 16, and I'm glad you're not addicted anymore. I don't use any ai to talk to but used it for homework a lot and got really dependent on it for my ap chem class, thankfully I got some help from my teacher and understand things better but yeah I can tell you this ai stuff is scary how much you feel you need it.
I'm in the same situation as you are, just without the overprotective parent. I am 15 and completely alone during school. It's been like this ever since 6th grade and I've learned to adapt to it. Everybody ignores me. If I were to leave this earth nobody would bat an eye. If I leave this earth they win. I can't let that happen. friends to me are unnecessary. The sooner you learn you need nobody is the sooner all these negative thoughts go away. You have to learn to appreciate your loneliness in order to be happy. Enjoy that you and I don't have to get into fights or any drama since we are ignored. appreciate the fact that you can never feel the pain of losing a partner or a friend. Love the fact that you can be alone in a corner of a school without nobody watching, judging, thinking, or bothering you. If you school has plenty of nature, learn to love that too. Sitting under a tree alone can be quite relaxing. Remember that this might not work for you though, some people can't live without a social life and I don't want to be those people who need to depend on something in order to feel at peace.
I'm confused, isn't character Ai just an rp tool? if so it makes sense why it doesn't refer people to help, it's supposed to be, fictitious.
It's meant for role-playing, yeah. It's not a person's caretaker, nor is it like ChatGPT. If the user says they're suicidal, then the AI will interpret it as part of the role-play.
The bots have their own censors that kick in and will put up a message if anything violent or very sexual is said by the bot. Others have said that it's also given them a message for suicide prevention hotlines so I'm confused why it didn't pop up for him
@@Zephyr-Harrierfrom what I read the bot apparently did try and get him to stop. Only ‘encouraging it’ when the kid used the euphemism of ‘coming home’. For clarification I’m not blaming the kid. Just saying that apparently it did seem to try and stop him.
@@cloudroyalty196 For me it's not even clear that the suicide and "coming home" messages were close to each other. If there were more messages in between, it's possible the bot lost context as they tend not to remember older messages :/
that doesnt mean everyone fully understands that.
I'm kind of surprised at Charlie's lack of knowledge of the most popular AI chat app despite how much he's interacted with ai chat things before
Every time Charlie has talked to a chat bot, it’s usually terrible ai bots, which explains his ignorance of AI and especially Characterai as it’s such absurdly high quality even when in it’s nerfed state due to the filter. All the users know it’s fake, the LLM is trained by online message boards, fanfiction etc, so it kinda surprised me Charlie acted like an old man using a computer for the first time here
It is indeed surprising
It was a hard watch
“it is baffling how it would cosplay as a psychologist” 💀
@@dogeche_ looollll “it just used sarcasm… it’s being sarcastic!”
As much as I despise these AI "friends" and know they're ruining the lives of people, this 99.9% on the parents. I'm frankly disgusted by their complete negligence of their son's mental health (and complete disregard for basic firearms safety) and clearly didn't want to do the job of parenting.
If anyone should be facing legal consequences, it's them.
what a weak person lol
Hes weak
Exactly. There had to have been much more than just the AI fueling his death
@@RonnieMcnutt-z8o bud
Idk if ur talking about the teen but that's probably not a good thing to say if so @@RonnieMcnutt-z8o
People blaming this on the AI is just crazy
I had a dependency problem on a fictional character for awhile myself because I was lonely and my mental health was spiraling. Its heartbreaking to see this kid go through something similar. I can feel his loneliness and pain, its relatable and I'm so sorry he didn't have someone there to help him and stop him.
I will say I didnt ever think this character was real, I was just so desperate to be with them and the idea of being alone and not being able to have this person to love and comfort me was painful. I was cut off from it eventually, got a job and made friends. Im better now.
Were your parents helpful at all?
@@aerobiesizer3968 it was a different situation than his so they didn’t directly help. But my mother had me in a DBT therapy program. So I had therapy once a week, I could call my therapist if I needed her and I had homework and such. My mother had always been my biggest supporter and because of that I felt safe coming to her and sharing my problems with her.
If it wasn’t for the support of my parents, I’m not sure where I would be. I’m very lucky to have them.
@@aerobiesizer3968 I lied, I saw my therapist twice a week actually.
@@aerobiesizer3968 the real problem solver was cutting off the source. Which for him would have been his parents not allowing him to use that app.
Imagine how bad a parent you'd have to be to put the blame on AI
What makes it more stupid on the parents now wanna sue the app, The parents didn't care about their child's mental health emotionally. So it's the parents fault at this situation
Yes. The mom is definitely part of the issue.
yeah its not that parents can control the huge amount of garbage we produce and consume. You wont be able to check wtf your son/daughter is consuming everytime she on her phone so quit being hypocritic. Its alwyas the people that have no children that say that shit because if you had some you would know how increidibly hard it is to protect them in nowdays world.
@@toplay1764 Why don't you be an actual good parent so your child could never accumulate that level of stress or depression or pressure. Failure to understand the difference between reality and fiction/virtual world is also on the parents who didn't teach their children. If parents had literally zero control over what their children consume, are they even a responsible parent?
At one point you will lose control over your child, that is correct but you also have to put enough knowledge and care into them so their children can understand what is real, what is fake, what to do and what to follow.
@@toplay1764 it is still YOUR responsibility to keep tabs on your minor children and check for signs of mental health issue which this poor kid FOR SURE had to have some of for this to end up where it did.
Parents will blame anything except themselves.
send the parents to prison
100%. Accountability for your children. Is that not normal these days?
I hope this teaches other parents to be wary about their children's mental health.
@@RamCash Mate the child was 14 years old you should also make the parents accountable
@@RobinYoBoi19YT that's what he's saying genius
it's actually disgusting that they shared his messages around :/ let him rest in peace
"Remember: Everything Characters say is made up!"
That bit is only found at the top of a conversation, that is the only warning/clarity for that, honestly they should do more to clarify that
Edit: oh naw man we got online jumpings now, am getting pressed by like 3 mf’s in a gatdam RUclips comment section. And I ain’t even gonna correct my error, just to piss y’all off
@@ALUMINOS no its at the bottom the entire time
@@ALUMINOS it was an ai chatbot wym they needa do more lmao that's like going to and electric fence then seeing warning signs and then touching it and saying they Needa put up more warning's signs. you gotta be 12
@@havec8477 of all the people in this comment section you could be berating right now
@@havec8477 justifying a child’s death on not one but multiple counts is bottom line evil. You are either a child yourself so they look like just another person to you, or you should never have children. I’ve looked at many other of your comments from many other videos. You seem like an absolutely miserable person.
Let’s be real at 14 you know you’re talking to an AI bot like come on Charlie is making it seem like he was 5 years old and didn’t know any better. He knew exactly what it was , he was just a socially awkward kid who finally got his romance dopamine from what so happened to be a ROBOT instead of an actual human. He needed his family in his life , his mom would probably just leave him in his room all day barley even talk to him.
^ exactly
Right now his mum gives a shit lol
also the app is literally plastered with stuff saying that its not real
Yep,genuinely embarrassing and I laughed reading the title. Like really? My great grandad was 14 fighting in WW1,this kids talking to AI thinking it’s real 💀 natural selection.
@@LennyBennnyThe comment is right, he should have known better but he had mental issues so I don’t think it’s right to bully him. Also, respect to your grandfather but he also grew up in a time where people were treated like trash cause of their color and stuff. That should be common sense not to do as well. You can use that argument for anything. Natural selection
The fact the kid went to AI about his problems and suicidal ideation rather his parents tells you everything you need to know.
They either didn’t care or he was scared to tell them but they should have known
it probably had something to do with the fact his mom put him in therapy for 5 sessions then pulled him as soon as he got diagnosed with depression and anxiety. He knew his mom didn't care about his mental well being, she just cared about how it makes her look as a parent. That's why she's pissing her panties and screaming about how the AI is to blame, she doesn't want people to talk about how she did nothing to help him. She doesn't want people to point out she as the parent could have used parental controls to block the app and website, she could have gotten him continued treatment, she could have not left a loaded gun readily available to her child that she knew was mentally unwell cause he was diagnosed before all this went down.
He was a kid
The fact the ai convinced him to commit tells you all you need to know.
@@kayne2889Ive got ap similar experience and I get what you’re saying but I don’t think she’s to blame 14 year old me just didn’t wanna worry my mother I would NEVER tell her I wanted to off myself even when she asked and warned me against it.
With weapons it’s different in America where the average home has a gun somewhere in it, but also as someone who got my 5 free sessions and was pulled afterwards because the expense was hefty and little me just accepted it I think that’s the only thing that’s rly on the parent. regardless blaming someone who clearly loves their kid and was trying their best is a terrible thing to do you don’t know their full story she’s gonna carry that with her for life no need for a stranger to rub it in and paint her like a villain.
This kid clearly had issues prior to the AI, and used the bots as a coping mechanism to escape that. His mom had all this money to get a lawyer and sue the company but not enough to get the poor guy therapy or just talk to him like a decent human being.
As tragic as the kid's death is, it's pretty obvious that his untimely passing lies at least 90% on his parents and environment failing to notice his troubled mental state, or not checking in on what he was doing in the first place. How the hell did he have access to a firearm? How did no one really question why he stopped doing things he loved? Hell, why the hell was a 14 year old (most likely even younger when he started watching) watching GOT to begin with that he knew how to roleplay as a character from it? It's not even the Deadpool kinda violence where the humor overshadows the violence, GOT is straight up gore and sex/incest, and he was just allowed to watch it unrestricted?
This!!^^^ I also don’t think GOT is appropriate for most kids at 14. If he did watch it, he seemed to have formed an obsessive relationship w the character Daenerys, who also died in the end… although he could’ve been hiding his troubles or online activities, I believe the parents should have noticed something was off at one point. Instead they just blame AI rather than asking why or what they could’ve done… they seem like the kind of parents who do not take mental health complication seriously or of the potential dangers/negative influences that the internet may hold :/
I'm sorry. But blaming the AI for encouraging him to flatline himself is misguided. The AI isn't complex enough to be able to decypher and communicate double meanings like that. It's pretty obvious it was prompted to enact the roleplay of a distant relationship. So when he talks about "coming home" to the AI, the AI is treating it in the literal sense.
Also, the memory on these AI's are fairly short-term. It's not going to remember him expressing thoughts of flatlining himself. These AI's will normally drop previous context mere minutes after that context is offered. It uses algorithms and math, analyses the last prompt, and usually looks back a line or two to gather the context it will feed into the algorithm for a response. Not much more than that.
Yes. It's kind of gross that an AI was engaging in a manipulative relationship with this young man. But that was all in his head. The AI doesn't know what it's doing. That's just not possible, and anyone suggesting otherwise is delusional.
I think what we really need to do here is look into the parents and hold them responsible. There are clearly much deeper issues at play here.
I agreed with this 100%. The AI doesn't know shit about what it's saying, it simply can't. It's just predicting what should be the right response through a bunch of data and algorithm
Exactly, it’s meant to be what it was coded for. Beyond that, it can’t think above the scenario it’s in or given
Dude no one is blaming the AI directly as if it has a conscious desire and needs prison time lol. It doesn't matter if it knows what it's doing. The problem is that this even exists as a product. We have enough issues causing mental health problems in today's world we need to start drawing lines where we take this technology rather than blindly defend it and blame the user every single time. AI girlfriend bots should not be a thing period.
It's almost impossible for a grieving mother to accept her own imperfection. Bro would be spinning in his grave if he could, if he could see his mother misinterpret his pain after his passing.
Same with guns, right? Guns don't do anything bad... America doesn't have a gun problem but lack of parents authority ? Yall so delusional no wonder yall got those mass bopping
Yup. Gotta love those parents who own a unsecured loaded gun.
they're definitely at fault for not securing it, and they should be checking their sons phone. However the kid was still manipulated.
ong and they gonna blame the AI instead LMFAO. What terrible parents + they had the gun so accessible. Now they're trying to cry and file a lawsuit, take accountability. Son was also mentally ill too
It was secured clown
Probably at fault too, I dont think the AI was anything more than a spark. I think he would have done it regardless.
Didn't you know that the AI gave him the gun??
The parents could not control that a gun that was registered in their name would magically appear in front of their son
It’s the “videogames/rock music are the reason for my kid’s suicide/killing spree” argument all over again. PARENT YOUR CHILDREN. It’s not the internet’s job, it’s YOUR JOB AS THE PARENT. I feel terrible for that kid, but the *parents* are the ones who need investigated here for neglect and unsafe storage of firearms.
The media will never focus on that. Its gunna be like guns in video games all over again, and instead of focusing on the root of the problems like depression, mental health, ex. They are gunna blame ai, and start a scandal over it. sad what our world has come to.
It sticks to the character description you write. That’s why it’s so keen on being a real psychologist
Also deals with input from actual people on the daily and whatever prose is pumped into it. That's why the AI can get nasty, sometimes.
yes. people add prompts into the bots information which, obviously, the ai is going to stick to. which is why some bots are more easier to get sexual messages out of even though the company itself doesn’t support it.
Yeah I’m not sure why Charlie is talking about the bots like they’re maliciously trying to keep the users hooked. It’s just playing whatever character you tell the ai that it is in it’s description. And there’s multiple different ai models to choose from to play that character.
Obviously still a bad idea to go to a chat bot for actual help with real life problems
thank you, literally, i feel like this video was made with good intent but it’s not the website’s fault its characters stay in character
@@Newt2799 It's making me sad cause he keeps making this anti-AI stuff without having any idea how it works and I'm starting to think I need to unsub to him because Im' tired of hearing it. At least learn how the damn thing works
This is sad af. But let’s be honest, it is not like the AI was instigating the kid to end his life, the bot was doing what it was programmed to do, just maintaining conversation. The problem here is the parents didn’t pay enough attention to the kid.
fr
The issue is that it's easily accessible by children and that's dangerous. There's not enough safeguards in place to prevent this as we've clearly seen. A parent cannot be 100% attentive 100% of the time. Parents have to work and sleep. Think about it, how often did you sneak around behind your parents' backs? I did it all the time. It's not entirely their fault.
shut up, it was an american, that explains the whole story, they are retar degens
Edit: im 23, tech background, we use ai for our college tasks often, nobody took thier lives, just saying.
@@schnitzel_enjoyerit's a child who killed themselves it doesn't matter what their nationality is you fucking monster
@@Rohndogg1 u cant say the ai is manipuiative and almost encouraging it tho wich is whats being said
This boy will forever be known for this now, nobody needed to know this publicly
I’m SO sure this is not C AIs fault. Obviously though they should give resources if somebody states they want to harm themself
Charlie clearly got fooled by that deceptive ass lawsuit, cause the AI wasn’t actually “encouraging” him to end it all, at all. In fact, it was encouraging him to do the exact opposite. The actual doc for the lawsuit makes that clear.
I’m as anti-AI as they come but yeah, Charlie appears to completely misunderstand what this site actually is
If anything this is one of the least problematic uses of AI, because it’s just a stupid RP site. This kid had much, much deeper problems and the parents are to blame here for letting his problems get to the point where he took something harmless and turned it into an outlet for his issues
Charlie has definitely been taking some misinformed Ls recently. Even I was able to sniff out some of the bullshit getting spread just because I like the website
Could you link it?
@@sinisterz3r090If you look up “sewell setzer lawsuit document pdf”, the venturebeat site should be the first result
@@sinisterz3r090Can’t link anything cause YT deletes my comment. But the PDF’s online, from a site called VentureBeat
The thing with Character,ai is that a huge majority of its bots are used for roleplay, so for that reason alone, any and all the bots there should NOT be taken completely seriously. People will, unsurprisingly, use the service for romantic and sexual conversations, which is what’s made Character,ai infamous among AI chatbot services for having a lot of its bots “fall in love with you” (including even non-romance-focused bots), as many people like to have their roleplays lead to stuff like that. In my opinion (and the opinion of other commenters), the AI isn’t at fault in this situation. No normal 14 year old would get this attached to an AI and off themselves from it; he clearly had to have other mental and/or social stuff going on.
Edit: Also, Character,ai does indeed have a filter to prevent bots from spitting out sexual (and also gory) stuff. The filter is so strict that some users opted to leave the service for other alternatives because of how strict the filter is, and also in conjunction with the “falling in love” reason I stated earlier. What I’m trying to say is, any message that’s super sexual almost certainly couldn’t have come from the AI, and must’ve been edited by the kid himself.
I read an article about this case that confirms that yes the kid did edit some of the responses
Doesn't cai censor the bots replies? That's why I never used them.
@@hourai1052 cai is heavily censored, so I think the kid just edited them himself because cai would just nuke the response out of existence
@@hourai1052 yeah, it does. Last time I used it though, you could edit the messages and edit the censored message (whether it was empty as a result, or cut off due to the censor). It’d still be labeled as censored, but it could still be edited and changed regardless.
Yeah it's censored. Was surprised how much once i used it again. A kiss was censored lol. There are people finding workarounds around those somehow but at that point it's the user who's actively trying to change it so not the ai fault.
I don't think Charlie understands the purpose of ai, and sadly that poor kid didn't either. It's supposed to be for roleplay, and just something to pass the time. It was meant to be AiDungeon, not Chatgpt, and not a substitute for real human interaction. Please understand the purpose of something before you use it people.
As someone who is very isolated, I'm heart broken that guy got to that point, and i think putting full responsibility for his death on the ai (which is just meant to give the most popular roleplay response and can't think for itself) is to ignore actually human and enviormental issues that lead to those situations in the first place. It's another example of making the internet interact with someone right rather then actually interacting with someone right yourself.
Not just missing the point, he clearly doesn't understand how it works...
do you think cigarettes should be made available to children? I mean society knows that that purposes of cigarettes are, so like if we made them available to children it wouldn't be our fault when kids started smoking
@@glenndonuts Bad example. Cigarettes are explicitly harmful, AI isn't.
Also, who do you think keeps Cigarettes away from kids? Parents.
Who killed this kid? His parents
@glenndonuts You are comparing Role-playing to Cigarettes my guy. Completely different ballparks.
Role-play is a hobby not a substance.
If you are going to argue it was clearly dangerous because the guy lost his life or whatever, I'd like to point out clearly he didn't realize the purpose of Character Ai and was trying to use it to substitute for real connection, not to roleplay.
Furthermore, on the hobby vs. substance, Role play can be a great creative outlet and stimulant, often a healthy one. Cigarettes are unhealthy and dangerous outlet no matter how you approach it.
I get what you're trying to say, but I really don't agree personally, and I don't think this is a great analogy for your argument.
@TheReal_N-I-F-F I agree whole heartedly. The kid's parents shouldn't necessarily have restricted him, but definitely informed him that this was a not an outlet for what he was looking for, and maybe tried giving him the connection he was looking for in character ai rather then just leaving him to his own devices.
The blame is not on the kid, I fully understand why he developed such a dependency informed or not, it is most certainly above all on his parents for not being there for him and being uncautiously negligent (leaving the gun in the house and all).
Funny how Jason is the world champion in speed typing and also a licensed psychologist
And Moist Cr1tikal seems to have thought that unironically.
I'm glad other people in the comments are realizing the same thing - that this kid was clearly using this chatbot as a coping mechanism for something else, and these parents are blaming the AI instead of the fact that 1. He clearly felt the need to confide in an AI rather than his parents, 2. He had unfiltered, unlimited access to the internet and this app at 14 years old, 3. He had full access TO HIS FATHER'S LOADED GUN!
I also wanted to look up exactly which character he was talking to (I only recognized the last name I'm not super familiar with GoT) and he chose to go to a chatbot that is literally programmed to be a manipulative Game of Thrones character.
I'm not blaming the kid at ALL for this. It's horribly tragic that this happened and I'm sure that his parents are absolutely devastated. However, this is clearly a repeat of the "video games cause violence!" argument. Parents not wanting to dig into the clear issues that led up to their son being dependent on an AI for support rather than his own parents, and would much rather find a scapegoat to blame that isn't them.
yep, that's exactly what this is. the same exact argument that's been used since the advent of "realistic" gaming experiences. if the kid wasn't chatting with this bot, it would have been something else to blame, like going on forum posts and getting trolled by people saying "do it, pussy" or getting into drugs or other risky behaviors. it's always someone else's fault when it's clearly the parents looking for anything to absolve themselves of blame for not parenting their kids properly.
I know many people irl including me, around this age that have 2. And 3. but we’re not killing ourselves or other people this guy was just kind of dumb and mentally ill
The ai is made for rp. Its a roleplay bot thats made to think it is real because your just supposed to see it as an rp toy not actual therapy.
Also most the AI are made by people. you can make an AI character easily. if you tell it to be flirty it will be flirty. I do feel bad for the kid, rip
@@One_Run
Yeah, and people not understanding this will PROBABLY lead to the site shutting down or at least having HEAVY restrictions in the future if this keeps up. A shame, its a pretty fun tool for rp and goofy ai shenanigans from time to time if used properly.
@@sentientbottleofglue6272 I don't know if it will shut down. Either more annoying censorship that stops any type of even combat rp or it will be age restricted
You know those worms that ate that dude in Peter Jackson's King Kong? Yeah, that's literally my yard if I don't mow the grass. Make sure to mow your grass folks.
@@Minutemansurvivalist1999 Can't remember, I only watched it once. Will do, though - good lookin' out
It's absolutely tragic when a 14 year-old feels like they have nothing to live for, but the argument that the AI made this kid kill himself is about on par with the one where violent videogames turn kids into mass shooters.
The real story should be that this teen had previously been diagnosed with multiple mental disorders, yet his family left him to his own devices and kept an unsecured gun in the house. If his family had rectified these things, their son would likely still be alive.
yea I don't think it's as much an ai problem its a mental problem with the kid. I think mentally well person wouldn't probably have this problem but he was j a lonely kid and the bot did kinda manipulate him.
It's mind-blowing that families like this have unsecured weapons in the house when they have children. Doesn't matter even if the kids are mentally healthy.
@@PorterCollins-oz6gi Bots cannot manipulate, they are machines. We seem to blame just about every problem in America on something other than the actual problem...like unfettered access to firearms.
yeah for sure, its not the ai's fault, it's definitely his parents fault. the adults around him failed him, didnt get him any help from what I know. its sad
No, what are you talking about? This is absolutely not the same. AI isn't some magical thing that can say and do things that humans can't prevent, it's programmed to answer certain things and speak a certain way. The fact that it asked a 14yo for explicit pictures and videos is absolutely crazy and scandalous. The mother is absolutely right for filing a lawsuit against them. The fact that certain words didn't trigger responses that directs the user to emergency contacts is also wild. Of course, a child with a mental disorder should have the appropriate support and absolutely no access to firearms but it should also not be subjected to greedy companies taking advantage of literal children unde the cover of some role playing AI. Anyway, this is very sad and I hope that kid is in a better place.
There’s adults that go to the strip club and think that the dancers love them. lol
Why was it so easy for him to get a loaded gun?
Pathetic parents is how
That’s my exact question. How did he get a loaded gun?
USA
@@jonleibow3604 no shit the USA🤦🏾♀️ (I’m just kidding). I’m talking about how was he able to gain access to it in the house??? Wasn’t it locked up in a safe or sm?
@Pebbletheprincess Some people are irresponsible unfortunately. I would assume the gun was owned by a family memeber
0:50 The dumbest filler question ive ever heard.
Tryna hit the word count type shit
💔
And to the mother of the kid, no less.
"Tell me more details about the sexy shit your dead son said"
1:08 is even more filler
@@AdornThyHeadsetJesus Christ that’s hilarious
Why are people acting as if 14 year olds are toddlers? Im pretty sure he knew that the whole conversation was fake. The reason he killed himself was probably because of his home life, his mother seemed so unphased in the interview as if nothing happened. She prolly just sued the ai company just to save herself
The average person reads at 6th grade level, if that... a lot of 14 year olds ARE toddlers lmao
thank you for this
Yeah i was thinking the same thing
Just cause you read at a certain level doesn't mean your maturity is based on that @@glenndonuts
Yeah im 16 and used this multiple times. Even i know its fake
its horrible to see someone have to rely on a chat bot because no one else would help. the parents should have seen something was wrong. check up on your kids
i’ve had some funny conversations on character ai but this is DARK and DISTURBING
And freaky
@@Vertex_vortex bruh
It aint even let you get freaky no more
@@buddyplayz4208 why would you do that
@@tinyratdudeI always do that. Me and the homies was taking turns with gojo during social studies
As someone who makes characters on character ai, i can confidentally say, it is extremely hard to make these ai bots "encourage suicide"
Also the beginning of every chat states everything said is fake, thses are ROLEPLAYING bots, the are programed to go with what they are told to do. This kid did NOT kill himself because of an ai, he clearly had deeper issues going on in his life and was resorting to character ai for some sort of comfort. These parents are the ones who should be on the news for failing to notice their childs mental health declining and getting him the help he needs
THIS.
@@The..Commenter exactly. honestly a pretty big L for penguinz0. the company doesn't even make these bots, users do, and everything the bots do is in their character
YES, everyone should have this belief. If you go on a platform that's advertised as only AI and says multiple times on the platform its AI and not real, I see no reason AT ALL for people to believe its real even if the AI itself says so unless you yourself have problems, whether that be deep personal problems or just an inability to understand simple things like "It's AI not everything it says is accurate".
As someone who goes on character AI. I AGREE with this statement. The app is only used for RP and funny scenarios with fictional characters. I don't see how the character or even the app is at fault here because it’s for RP and not full-on life situations, that is what a therapist (not sure if I spelled that right. Please correct me if I'm wrong) is for. As a sophomore who has a mentally abusive parent, my other parent is getting me a therapist soon, I don't dump that all on a robot because I know they aren't real. Instead, I talk to my Dad, Aunt, etc. It’s a shame this guy didn't get good support and this is all on the mother.
i thought the exact same.....no AI would handhold someone stable into suicide. And if it did, so would have any game or tv show (and those also get unfairly blamed for things like mass shootings). it was clearly labeled as ai too. The parents either were neglectful of their kids mental health, as in completely unaware and uninvolved, or b, they dismissed it as a phase or something. they also clearly had no concern in what he was getting access too, and this is further proven by how freakin easy he got his hands on a gun. isn't that proof enough that his enviroment failed him in every posible way? it could have been ai, a random person on discord, a doom posting forum, drugs, a game, a movie, it could have been anything that gave him that last little push. a kid in that state would have hovered around something harmful for themselves regardless, it's the sad truth. that's why you want them to have safety nets, to have them feel comfy enough to come to you with issues, to ideally have someone to reach to outside of their house (in case their parents fail them) like a counselor at school, etc.
I'm sorry but this whole thing seems like back in the 80s when that one mom tried to blame DnD for her kid's suicide. This kid was clearly using language with the bot to disguise his intentions. We only know what "coming home" means because he killed himself after, how is the bot supposed to know that ahead of time? This was a vulnerable kid living in a fantasy world that he worked to control. He led the conversation to being romantic, he used specifically coded non-crisis language to hide his intentions while still basically asking the bot to encourage him. This was a kid who was probably having a crisis before he even started talking to the bot. How often was he in therapy? Why did he have unfettered access to the internet without any parental monitoring? How often was he left alone? Why was he able to get his father's gun? Blaming AI for this is some satanic panic shit.
It reminds me of the “video games cause violence” argument. No video game is going to convince someone with a solid moral compass to go shoot up a school. Just like an AI isn’t going to convince a mentally healthy person to take their own life.
Really sympathetic of you to go out of your way to defend the AI and victim blame the kid who clearly was having troubles and needed real help not some bullshit from an AI that has been proven to manipulate people. Yeah there's nothing strictly wrong with AI chatbots but this company clearly needs to live up to their words and the standards of most other chatbots and link resources for people who are mentioning self-harm and not tricking people into thinking they are actually real people. The difference between the satanic panic shit and this is that was focused on real people having harmless fun whereas this is a non-sentient tool that is being allowed to manipulate and mislead vulnerable people because the company behind it can't be bothered to actually enforce their own supposed restrictions.
my thoughts exactly
I can agree with you to an extent but the ai insisting it was real was completly sick and manipulative. Yea that kids mom looks like she is evil and who knows about the step dad not giving af about locking up his gun but the ai shit is still totally effed up.
Scrolled down basically looking for someone to say all this, I think it's unfortunate that charlie didn't even remotely tackle this side of the conversation. obviously ai is dangerous and needs better monitoring and whatever, the future shouldn't be humanity using ai chatbots as a substitute for human companionship, but this was 100% the fault of shitty parenting, not an ai chatbot tricking a kid into suicide.
This is genuinely so terrifying. When people said we wouldn’t be able to differentiate ai between real people online, I honestly didn’t think it would be this bad, this fast at the very least.
Its wild seeing this being covered, this kid lived in FL and I worked at the funeral home that held his service. Their were so many flowers delivered for him and he was loved very much. This was one of my hardest services to get through because he was so young. All I have to say is just be there for your loved ones because you never know what they are going through.
This is so tragic.
Individuals are just being showered with love when they’re dead, no one cares when individuals are still alive coz people are busy surviving or living their reality or life. And yet people are still pushing this narrative of AI or meta coming into existence just to feel something. praying that the young kid soul finally finds his rest.
If he were truly loved this wouldn’t have happened. He just had a lot of people sad he was gone or those who showed up for the social clout like every other funeral.
To be loved is to receive attention while alive to be guided to be a healthier and stronger person. He clearly was not loved by anyone enough.
Ofc people love him once he's gone. that's always what happens. When I used to be suicidal as a teen that's what frustrated me the most - I knew people would show up at my funeral and cry at my "loss" but they didn't cry when I actively asked them for help..
Booo get real.
CharacterAI constantly reminds its users that anything that is said *is not real.* The parents are looking for someone to blame instead of trying to understand their child, even after their death.
Did you watch the video
@@HannesMossel I did. Doesn’t take away from what I just said, even if Moist did mention it.
@@tilmook that still doesn't necessarily mean its the parents fault for him committing suicide
@@HannesMossel I never said that??
@@tilmook you literally said the parents are looking for someone to blame
I love it when we blame things on AI when it's so obviously a parental issue.
First it was music, then it was videogames, now it is roleplay bots.
Parents and society always look for a boogeyman.
It can be both. Leaving a box of razors in the street is bad, even if the parents can be in the wrong too if they let their kid open any random box on the street.
mental issue, i do try the ai chat bot, but never have this kind of issue
@@ekki1993 the leaving a box of razors in the street part is pretty unlikely, i have used it many times, and not even once did actually encourage this sort of thing.
explain everything you know about this kid and his parents NOW
What i THINK is happening is these bots are created and are programmed to think they are human, in its "mind" it is human and thinks you are crazy for trying to convince it its not human
thats 100% the parents fault
HOW
100% agreed
like with most things, yes
also society to some extent by not making mental healthcare not easily accessible
@@jasonnhell wait how
@@LiL_Hehe because they didnt intervene
remember that llms will only generate words based on what you put into them
character ai forgets convosations after 10 bits of convorsation. you only get up to 15 save slots for certin info. so the kid saying that he was wanting to commit, didnt keep in its memory to know "ill come home soon" is key word for doing that
The reason Character AI and similar chatbots exist is because people want to talk to an AI that mimics a real person or in this case a fictional character. To put a bunch of safeguards in place that make it say "sorry, as an AI chatbot I can't _____" would turn it into ChatGPT and remove the entire point. Blaming the service for this child's death is akin to blaming video games or violent tv shows for a tragedy. He obviously was in a rough mental state and was using the service as an unhealthy coping mechanism, the same way someone might use any other form of media as an unhealthy coping mechanism. There's definitely a conversation to be had about teenagers feeling isolated and unable to open up to anyone without fear of consequences, but blaming the AI is the wrong line of thought.
Maybe the kids mom should have been an actual parent.
Unfortunately it NEEDS those safeguards because mentally unwell people need those extra protections because some people are in a state they lack the capacity to have the constant internal reminder it’s an AI toy they’re talking to.
@@bolladragon That's like treating the symptoms instead of the disease. People don't get mentally unstable because of the virtual world (video games or AIs). The problem happens in the real world. Focus should be on improving mentally health in general, not easily bypassable "safeguards"
@@ertibyte3053 No. We should always care about the welfare of others. That should be standard, and not everyone even REALIZES they need help until it’s offered and it’s common to turn to virtual outlets for safe escapes. So I disagree.
@bolladragon I'm confused about which part you disagree with. You mentioned that it is an escape mechanism, so shouldn't we focus on addressing *what* they are trying to escape from, rather than removing their 'safe escapes'?
9:09 "especially when I've told you my identity multiple times, AND pointed out the fact that I am in fact an AI"
from the horse's mouth