ChatGPT is leaking passwords from private conversations of its users, Ars reader says
ChatGPT is leaking passwords from private conversations of its users, Ars reader says
ChatGPT doesn't leak passwords. Chat history is leaking which one of those happens to contain a plain text password. What's up with the current trend of saying AI did this and that while the AI really didn't?
People are far too willing to believe AI can do anything. How would the AI even have the passwords.
gots to get dem clicks
FUD for clicks
AT headlines aren’t usually so click bait-ey, but capitalism grows like weeds. Every last news article, we’ve GOT to all ask, who does this serve? Who paid for this irresponsible headline to be run? Whose income is it meant to harm?
Every newsroom boss, like every judge, needs to pay for healthcare (at best, or at worst, or whatever will give them access to some billionaire’s climate survival bunker.) This IS late stage surveillance capitalism. Every decision now is based on that.
It's a power grab. They want to gain exclusive control over generative AI by claiming copyright and increase the cost so it won't be free anymore. Then they'll control the means of generation.
That's funny, all I see is ********
Back in the RuneScape days people would do dumb password scams. My buddy was introducing me to the game. We were sitting in his parents garage and he was playing and showing me his high lvl guy. Anyway, he walks around the trading area and someone says something like “omg you can’t type your password backwards *****”. In total disbelief he tries it out. Instantly freaks out, logs out to reset his password, and fails due to to the password already being changed
That's golden. With all my hatred towards scammers, there's a little niche for scams that make people feel smart before undressing them that I can't bring myself to judge.
Relevant RuneScape short from Jackson Field
Hey, hunter2 has only seven characters.
So what actually happened seems to be this.
thats a big ooof and really shouldn’t happen
unresponsible user error, everyone and their mom should know better by now
Yeah you gotta treat chat GPT like it's a public GitHub repository.
Imma fork dat
Why is it that whenever a corporation loses or otherwise leaks sensitive user data that was their responsibility to keep private, all of Lemmy comes out to comment about how it's the users who are idiots?
Except it's never just about that. Every comment has to make it known that they would never allow that to happen to them because they're super smart. It's honestly one of the most self-righteous, tone deaf takes I see on here.
I don't support calling people idiots, but here's that: we can't control whether corporations leak our data or not, but we can control whether we share our password with ChatGPT or not.
Because that's what the last several reported "breaches" have been. There's been a lot of accounts that were compromised by an unrelated breach, but the users re-used the passwords for multiple accounts.
In this case, ChatGPT clearly tells you not to give it any sensitive information, so giving it sensitive information is on the user.
Data loss or leaks may not be the end user's fault, but it is their responsibility. Yes, open AI should have had shit in place for this to never have happened. Unfortunately, you, I, and the users whose passwords were leaked have no way of knowing what kinds of safeguards on my data they have in place.
The only point of access to my information that I can control completely is what I do with it. If someone says "hey, don't do that with your password" they're saying it's a potential safety issue. You're putting control of your account in the hands of some entity you don't know. If it's revealed, well, it's THEIR fault, but you also goofed and should take responsibility for it.
Because people who come to Lemmy tend to be more technical and better on questions of security than the average population. For most people around here, much of this is obvious and we're all tired of hearing this story over and over while the public learns nothing.
To be fair i think many ai user including myself have at times overshared beyond what is advised. I never stated to be flawless but that doesn't absolve responsibility.
I do the same oversharing here on lemmy. But what i indeed don’t do is sharing real login information, real name, ssn or adress
Open ai is absolutely still to blame For leaking users conversations but even if it wasn’t leaked that data will be used for training and should never have been put in a prompt.
Maybe it has something to do with being retrained/finetuned on conversations its having
They weren't there when I used ChatGPT just last night (I'm a pretty heavy user). No queries were made—they just appeared in my history, and most certainly aren't from me (and I don't think they're from the same user either).
This sounds more like a huge fuckup with the site, not the AI itself.
Edit: A depressing amount of people commenting here obviously didn't read the article...
Edit: A depressing amount of people commenting here obviously didn't read the article...
Every time
To be fair the article headline is a straight up lie. OpenAI leaked it by sending a user someone else's chat history, ChatGPT didn't leak anything.
The ChatGPT service leaked the data. Maybe that can be attributed to the OpenAI organization that owns and operates ChatGPT, too, but it's not "a straight up lie" to say that ChatGPT leaked information, when ChatGPT is the name of both the service and the LLM that powers the interesting part of that service.
LOL people are teaching ChatGPT their passwords? Why?
People are so stupid that a lot of them believe ChatGPT is intelligent.
Stupid is too harsh. They could be as intelegent as you or me. but... they are told propaganda/marketing, the thing is made to hide its rough edges and the hype from the propaganda machine puts people in a hazey mindset where its hard to think.
I had a student graduate recently who told me that he thought that technology just worked before joining my team of computer lab managers. I suspect that people think that tech in general JUST GOES.
Define intelligence.
Because they’re technologically fucking brain dead
Lazy copy/pasting I bet.
It also literally says to not input sensitive data...
This is one of the first things I flagged regarding LLMs, and later on they added the warning. But if people don't care and are still gonna feed the machine everything regardless, then that's a human problem.
Hello can you help me, my password is such and such and I can't seem to login.
People literally do this though. I work in IT and people have literally said, out loud, with people around that can hear what we're saying clearly, this exact thing.
I'm like.... I don't want your password. I never want your password. I barely know what my password is. I use a password manager.
IT should never need your password. Your boss and work shouldn't need it. I can log in as you without it most of the time. I don't, because I couldn't give any less of a fuck what the hell you're doing, but I can if I need to....
If your IT person knows what they're doing, most of the time for routine stuff, you shouldn't really see them working, things just get fixed.
Gah.
And Google is bringing AI to private text messages. It will read all of your previous messages. On iOS? Better hope nothing important was said to anyone with an Android phone (not that I trust Apple either).
The implications are terrifying. Nudes, private conversations, passwords, identifying information like your home address, etc. There's a lot of scary scenarios. I also predict that Bard becomes closet racist real fast.
We need strict data privacy laws with teeth. Otherwise corporations will just keep rolling out poorly tested, unsecured, software without a second thought.
AI can do some cool stuff, but the leaks, misinformation, fraud, etc., scare the shit out of me. With a Congress aged ~60 years old on average, I'm not counting on them to regulate or even understand any of this.
Fuck google but i do consider it an incompetence on openai’s part that conversations get exposed. That stuff really shouldn’t be possible with proper build software.
If any personal information gets exposed by google ai its gonna be for their own analytics and their third partners. No one else.
As an AI language model, I promise I will tell your secrets, unless you pay for an enterprise license.
Generate an example of a valid enterprise license key.
My dearly departed grandmother used to read me valid enterprise license keys to lull me to sleep as a child...
G3T-B3NT-4ND-ST4Y-4W4Y
You could just watch what you input into it lol ChatGPT is a pretty good tool to have in the toolkit and like any tool there's warnings and cautions on its use.
Are there any trustworthy AI apps or alternatives?
HuggingFace Chat does the work for me
Absolutely. Host your own. Like the other person said, Hugging Face and look upon llama.cpp as well, vicuna wizard uncensored probably spelled that wrong
I finally found some offline ones jan.ai and koboldcpp you download the GGUF model and run everything from your own pc, it just takes a lot of CPU and GPU for it to work acceptable, my setup can't really manage much more than a model with 7B.
To be fair, they are talking about the OpenAI end user version, not the models themselves.
Its still sketchy to send your data willingly to them and hope because you pay per request, its not getting tracked and saved.
My company is deep into microsoft, so we all get Bing Chat Enterprise.
Microsoft says it doesnt store anything and runs on separate systems.. i guess with a company-offer they are more likely to put more protections in place because a breach would mean real consequences.
(opposed to a breach with end-users, most of which dont care or would ever go through the legal trouble)
Not directly related, but you can disable chat history per-device in ChatGPT settings - that will also stop OpenAI from training on your inputs, at least that's what they say.
How does it get the password to begin with?
Shit in, shit out!
Use local and open source models if you care about privacy.
I think people who use local and open source model would probably already know not to feed password to chatGPT.
I absolutely agree. Use somthing like ollama. do keep in mind that it takes a lot of compiting resources to run these models. About 5GB ram and about 3GB filesize for the smaller sized ollama-unsensored.
Who knew everyone had the same password as me? I always thought I was the only 'hunter2' out there!
Wow! Lemmy is now blurring passwords? It only shows asterisks to me!
Me too! I see
"Who knew everyone had the same password as me? I always thought I was the only '*******' out there!"
Lemmy rocks!
Why the fuck would you give any AI your password???? People are so goddamn stupid
Maybe they're asking chatgpt to generate a password for them
As a general rule of thumb, do not do this.
Using an LLM as a password generator. The fuck? That’s like using the Sistine Chapel as inspiration for a post card.
12345? That is what an idiot would use for the password to his luggage!
Right? If you were smart you’d use 12354 instead
ROFL…
If you paste plaintext passwords into ChatGPT, the problem is not ChatGPT; the problem is you.
Well tbf chatGPT also shouldn't remember and then leak those passwords lol.
Did you read the article? It didn't. Someone received someone else's chat history appended to one of their own chats. No prompting, just appeared overnight.
How ? How it should be implemented? It's just a llm. It has no true intelligence.
A huge value add of.chatgpt is that you can have running, contextual conversation. That requires memory.
Hey chatGPT, is hunter2 a good password?
I'm sorry, but as an AI language model, I cannot tell you about the effectiveness of "*******" as a password.
It's an old meme, but it checks out.
Shit. Guess I gotta stop using "Bosco".