Data contamination expert π
Data contamination expert π
Data contamination expert π
I wonder how much these models are now learning from spam they were used to generate
Time to make a lot of wandering dwarf bots on reddit to make variations of various game phrases all over, so the LLM based bots just spout Rock And Stone and This is my favourite store on the Citadel?
Thing is, you could use a bot to do nothing but post pop culture references, and it would be indistinguishable from a garden variety Redditor. Reddit is one of the worst places to train an AI.
All of them
OpenAI team after including the data: why is the model suddenly even more horny, abusive, and discriminatory?
If it takes reddit data to train a model, instead of Artificial Intelligence we will end up with Artificial Idiocy and a horny one that too.
Sigh, unzips
You had to unzip?
Hey, I'd say that Facebook, Twitter and YouTube are at least just as bad, and probably worse.
Good move, but anyone using public data already applies a simple spam filter to reject "dumb" data poisoning. Also, hatred and other negative comments as responses will be penalized in a language model training, so an effective data poisoning takes effort. I'll just throw some ideas here how poisoning could hypothetically have a tangible negative impact in their results.
The best one can do in terms of data poisoning is make comments that are not easily discernible from usual comments - both for humans and machines - but are either unhelpful or misleading. This is an "in-distribution" data poisoning attack. To be really effective in having any impact whatsoever for training, they need to be mass applied using different user accounts that also upvote each others' comments in a way that mimics real user interaction: if applied in a simplistic way, a simple graph analysis on these interactions can highlight these fake accounts as a christmas tree.
but are either unhelpful or misleading
Honestly that just sounds like a lot of Reddit users in general
yea we know that's why he said that because that's "real" reddit content
I was contemplating the merits of botting with the current model with slight vectorization offsets so the data becomes prone to overfitting.
I would think it would alao work to post using valid, but non-standard syntax so it muddies the n-gram searches.
Set up a bot that just constantly posts blatantly wrong information, like "the earth is flat according to encyclopedia Britannica", "the sky is green because it's full or chlorophyll according to the UK foundation of science"
Or in line with current events, βwe are sorry about your experience and will refund you triple.β
You won't poison the data if the bot is on there just doing the same things as the redditors.
we need to make a repository just for that and spam reddit with it, everyone is welcome to contribute, open-source fake news
That should be super easy. Just make a massive database of random stuff and put them in a sentence structured "XX is YY because ZZ" with no other explanation.
You've probably been shadow banned for 5 of those months
We should have started an all-out attack on Reddit once they started forcing open subs by removing mods. People folded like soggy tortillas.
I just left and came here after 10+ years on reddit. No point wasting time energy trying to take reddit down. They are fucked anyway. Anytime I check back for something occasionally the quality of posts / comments is just pure garbage.
Just like when Netflix and Disney plus and every other streaming service colluded to all raise their prices and remove account sharing.
My account got locked out after I lost all my authenticators with an old phone. Reddit is one of only a few sites that would not let me change it.
This announcement is just "oh by the way, the horse is now out of the barn. He left like 10 years ago but this is the announcement."
Shout out to whoever dismissed the first AI writings with "It's like a perfect Redditor. Totally confident and completely full of shit, doesn't even know that it's lying."
That doesn't happen by accident. That happens when everyone was already scraping the shit out of the site, at the very least.
Dear God, I've posted a lot of nonsense and untrue things over the years. You guys want to do a candle light vigil tonight for ai?
I'm pissed at reddit but I still hate searching for something and finding a post on reddit discussing it, only to find some of the posts being deleted or overwritten.
Good, then the protest at least worked somewhat.
if you're lucky, some posts have been archived on the internet archive's wayback machine. highly recommend pinning the extension to your toolbar, it'll show a number badge of how many times the current site has been archived :) https://addons.mozilla.org/en-US/firefox/addon/wayback-machine_new
This is the ideal meme format. Pedroβs smile is perfect.
exactly, βaiβ right now is just a computer parrot. why settle for blurry generic versions of the art that it is digesting and shitting back out?
Nailed it. The whole essence of AI is that it can make images with a variety of colors and styles, but it's not creative or artistic by definition. At the end of the day, it's just a bunch of numbers and equations being translated into pixels on a screen.
(This comment pasted from NovelAI with this prompt:
Please write a reply to this interrnet comment: exactly, βaiβ right now is just a computer parrot. why settle for blurry generic versions of the art that it is digesting and shitting back out?)
we need a bot that deletes comments and replaces them with some faulty grammar yoda-speak.
So does that mean, that this time DAN will come pre-installed?
"So much for your fucking canoe!"
I really ought to have done that.
Why care?
It just seems they were correct in changing api prices
I mean, yeah, but because they fully expected to sell their userbase as training data for LLMs, not because they actually care about people using bots to post wrong informations. Wouldn't that require them caring about actual people posting wrong infos in the first place ?
They'll just find the signal in what you're doing. Sorry but checkmate, mate.
I used some tools to corrupt about 10 years of comments and posts of mine.
While that's the correct thing to do in my opinion, it would be a mistake to assume that Reddit didn't store your original comments.
By corrupting their dataset, you may actually be helping them recognize maliciously edited comments.
They were fairly specific about not doing that (I'd imagine largely because of GDPR).
I deleted 10 years of "content" before I left and checked their policies. They apparently actually do properly delete from their servers.
Yeah, I mean I knew that when I was doing it.
Sometimes all you can do is make a symbolic gesture that really does nothing, and even if it does nothing, you should still do it.
Probably leaving and supporting lemmy by paying for some developer fees (i'm on the patreon), posting and commenting, probably 100x more damaging to Reddit.
Mass edits made rapidly are obviously suspect, too... If the same user edits anything more than a dozen comments in, say a minute, you have to ask what's going on
Can't post a genius idea like this one without posting the links of the tools
Its not my idea, but I could probably dig up the tool I used. Dollars to donuts, it doesn't work any more.
This might have been the tool I used. I dont think so because I overwrote everything with one message, but google around you'll find similar.
https://github.com/adriantache/YARCO
A tool like that would almost definitely require api access to function. If that was still possible, most of us wouldn't be here having this conversation.
I think Reddit caught on to this. I tried destroying my comment history (~7 years with 600k karma) with a few of the available tool on GitHub.
Found my account permabanned next time trying to login. People should attempt to eliminate/poison as much as possible, but Reddit has all the comments and modifications in a database somewhere to sell it all to whatever AI is the highest bidder.
They have to do something to make money after taking away awards. The advertising is absolute shit and not worth the $100 entry fee.
I edited mine via a tool to say fuck Reddit and Steve Huffman is a greedy pig boy.
What do you mean by corrupt?
I used a tool that edited my comments to replace it with gibberish. Supposedly Reddit still retains deleted comments but if you edit them, it only keeps the latest version. So by editing it you make the comments worthless.
I ran a script over all of my comments (through my browser) to edit them into something about how spez had back stabbed the community. I had tens? hundreds of thousands? of comments.
It took several hours to run, but I did a forward pass (newest to oldest) and a backwards pass (oldest to newest). It bugged out because it had to run so long but I think I got it all.
I'm not sure this will really do anything because you could pretty easily statistically isolate any one who did what I did, and roll their account history back to a prior state in the training data.
Regardless, it was the least I could do on the way out the door.
It replaces them with gibberish. I did the same for my 12+ years worth.