I feel like it's going to be a challenge to find a definition of malicious most people agree on.
Someone might think it's fine to make nudes of Captain Marvel for example because she's a character. They don't really care about the Brie Larson aspect.
I suppose there is the option to eliminate any kind of name based suggestions.
Yeah but I like to think I am a bit better about not ingesting hair care products through my eyes, nose, and mouth than a Schnauzer. Hopefully it was something non-toxic
Am I the only one who finds this so weird when we talk about LLMs? If someone makes a bot that resembles some specific person, that person’s rights aren’t really violated, and since they’re all fictional content, it is very hard to break actual laws through its content. At that point we would have to also ban people’s weird fan fiction, no?
Not arguing about whatever they want or don’t want on their platform, but the legal & alleged moral questions / arguments always weird me out a bit, because there’s no one actually getting hurt in any sort of way by weirdos having weird chats with computers.
I could see some people making the argument that it could be considered defamatory especially in cases where it is being peddled as real. Politicians might even try to link it in with revenge porn or other non-consensual pornography laws.
It would sure get messy in a hurry though. Imagine someone trying to make lewd photos of Tomb Raider's Laura Croft for example and accidentally generates images resembling Alicia Vikander or Angelina Jolie from the Tomb Raider movie.
“We want to ensure that people have maximum control to the extent that it doesn’t violate the law or other peoples’ rights,” Joanne Jang, a member of the product team at OpenAI, told NPR. “There are creative cases in which content involving sexuality or nudity is important to our users.”
The other problem in my mind is the fallibility of current safeguards. OpenAI and rivals have been refining their filtering and moderation tools for years. But users constantly discover workarounds that enable them to abuse the companies’ AI models, apps and platforms.
Some highlights from the article.
It seems like AI porn is inevitable and OpenAI has safeguards in mind for exploitative content so it doesn't seem like a horrendous idea.
An example a lot of people here can relate to is thinking about game consoles and handhelds they played growing up like the GBA.
There were likely some great games produced for it but there was also a lot of shovelware movie tie-ins and horrendous ports that were misrepresented in advertisements.
I am not looking to fill those niches. I was curious because it was quite popular a while back.