I still find it difficult to get my head around how a decrease in novel training data will not eventually cause problems (even with techniques to work around this in the short term, which I am sure work well on a relative basis).
A bit of an aside, I also have zero trust in the people behind current LLM, both the leadership (e.g. Altman) or the rank and file. If it's in their interests do downplay the scope and impact of model degeneracy, they will not hesitate to lie about it.
I've read the source nature article (skimmed though the parts that were beyond my understanding) and I did not get the same impression.
I am aware that LLM service providers regularly use AI generated text for additional training (from my understanding this done to "tune" the results to give a certain style). This is not a new development.
From my limited understanding, LLM model degeneracy is still relevant in the medium to long term. If an increasing % of your net new training content is originally LLM generated (and you have difficulties in identifying LLM generated content), it would stand to reason that you would encounter model degeneracy eventually.
I am not saying you're wrong. Just looking for more information on this issue.
There is got to be something else going behind the scenes. He must have had enough money to disappear (high in the mountains of Bolivia?) if he really wanted to.
FWIW, I follow VOA in several languages (not my only or even major source of information) and their reporting is better than many major news sources (English language and ones in from my country).
That fact that is not taken as a given, speaks a lot about how deeply ingrained corruption is in our society.
I would almost argue that even "neutral" newswires like AP/Reuters should use language like "Companies A, B, C, have created a common PR organisation that will be focused on self-regulation polemics ...".
I actually did try that twice (in a context where they would have more motivation than a typical dev/studio), no luck.
Don't get me wrong, I do think we have to move of corporate social networking systems. I started actively using Lemmy about two months ago and I am enjoying it. However, we do have to be realistic about the state of the market.
(i) Innumerable media applications just like Odysee, X, Reddit, Zerohedge, Drudge Report, etc. powered by the same Arweave technology stack which makes them privacy focussed, customizable, and censorship resistant.
This part doesn't sit well with my me. Tone is a bit too bombastic.
This is pretty cool, although it makes me feel old.
I can't imagine anyone younger than 30 would even get what this article is about.