deepseek's model claims to be chatgpt during conversation. what does this mean?
Robin @ Robin @lemmy.world Posts 0Comments 146Joined 2 yr. ago
Robin @ Robin @lemmy.world
Posts
0
Comments
146
Joined
2 yr. ago
Deleted
Permanently Deleted
Training data for these models used to be text off of the internet and some manually generated Q&A examples to make it behave more like a chat bot (instruction tuning). Because there is still a need for more data they have started adding AI generated text to the dataset. This technique doesn't add new knowledge but it has shown to reduce hallucinations. Likely because this data is more focussed, truthful and structured than the median text from the existing datasets. They would probably have data from every major chat provider in there, especially the big boys.