What is a self-hosted small LLM actually good for (<= 3B)
CrayonDevourer @ CrayonDevourer @lemmy.world Posts 0Comments 73Joined 2 mo. ago
CrayonDevourer @ CrayonDevourer @lemmy.world
Posts
0
Comments
73
Joined
2 mo. ago
I'm not storing their data. I'm feeding it to an LLM which infers things and storing that data. Other Twitch bots store twitch data too. Everything from birthdays to imaginary internet points.