ChatGPT's new AI store is struggling to keep a lid on all the AI girlfriends
Killer_Tree @ Killer_Tree @sh.itjust.works Posts 0Comments 77Joined 2 yr. ago

Killer_Tree @ Killer_Tree @sh.itjust.works
Posts
0
Comments
77
Joined
2 yr. ago
Exactly! If you only want to use a Large Language Model (LLM) to run your own local chatbot, then using a quantized version will dramatically improve speed and performance. It also allows consumer hardware to run larger models which would otherwise be prohibitively resource intensive.