GGUF progressing nicely, ggerganov is back on it tomorrow!
GGUF progressing nicely, ggerganov is back on it tomorrow!
github.com
GGUF by ggerganov · Pull Request #2398 · ggerganov/llama.cpp
Been a lot of good work done the past week by several pivotal members, and now the boss is back and focused on it, going to be a very breaking change but I'm really excited where this will lead us!