Skip Navigation

LocalLLaMA @sh.itjust.works

turkishdelight @lemmy.ml

1y ago

Ollama now supports AMD graphics cards

Ollama now supports AMD graphics cards · Ollama Blog

But in all fairness, it's really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

4 comments

I've been using it with a 6800 for a few months now, all it needs is a few env vars.
That's cool. I've just recently gotten hold of an interesting Ampere system and it's got an AMD card in it. I must give it a spin.
- I was sadly stymied by the fact the rocm driver install is very much x86 only.
  
  It's improving very fast. Give it a little time.