Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?
[moved to hexbear] @ Tempo @lemmy.ml Posts 2Comments 45Joined 3 yr. ago
![[moved to hexbear]](https://lemmy.ml/pictrs/image/88401b61-49ef-4670-b42a-ea5f922789f7.png?format=webp&thumbnail=128)
[moved to hexbear] @ Tempo @lemmy.ml
Posts
2
Comments
45
Joined
3 yr. ago
They're Ryzen processors with "AI" accelerators, so an LLM can definitely run on hardware on one of those. Other options are available, like lower powered ARM chipsets (RK3588-based boards) with accelerators that might have half the performance but are far cheaper to run, should be enough for a basic LLM.