LocalLLaMA !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learn

---

Read more

Members

3,369

Posts

353

Active Today

32

Created

2 yr. ago

Moderators

---

Mistral Small 3 (24B) released

Did DeepSeek R1 just pop nvidias bubble?

Why llms are suprisingly good at math, and what it means to process language.

Thoughts on new deepseek R1 distill models

unsure on how to quantize model

How much gpu do i need to run a 90b model

Nvidia Digits AI Supercomputer just announced

Go toolchain error - Does anyone know what's going on here?

(New) papers by Meta: Large Concept Models and BLT

New open-weight 🐋 DeepSeek V3. 685B MoE. Beats Claude 3.5 Sonnet on Aider coding benchmark

Can you fine-tune on localized steering of an LLM?

Questions about HW for local LLM.

Fixed it

Llama 3.3 70b - End of open-weight pretrained models from Meta or just a better Llama 3.1 405b finetune?

OpenWebUI OpenStreetMap Tool 2.1.0

Qwen2.5-Coder-7B

Having trouble to generate correct output? Try prefixes!

Meta unveils open-source Llama Stack, standardizing AI building blocks across the entire development lifecycle.

Qwen2.5: A Party of Foundation Models!

Testing the Limits: My GTX 1070 Rig vs Mistral Small 22B