LocalLLaMA !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learn

---

Read more

Members

3,388

Posts

354

Active Today

2

Created

2 yr. ago

Moderators

---

How to run LLaMA (and other LLMs) on Android.

What is a good model that runs on 6GB Vram?

Mistral Small 3 (24B) released

Did DeepSeek R1 just pop nvidias bubble?

Why llms are suprisingly good at math, and what it means to process language.

Thoughts on new deepseek R1 distill models

unsure on how to quantize model

How much gpu do i need to run a 90b model

Nvidia Digits AI Supercomputer just announced

Go toolchain error - Does anyone know what's going on here?

(New) papers by Meta: Large Concept Models and BLT

New open-weight 🐋 DeepSeek V3. 685B MoE. Beats Claude 3.5 Sonnet on Aider coding benchmark

Can you fine-tune on localized steering of an LLM?

Questions about HW for local LLM.

Fixed it

Llama 3.3 70b - End of open-weight pretrained models from Meta or just a better Llama 3.1 405b finetune?

OpenWebUI OpenStreetMap Tool 2.1.0

Qwen2.5-Coder-7B

Having trouble to generate correct output? Try prefixes!

Meta unveils open-source Llama Stack, standardizing AI building blocks across the entire development lifecycle.