LocalLLaMA !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learn

---

Read more

Members

3,363

Posts

350

Active Today

44

Created

2 yr. ago

Moderators

---

32B olmo-2 03/25

Show HN: Clippy, 90s UI for local LLMs

Specialize LLM

NousResearch is quietly cooking some fascinating stuff presumably for full release of DeepHermes!

I'm using open web ui, does anybody else have a better interface?

Qwen3-32b: Windows95 starfield screensaver web app with warp drive on click

Technically correct

Qwen3 officially released

Qwen3 "Leaked"

DeepSeek R2 AI Model Rumors Begin to Swirl Online; Reported to Feature 97% Lower Costs Compared to GPT-4 & Fully Trained on Huawei's Ascend Chips

Niche Model of the Day: Nemotron 49B 3bpw exl3

How do I get started with RAG (ideally with llama.cpp)?

Less positive model

Niche Model of the Day: Openbuddy 25.2q, QwQ 32B with Quantization Aware Training

AI-generated videos now possible with gaming GPUs with just 6GB of VRAM

Can it play Doom? - New VLM Benchmark

Which model are you using?

Microsoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUs

Trump administration reportedly considers a US DeepSeek ban | TechCrunch

Should be able to load the full version of DeepSeek R1 on this no prob 😎😎