LocalLLaMA !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learn

---

Read more

Members

3,388

Posts

354

Active Today

4

Created

2 yr. ago

Moderators

---

Chain of Draft: Thinking Faster by Writing Less

Atom of Thoughts (AOT): lifts gpt-4o-mini to 80.6% F1 on HotpotQA, surpassing o3-mini and DeepSeek-R1

Crossing the uncanny valley of conversational voice

Apparently microsofts new phi-4-mini is business-tuned?

Framework just announced their new Desktop: an AI powerhorse?

Anyone found "optimal" settings for llama.cpp partial offload?

Psychoanalysis

Does DeepSeek* Solve the Small Scale Model Performance Puzzle?

AMD CPU, Apple M4 Pro Performance - Ryzen AI MAX Review

Trying out old GPUs with Vulkan

Models not loading into RAM

AMD denies rumors of Radeon RX 9070 XT with 32GB memory

Recommend models for GTX 1660 Super (6GB)

AMD reportedly working on gaming Radeon RX 9070 XT GPU with 32GB memory

The Anthropic Economic Index - an initiative aimed at understanding AI's effects on labor markets and the economy over time.

AI Action Summit in Paris

French President Emmanuel Macron announces €100 billion investments in AI

"Flash Answers" Cerebras brings instant inference to Mistral Le Chat

Hibiki by kyutai, a simultaneous speech-to-speech translation model, currently supporting FR to EN

DeepSeek gives Europe's tech firms a chance to catch up in global AI race