DEV Community

#localllms

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Ollama in Your Dev Loop: Swapping the Base URL Is the Easy Part

Ollama in Your Dev Loop: Swapping the Base URL Is the Easy Part

Comments
4 min read
NVIDIA Flare Architecture: Local LLM Inference for Blackwell and DGX Spark

NVIDIA Flare Architecture: Local LLM Inference for Blackwell and DGX Spark

Comments
10 min read
The Local DeepSeek-R1 Reasoning Blueprint: Running 14B & 32B Models on Consumer GPUs for $0 (VRAM Math & Setup)

The Local DeepSeek-R1 Reasoning Blueprint: Running 14B & 32B Models on Consumer GPUs for $0 (VRAM Math & Setup)

Comments
11 min read
Local Models vs Cloud Models — The AI Advantage Is Moving From Access to Infrastructure

Local Models vs Cloud Models — The AI Advantage Is Moving From Access to Infrastructure

Comments
3 min read
Fix Local LLM Quality: Context Stacking & Rope Freq Tweaks

Fix Local LLM Quality: Context Stacking & Rope Freq Tweaks

Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.