Moe - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Private Local AI

Nov 12

One gaming PC, one 552B MoE: how expert offload actually works

#localai #moe #selfhosted #llm

4 min read

Private Local AI

Nov 12

Hot experts, cold RAM: a big MoE on a box with more memory than VRAM

#localai #moe #llm #hardware

3 min read

Nov 13

KTransformers Review: Trading GPU VRAM for CPU RAM and NUMA Complexity

#ktransformers #moe #hybridinference #sglang

10 min read

devs

Nov 7

Hugging Face’s 70k-Word MoE Handbook After 800k GPU Hours — Why Sparsity Still Wins for Local Real-Time Tools

#moe #inference #localai #windows

4 min read

arthur

Nov 6

Inkling 2 Small 发布：68 小时主预训练，多模态与可定制性并重

#moe

1 min read

Felix

Nov 10

I Wanted to Run a 750B Model at Home. My Hardware Said No

#localllm #homelab #proxmox #moe

8 min read

EME GUG

Oct 13

Running MoE LLMs Larger Than Your RAM: A Practical Guide to mmap, Expert Offloading and SSD Streaming with llama.cpp

#llm #llamacpp #moe #performance

8 min read

orca forge

Oct 12

An 80GB H100, and only 3B of the model could keep up with conversation

#gpu #llm #moe #ai

5 min read

ai maya

Oct 6

The great sparsification: 2026 open-weight MoE models now activate 1 to 9 percent of their weights

#ai #machinelearning #llm #moe

6 min read

ryan2run

Sep 13

DeepSeek R1: The Open-Source Reasoning Revolution That Changes Everything

#ai #deepseek #moe #reasoning

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.