DEV Community

#sglang

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Cross‑Request KV Cache Exposure in GLM‑5.3 Workers AI: A Deep Dive and SGLang Remediation

Cross‑Request KV Cache Exposure in GLM‑5.3 Workers AI: A Deep Dive and SGLang Remediation

Comments
8 min read
KTransformers Review: Trading GPU VRAM for CPU RAM and NUMA Complexity

KTransformers Review: Trading GPU VRAM for CPU RAM and NUMA Complexity

Comments
10 min read
SGLang for Multi-Turn Agents: Prefix-Cache Wins, Speculative-Decoding Risks

SGLang for Multi-Turn Agents: Prefix-Cache Wins, Speculative-Decoding Risks

Comments
9 min read
Running an MoE Model Larger Than Your VRAM: SGLang Paged Experts, the PCIe Math, and the 4-Request Cliff

Running an MoE Model Larger Than Your VRAM: SGLang Paged Experts, the PCIe Math, and the 4-Request Cliff

Comments 1
14 min read
From SGLang to OpenLogi: The Developer Shift Toward Local-First AI Infrastructure

From SGLang to OpenLogi: The Developer Shift Toward Local-First AI Infrastructure

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.