Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
localai
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
datasette-llm 0.1a11:通过 OpenAI 兼容接口接入本地模型
arthur
arthur
arthur
Follow
Nov 15
datasette-llm 0.1a11:通过 OpenAI 兼容接口接入本地模型
#
datasette
#
llm
#
localai
#
sql
Comments
1
 comment
1 min read
Moderation
Kindi – fast local inference on low-cost GPUs, and the exact-match rule that makes its numbers trustworthy
Private Local AI
Private Local AI
Private Local AI
Follow
Nov 15
Kindi – fast local inference on low-cost GPUs, and the exact-match rule that makes its numbers trustworthy
#
localai
#
opensource
#
selfhosted
#
machinelearning
Comments
Add Comment
7 min read
Moderation
Project Maya – four huge MoE models on the GPUs you already own, each with its own engine
Private Local AI
Private Local AI
Private Local AI
Follow
Nov 15
Project Maya – four huge MoE models on the GPUs you already own, each with its own engine
#
localai
#
opensource
#
selfhosted
#
machinelearning
Comments
Add Comment
7 min read
Moderation
Klepai v0.1.0: regenerate keeps your old answer
Crystal Studio
Crystal Studio
Crystal Studio
Follow
Nov 15
Klepai v0.1.0: regenerate keeps your old answer
#
ollama
#
opensource
#
localai
#
agents
Comments
Add Comment
3 min read
Moderation
What Is the Best App to Run AI Models Offline on Your Phone? (iPhone and Android, 2026)
Mohammed Ali Chherawalla
Mohammed Ali Chherawalla
Mohammed Ali Chherawalla
Follow
Nov 15
What Is the Best App to Run AI Models Offline on Your Phone? (iPhone and Android, 2026)
#
localai
#
llm
#
android
#
ios
Comments
Add Comment
6 min read
Moderation
llama.cpp 1.0.0 Stabilizes the Local Inference API — Dual-Track WASAPI Capture Still Owns the Latency Budget
devs
devs
devs
Follow
Nov 14
llama.cpp 1.0.0 Stabilizes the Local Inference API — Dual-Track WASAPI Capture Still Owns the Latency Budget
#
llamacpp
#
windows
#
audio
#
localai
Comments
Add Comment
4 min read
Moderation
One gaming PC, one 552B MoE: how expert offload actually works
Private Local AI
Private Local AI
Private Local AI
Follow
Nov 12
One gaming PC, one 552B MoE: how expert offload actually works
#
localai
#
moe
#
selfhosted
#
llm
Comments
Add Comment
4 min read
Moderation
Hot experts, cold RAM: a big MoE on a box with more memory than VRAM
Private Local AI
Private Local AI
Private Local AI
Follow
Nov 12
Hot experts, cold RAM: a big MoE on a box with more memory than VRAM
#
localai
#
moe
#
llm
#
hardware
Comments
Add Comment
3 min read
Moderation
Running Mano-P on the Cheapest Mac It Survives On
Mininglamp
Mininglamp
Mininglamp
Follow
Nov 12
Running Mano-P on the Cheapest Mac It Survives On
#
ai
#
opensource
#
apple
#
localai
1
 reaction
Comments
Add Comment
3 min read
Moderation
Speech Studio 0.5.0 Drops Local Multi-Engine TTS+STT on Windows — First-Sound Latency Still Sets the Overlay Floor
devs
devs
devs
Follow
Nov 11
Speech Studio 0.5.0 Drops Local Multi-Engine TTS+STT on Windows — First-Sound Latency Still Sets the Overlay Floor
#
windows
#
audio
#
stt
#
localai
Comments
Add Comment
4 min read
Moderation
MCP servers, and what they let a local model actually do: Blender, CADCraft and the DWG problem
Private Local AI
Private Local AI
Private Local AI
Follow
Nov 11
MCP servers, and what they let a local model actually do: Blender, CADCraft and the DWG problem
#
localai
#
opensource
#
selfhosted
#
machinelearning
Comments
Add Comment
17 min read
Moderation
How to make a local AI model give the same answer every time
Hanako H.
Hanako H.
Hanako H.
Follow
Nov 9
How to make a local AI model give the same answer every time
#
ai
#
llm
#
localai
#
tutorial
Comments
Add Comment
3 min read
Moderation
My Go-To Prompt for Testing Local LLMs
Josep Oriol Carné
Josep Oriol Carné
Josep Oriol Carné
Follow
Nov 8
My Go-To Prompt for Testing Local LLMs
#
llm
#
ollama
#
localai
#
nvidia
Comments
Add Comment
1 min read
Moderation
Apiiro’s Claude Code Scan Found 2,539 Secrets in .claude/settings.local.json — Local Desktop Tools Keep Credentials Off the Git Path
devs
devs
devs
Follow
Nov 7
Apiiro’s Claude Code Scan Found 2,539 Secrets in .claude/settings.local.json — Local Desktop Tools Keep Credentials Off the Git Path
#
claudecode
#
security
#
windows
#
localai
Comments
Add Comment
3 min read
Moderation
Hugging Face’s 70k-Word MoE Handbook After 800k GPU Hours — Why Sparsity Still Wins for Local Real-Time Tools
devs
devs
devs
Follow
Nov 7
Hugging Face’s 70k-Word MoE Handbook After 800k GPU Hours — Why Sparsity Still Wins for Local Real-Time Tools
#
moe
#
inference
#
localai
#
windows
Comments
Add Comment
4 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account