Localllm - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

System Design Simple

Nov 15

How can an AI answer with no network? On-device AI explained

#aisystems #ondeviceai #localllm #offlineai

6 min read

DudeSquad999 · Building Prism AI

Nov 13

Configuring Ollama and Cloud Models in Prism AI: A Local-First Approach

#ai #ollama #localllm #tutorial

1 min read

Nov 13

The 8GB VRAM Breakthrough: How PagedAttention and Dynamic KV-Cache Quantization Unlock 64k Context on Consumer GPUs

#ai #localllm #cuda #opensource

11 min read

Nov 12

Quantize or Offload? A 16GB GPU Local LLM Strategy

#localllm #machinelearning #python #cuda

4 min read

Behnoud mostafaie for Vekt

Nov 10

AI CV screening on a local LLM with Ollama

#localllm #ollama #aiscreening #selfhosted

9 min read

Muhammad Tayyab

Nov 6

FreeToken: Run Frontier MoE Models on Your Own GPU, and the RAM It Takes

#opensource #localllm #mixtureofexperts #llminference

9 min read

Felix

Nov 10

I Wanted to Run a 750B Model at Home. My Hardware Said No

#localllm #homelab #proxmox #moe

8 min read

Veduis

Nov 6

Local LLMs vs Cloud AI: Choosing the Right Solution for...

#localllm #ondeviceai #privateaimodels #ollamaforbusiness

8 min read

Jonne Riepponen

Nov 5

Local LLMs as System Tooling: Running many Sub-3B Models on Edge and Budget Hardware

#ai #localllm #sysadmin #privacy

7 min read

Aleksei Aleinikov

Nov 6

Local LLMs for Cybersecurity: Choose the Brain, Limit Its Reach

#localllm #cybersecurity #llmsecurity #aiagentsecurity

15 min read

Jonne Riepponen

Nov 2

Local LLMs as System Tooling: Running Sub-3B Models on Edge and Budget Hardware

#ai #localllm #privacy #seniortech

8 min read

maruhana

Nov 14

A 120B Model Ran About 4x Faster Than a 27B One: 8 Local LLMs on a Surface Laptop Ultra

#ai #llm #llamacpp #localllm

13 min read

Oct 31

I added a LOCAL MODELS channel to my retro dev TV, and Ollama has no API for it

#ollama #localllm #opensource #javascript

3 min read

Cortex AI

Oct 26

Local AI system for business: what local models can and cannot do

#localllm #privateai #ollama #smallbusiness

4 min read

Jaroslaw Nowosad

Oct 25

Meet Kowalski

#opensource #rust #ai #localllm

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.