DEV Community

AI Intermediate: Infrastructure & Agentic Systems Series' Articles

Back to Suresh Kumar Pallapothu's Series
Day 1: The AI Infrastructure Shift — Why the Model is Only 10% of the Production System

Day 1: The AI Infrastructure Shift — Why the Model is Only 10% of the Production System

Comments
5 min read
Day 2: Advanced Docker for AI — Multi-Stage Builds for Heavy Python Runtimes

Day 2: Advanced Docker for AI — Multi-Stage Builds for Heavy Python Runtimes

Comments
4 min read
Day 3: Hardware Acceleration in Docker — GPU Passthrough and Limits for Constrained Hardware

Day 3: Hardware Acceleration in Docker — GPU Passthrough and Limits for Constrained Hardware

Comments
4 min read
Day 4: Optimizing Model Weights — Quantization Basics (GGUF, AWQ) for Efficient Inference

Day 4: Optimizing Model Weights — Quantization Basics (GGUF, AWQ) for Efficient Inference

Comments
4 min read
Day 5: Local AI Runtimes — Deploying Ollama and vLLM for Bare-Metal Execution

Day 5: Local AI Runtimes — Deploying Ollama and vLLM for Bare-Metal Execution

Comments
3 min read
Day 6: Containerizing AI Microservices — Building and Packaging APIs with FastAPI

Day 6: Containerizing AI Microservices — Building and Packaging APIs with FastAPI

Comments
4 min read
Day 7: Docker Compose — Architecting a Multi-Container Database and Inference Stack Locally

Day 7: Docker Compose — Architecting a Multi-Container Database and Inference Stack Locally

Comments
4 min read
Day 8: K3d and Lightweight Kubernetes — Running Multi-Node Clusters on 16 GB of RAM

Day 8: K3d and Lightweight Kubernetes — Running Multi-Node Clusters on 16 GB of RAM

Comments
3 min read
Day 9: Kubernetes Core for Machine Learning — Pods, Deployments and Headless Services

Day 9: Kubernetes Core for Machine Learning — Pods, Deployments and Headless Services

Comments
4 min read
Day 10: Persistent Volumes (PV/PVC) — Managing Heavy Model Weights and Vector Stores

Day 10: Persistent Volumes (PV/PVC) — Managing Heavy Model Weights and Vector Stores

Comments
3 min read