Home / Blog / Local LLMs

Local LLMs

Ollama, local models, Docker deployment, and hardware requirements. 10 articles, written by the engineers building AI App Lab.

Ollama Open WebUI: Self-Hosted ChatGPT Alternative with RAG, Multi-User, and Model Management

Ollama Open WebUI: self-hosted ChatGPT alternative. Docker install, multi-user auth, RAG document Q&A, model management, arena A/B testing, image generation, web search, admin panel, and production checklist for 2026.

May 11, 2026 13 min read

Ollama VPS Setup: Deploy Local LLMs on Cloud Servers with GPU and Systemd

Ollama VPS setup: install on cloud servers (AWS, DigitalOcean, Linode), GPU vs CPU, systemd service, OLLAMA_HOST remote access, Nginx reverse proxy, TLS, firewall, SSH tunnel, security, and production checklist for 2026.

Apr 27, 2026 13 min read

Ollama Tutorial: Run LLMs Locally with OpenAI-Compatible API and Python SDK

Ollama tutorial: run LLMs locally for free. Install on Mac/Linux/Windows, pull llama3.2/qwen2.5/deepseek-r1, OpenAI-compatible API at localhost:11434, Python SDK integration, streaming, structured output, RAG, and production checklist for 2026.

Apr 26, 2026 14 min read

Local LLM Model Selection: Qwen3, DeepSeek-R1, Llama 3.3, and Phi-4 Benchmark Guide

Local LLM model selection 2026: Qwen3 vs DeepSeek-R1 vs Llama 3.3 vs Phi-4 vs Gemma 3. Benchmarks, VRAM tiers, use case decision table, quantization Q4_K_M Q5_K_M, coding vs reasoning vs general, and production checklist.

Apr 24, 2026 13 min read

Ollama Docker Production: GPU Passthrough, Persistent Volumes, and Multi-Container Deployment

Ollama Docker production: docker-compose with GPU passthrough, persistent model storage, NVIDIA Container Toolkit, healthcheck, restart policy, Redis caching, Open WebUI, version pinning, and production checklist for 2026.

Feb 26, 2026 12 min read

Local LLM Hardware Requirements: VRAM, GPU, Apple Silicon, and Budget Tiers for 2026

Local LLM hardware requirements 2026: VRAM tiers (4GB-64GB), GPU comparison (RTX 4060-5090), Apple Silicon M4 unified memory, CPU inference, RAM, NVMe SSD, power supply, budget tiers, and production checklist.

Dec 5, 2025 13 min read

Open Source LLM Models: License Comparison, Benchmarks, and Commercial Use Guide for 2026

Open source LLM models 2026: Llama 3.3, Mistral, Qwen3, DeepSeek-R1, Phi-4, Gemma 4. License comparison (Apache 2.0, MIT, Llama), commercial use, benchmarks, Hugging Face GGUF, Ollama, and production checklist.

Nov 2, 2025 12 min read

Ollama Nginx Reverse Proxy: TLS, Authentication, Rate Limiting, and Streaming for Production

Ollama Nginx reverse proxy: TLS with Let's Encrypt, Basic Auth, rate limiting, proxy_buffering off for streaming, proxy_read_timeout 600s, block management endpoints, WebSocket support, and production checklist for 2026.

Oct 16, 2025 12 min read

Ollama REST API: Complete Endpoint Reference for Chat, Generate, Embeddings, and Model Management

Ollama REST API: /api/chat, /api/generate, /api/embeddings, /api/pull, /api/show, /api/delete, /api/tags, /api/ps, /api/create, /api/copy. Streaming JSON, options, format, keep_alive, and production checklist for 2026.

Aug 27, 2025 14 min read

LLM Quantization: GGUF, AWQ, GPTQ, and FP8 Comparison with Quality Benchmarks for 2026

LLM quantization 2026: GGUF Q4_K_M, AWQ INT4, GPTQ, FP8, MLX. Perplexity benchmarks, MMLU loss, VRAM savings, throughput comparison, production recommendations, use case decision table, and checklist.

Aug 21, 2025 14 min read