AI
Models, agents and practical artificial intelligence.
Q4_K_M vs Q5_K_M vs Q8_0: GGUF Quant Sizes Compared
Q4_K_M is 4.58 GiB, Q5_K_M 5.33 GiB on an 8B model: what the names mean and how much memory each needs.
RAG Prompt Injection Defense: A Practical Guide
A practical defence model for indirect prompt injection across RAG ingestion, retrieval, model context and tool calls.
Local LLM vs API: Data Boundaries and Operating Work
Compare local inference and hosted APIs by data flow, permissions, fallback and the work needed to run them.
Model Precision Formats for Local AI
Model precision formats shape weight memory, compute compatibility and numerical behaviour in local AI.
Open-Weight Model Licenses: What Free to Use Allows
Downloadable weights can carry conditions for commercial use, redistribution and hosted products.
Local Model Chat Templates: Roles, Tokens and Turns
The same conversation can require different token formats. Read the model's chat template before changing its prompt.
KV Cache Memory: Why a Loaded Model Can Still Run Out
Model weights are only part of the memory budget. Longer sequences can add a substantial KV cache.
GGUF files explained: choosing a local model download
How to choose a GGUF download and check its encoding, companions, license and memory requirements.
How to Test an AI Tool Before Giving It Real Work
Build a small set of real tasks with known outcomes, then record errors, cost and the help each run needs.
Open-Weight vs. Open-Source AI: Why the Difference Matters
Downloading model weights does not tell you what you may do with them or how the model was built.
The Hidden Costs of an AI Workflow
Compare the cost of a completed job, including retries, tools and review—not just the price of one prompt.
What Happens to the Files You Upload to an AI Assistant?
Uploading, storing, retrieving and training are separate operations. Check each one before sharing a file.
Running AI Locally: What Your Laptop Can Handle
Memory, context length and model size determine whether local AI feels usable on your machine.
AI Agents vs. Chatbots: What Actually Changes?
An agent can choose and run the next step. That changes permissions, costs and the way you check its work.