AI Knowledge Hub// Latest Tech Posts
Analyzes the reality of daily limits, slowdowns, and deliberate throttling hidden behind the sweet marketing of free AI agent platforms. It also offers tips for using free tools most efficiently and realistic alternatives.
Local AI inference is governed by a single formula: memory bandwidth equals speed. From a ~500,000 KRW AMD mini-PC to a ~4,000,000 KRW Mac Studio, this lays out with measured numbers which models you can run at how many TPS for each budget.
It lays out a division of labor where a generative LLM writes the code and the non-generative judgment model Jev verifies it with yes-or-no. It covers Jev's business model and pricing, the four MCP integration paths, and three synergies: on-site supervisor, conditional controller, and fact checker.
A hands-on record of wiring the Rust-built coding agent jcode — which boots in 14ms in the terminal and uses only 27.8MB of RAM — directly to DeepSeek V4 Flash. About 86% of the roughly 14,000-token system prompt is reused as cache, confirming a cost of about 0.1 won per question.
A breakdown of the differences between the GGUF, EXL2, AWQ, GPTQ, and GGML formats used in local LLMs, with concrete model benchmark numbers. It provides a practical guide to which format to use on which hardware.
A comparison of five MCP servers that add web search to an AI agent. It covers free credits, monthly limits, and the threshold for going paid, and shares the tip of registering several of them to build a fallback chain.
GPU VRAM Allocation Structure and the KV Cache Bible: A Complete Breakdown of Real Usage by Model [1 comments]
Why a local LLM suddenly slows down on 8GB of VRAM, what the KV cache is, and the real VRAM usage per model, laid out with benchmark figures.
Unity CLI MCP lets you connect free local AI models for game development without any paid subscription. This covers the whole process, from installation to connecting an AI agent and real-time game builds.
Your first step into local AI. From installing LM Studio to downloading a Llama/Qwen model and having your first conversation in three minutes. A from-zero explanation of how to run AI on your own computer without the internet.
20,000 tokens for a greeting, 40,000 tokens for a line of code. An agent's excessive reasoning is not a technical limitation but a thoroughly deliberate structure. This piece digs into the structure that profits platforms and API vendors the more tokens get consumed.