Inside Small LLM Coding Agents: Sub-8B Architecture

AI Tools Kit

AI Tools Kit provides free developer tools for working with AI language models. Built by developers, for developers.

Inside Google's A2A Protocol: Agent Discovery and Delegation

Google's A2A protocol defines how AI agents discover each other and delegate tasks over HTTP. Full architecture walkthrough: Agent Cards, task state machine, SSE streaming, and key design tradeoffs.

Architecture Deep Dive

Inside QLoRA: How 4-Bit Fine-Tuning Fits LLMs on One GPU

QLoRA fine-tunes 65B-parameter LLMs on a single 48GB GPU using NF4 quantization, double quantization, and paged optimizers. Deep-dive on each technique and its production trade-offs.

Architecture Deep Dive

Inside vLLM: How PagedAttention Enables High-Throughput LLM Serving

vLLM's PagedAttention algorithm achieves 24x higher throughput than HuggingFace Transformers by applying OS virtual memory concepts to KV cache management. Here's how the architecture actually works.

Inside Small LLM Coding Agents: Sub-8B Architecture

Related Articles

Inside Google's A2A Protocol: Agent Discovery and Delegation

Inside QLoRA: How 4-Bit Fine-Tuning Fits LLMs on One GPU

Inside vLLM: How PagedAttention Enables High-Throughput LLM Serving