AI
AI Tools Kit
AI Tools Kit provides free developer tools for working with AI language models. Built by developers, for developers.
Learn more about us →Related Articles
AI Architecture
Inside Constitutional AI: Anthropic's Alignment Architecture Explained
Constitutional AI makes Claude harmless by having it critique and revise its own outputs against written principles, then uses AI-generated preference labels instead of humans.
AI Architecture
Grouped Query Attention (GQA): How Modern LLMs Shrink KV Cache
GQA cuts KV cache 4-8x vs. multi-head attention with minimal quality loss. Architecture, memory math, MHA vs MQA vs GQA trade-offs, and which models (LLaMA 3, Mistral, Gemma) use it.
AI Architecture
How Speculative Decoding Works: Draft Models and 3x Speedup
Speculative decoding proposes token batches with a small draft model and verifies them in one large-model pass — 2-3x speedup with zero quality loss. Here's the algorithm, the acceptance math, and when it fails.