https://harisudarsan1.github.io/blog/tags/vllm/Recent content in Vllm on Hari's BlogHugoen-ushttps://harisudarsan1.github.io/blog/posts/2026-07-10-writing-an-inference-engine/Mon, 01 Jan 0001 00:00:00 +0000https://harisudarsan1.github.io/blog/posts/2026-07-10-writing-an-inference-engine/<h2 id="building-an-llm-inference-engine-from-scratch">Building an LLM Inference Engine from Scratch</h2> <p>I recently started exploring machine learning and AI from a systems engineering perspective. While most people begin by focusing on model training, I found myself much more interested in the inference side of the stack.</p> <p>I wanted to understand how deep learning models and neural networks work under the hood, but what fascinated me even more were the engineering breakthroughs that made modern LLM serving possible. Everywhere I looked, people were discussing innovations such as PagedAttention in vLLM, RadixAttention in SGLang, continuous batching, speculative decoding, fused attention kernels, and distributed inference.</p>