Notes

Practical notes on generative AI, deep learning, optimization, and LLM systems.

Notes from what I read and build, with code and examples along the way.

Generative AI NLP Deep Learning Optimization Books

BPE Tokenizer

NLP

A practical guide to understanding and implementing a byte-pair encoding tokenizer from first principles.

Sep 25, 2026
16 min

xLAM SFT

Generative AI

Supervised fine-tuning of Qwen2.5-0.5B for tool calling using the Salesforce xLAM dataset.

Aug 18, 2026
15 min

Flow Matching

Generative AI

Notes on Flow Matching

Jun 2, 2026
10 min

Score Matching

Generative AI

Notes on Score Matching

May 22, 2026
21 min

Diffusion Models

Generative AI

Notes on Diffusion Models

May 18, 2026
15 min

Variational Autoencoder

Generative AI

Notes on Variational Autoencoders, ELBO, and reparameterization

May 6, 2026
14 min

Rotary Position Embedding

Deep Learning

A visual and mathematical walkthrough of RoPE, relative position intuition, rotation matrices, and attention score behavior.

Apr 7, 2026
10 min

Position Encoding

Deep Learning

Notes on sinusoidal positional encoding, why transformers need position information, and how different frequencies encode token positions.

Apr 6, 2026
8 min

AI Engineering: Chapter-Wise Summary

Books

Work-in-progress chapter notes from AI Engineering.

Jan 13, 2026
19 min

Attention Mechanism

Deep Learning

A step-by-step note on attention, scaled dot-product attention, softmax gradients, and transformer intuition.

Jan 12, 2026
13 min

Hands on LLMs: Chapter-Wise Summary

Books

Work-in-progress chapter notes from Hands-On Large Language Models.

Jan 27, 2025
6 min

Meta Learning: Chapter-Wise Summary

Books

Chapter-wise summary notes from Meta Learning, focused on learning practice, programming habits, and deep learning growth.

Jul 6, 2024
9 min

Quantization in Depth

Optimization

Detailed notes on quantize/dequantize workflows, quantization error, calibration, packing, and practical model optimization.

May 24, 2024
30 min

Quantization Fundamentals

Optimization

Introductory notes on model quantization, lower-precision data types, scaling, zero points, and model compression basics.

May 13, 2024
7 min
No matching items