Imad Dabbura
Blog
Paper Summaries
TIL
Projects
DL Tips & Tricks
More
Library
Notes
Data Engineering
About
Imad Dabbura
AI Scientist
Understanding AI by building it from scratch: long-form posts, paper summaries, and open-source projects from first principles.
Learn more about me →
Start Here
Improving ML Systems with the Theory of Constraints
ML Systems
Designing Machine Learning Systems from First Principles
ML Systems
Hard-Learned Lessons in Shipping Software (AI/ML) Projects
Machine Learning
Deep Learning
Software Engineering
Building GPT(2/3) from Scratch: Turning Theory into a Working Transformer
NLP
The Transformer Architecture: A Deep Dive
NLP
Inside LSTMs: Implementing and Optimizing Sequential Models from First Principles
NLP
No matching items
Latest Writing
Why Cross-Entropy Never Reaches Zero
Cross-entropy’s infimum is at infinity, and unbounded weights turn the predictor into a step function
Machine Learning
Deep Learning
Optimization
Apr 27, 2026
10 min
Why Autograd Needs Floats, Not Ints
Calculus is continuous, and integer tensors quietly kill the gradient signal
Deep Learning
Machine Learning
Apr 21, 2026
11 min
Improving ML Systems with the Theory of Constraints
A practitioner’s guide to finding and fixing the one bottleneck that governs your system’s performance.
ML Systems
Sep 21, 2025
22 min
No matching items
Back to top