Imad Dabbura
  • Blog
  • Paper Summaries
  • TIL
  • Projects
  • DL Tips & Tricks
  • More
    • Library
    • Notes
    • Data Engineering
  • About



Imad Dabbura

AI Scientist

Understanding AI by building it from scratch: long-form posts, paper summaries, and open-source projects from first principles.

Learn more about me →

Start Here

Improving ML Systems with the Theory of Constraints
ML Systems

Designing Machine Learning Systems from First Principles
ML Systems

Hard-Learned Lessons in Shipping Software (AI/ML) Projects
Machine Learning
Deep Learning
Software Engineering

Building GPT(2/3) from Scratch: Turning Theory into a Working Transformer
NLP

The Transformer Architecture: A Deep Dive
NLP

Inside LSTMs: Implementing and Optimizing Sequential Models from First Principles
NLP
No matching items

Latest Writing

Why Cross-Entropy Never Reaches Zero

Cross-entropy’s infimum is at infinity, and unbounded weights turn the predictor into a step function
Machine Learning
Deep Learning
Optimization
Apr 27, 2026
10 min

Why Autograd Needs Floats, Not Ints

Calculus is continuous, and integer tensors quietly kill the gradient signal
Deep Learning
Machine Learning
Apr 21, 2026
11 min

Improving ML Systems with the Theory of Constraints

A practitioner’s guide to finding and fixing the one bottleneck that governs your system’s performance.
ML Systems
Sep 21, 2025
22 min
No matching items
Back to top

© 2017–2026 Imad Dabbura ∙ Made with Quarto

 
  • Report an issue