I'm an ex Research Engineer at Google DeepMind & Microsoft. I run the 'The AI Epiphany' community. I'm also a proud father of 16 H100s (generously sponsored by Hyperstack).
Recent technical blog posts:
- Inside the Transformer: The Life of a Token
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels
- Inside vLLM: Anatomy of a High-Throughput LLM Inference System
Recent Highlights:
* Rnj-1 and Rnj-1.5, strongest 8B USA LLM for code/STEM (as a tech lead at Ashish Vaswani's AI lab)
* I previously co-founded a startup called P-1 AI: Exclusive: What If AI could design a jet engine—or even a starship? Google DeepMind and Airbus veterans just raised $23M with an eye on that future
* I'm one of 3 main devs on the llm.c project led by Andrej Karpathy
Most recent OSS contributions:
- llm.c - training LLMs in C/CUDA :)
- airoboros - synthetic instruction following data generation framework
My older recent projects:
- AI/tech jobs platform Cracked Engineers
- Huberman Transcripts - transcripts, chapter/episode level summaries to help you learn faster (had to sunset it due to a legal notice)
- YugoGPT - trained SOTA 7B LLM for Croatian, Bosnian, Serbian, Montenegrin languages
- SlovenianGPT - trained SOTA 7B LLM for Slovenian language
- YugoChat - talk to YugoGPT
- First Serbian LLM eval
- Open-NLLB - Replicating Meta's "no language left behind" machine translation (MT) project
- Jarvis for images
- YouTube AI Buddy (removed from Chrome store)