What I think you'll find useful
I find myself wandering on the Internet and founding miracle content. There's so much stuff out here, this page could be a reasonable place to gather some interesting links (for me). I will be updating this list for as long as I can. Notice that probably some link will break sometimes in the future.
- Deep ML: Leetcode stile ML and Deep Learning code challenge
- Distill: Various super-interesting ML articles, incredible site design, unfortunately on pause.
- How to Interview and Hire ML/AI Engineers: Very intriguing blog post about ML/AI hiring process.
- Integer tokenization is now much less insane: Tokenization is a really tricky problem, integer tokenization is even worse.
- CS229 Lecture Notes: ML notes by Andrew NG, still have to study them though.
- Karpathy's Neural Networks Zero to Hero: the legend himself teaching the coolest thing ever on Youtube.
- The AI Summer: Great platform to learn basics and some advanced concepts of DL.
March 25 Update
- The Ultra-Scale Playbook: Training LLMs on GPU Clusters: Training LLMs and making lots of GPUs go brrr.
- The Annotated Transformer: Nice blog about the infamous Attention is All You Need paper with code.
- How to build a 70B LLM model: Three-part series on how they trained a 70B model
- How to Build an AI Data Center: Interesting article on what challenges data centers confronts.
- Getting Started in Security: Course by Antisyphon Training and John Strand, it provided me an incredible fundamental refresher of security concepts (If useful, I've written my notes here).
- Flash Attention from scratch: 7.5 hours project about Flash Attention by Umar Jamil (TO-DO).
- Coding an Antivirus in C: Dr Jonas Birch YouTube channel is great for C resources (TO-DO).
- Detection Engineering for Beginners: Course I want to follow in the following months about Detection Engineering (TO-DO).
- IO devices and latency: Blog with beautiful visualization of IO devices (HD, SSD, tapes).