I’m Aakash Varma. I work on model research and engineering at a stealth startup, currently exploring world models, gaussian splats, robotics, model inference, model finetuning, and model optimization. I like problems at the intersection of mathematics, algorithms, models, and hardware.

• Coming soon 03.18.26 Let it Flow
• Research 04.27.25 The RoPE Compatibility Problem in DeepSeek's Multi Head Latent Attention
• Analysis 01.01.25 Analysis of Matrix Multiplications in Transformer Architectures

More tech-related writing on Word Vectors.