Towards Efficient Optimizer Design for LLM via Structured Fisher Approximation with a Low-Rank Extension

Senior Researcher at Microsoft Research Cambridge working on learning dynamics and optimization for foundation models, with prior work on causality and approximate inference.