Notes

Below is a collection of notes that I have prepared for seminars, reading group presentations, PhD milestones, and tutorials.

• Compute-Optimal Scaling Laws under Low-Rank Feature Map Perturbations (PhD Research Comprehensive Exam) [Full Report] [Slides]
• Informal seminar on SGD sample complexity in single-index models [Notes]
• Reading group presentation on scaling laws [Notes]
• Reading group presentation on spectral clustering (based on von Luxburg’s tutorial) [Notes]
• Reading group presentation on “Scaling Laws of Optimization” (Francis Bach’s blog post) [Notes]
• Reading group presentation on “Transformers as Statisticians” (Bai et al., 2023) [Notes]
• Brief summary of research on knowledge distillation of self-supervised image representations [Notes]
• Calculus 3 (MATH 222 at McGill) Final Exam Review Notes [Notes]