Its Me

Don Dennis

  donkdennis [at] gmail [dot] com
  dondennis [at] meta [dot] edu
  Menlo Park, CA, USA
  Google Scholar
  Github
  Resume

I am a Research Scientist at Meta, in Menlo Park, where my work focuses on designing and implementing machine learning (ML) systems that are both theoretically sound and practically impactful --- bridging low-level hardware, algorithms, and high-level applications. My work includes developing algorithms and frameworks to

  • Perform on-device ML inference with minimal memory and compute (EdgeML on microcontrollers),
  • Enable efficient federated learning on heterogeneous networks (e.g., k-fed: one-shot federated clustering),
  • Support adaptive inference for cloud-based LLM deployments (e.g., B-Distil, ABC),
  • Continually solve large-scale optimization problems (e.g., COpter: a system for continual optimization in resource allocation).

Previously, I was a PhD student in the Machine Learning Department at Carnegie Mellon University, advised by Prof. Virginia Smith. In Summer '21, I interned with Kazuhito Koishida at Microsoft Applied Sciences Group, Redmond, where I worked on adaptive ML inference methods. Prior to that, I spent two enriching years as a Research Fellow at Microsoft Research India, advised by Prateek Jain and Harsha Simhadri. I completed my undergraduate studies at the Indian Institute of Technology, Patna, where I worked with Prof. Arijit Mondal on designing a RISC-V microprocessor and accompanying toolchain, applied in FPGA-based hardware simulations and educational tools.


Publications

COpter: Efficient Large-Scale Resource-Allocation via Continual Optimization
Don Dennis*, Suhas Jayaram Subramanya*, Virginia Smith, Greg Ganger
Symposium on Operating Systems Principles (SOSP), 2025
Agreement-Based Cascading for Efficient Inference
Don Dennis*, Steven Kolawole*, Ameet Talwalkar, Virginia Smith
Transactions on Machine Learning Research (TMLR), 2025
Progressive Ensemble Distillation: Building Ensembles for Efficient Inference
Don Dennis, Abhishek Shetty, Anish Sevekari, Kazuhito Koishida, Virginia Smith
Advances in Neural Information Processing Systems (NeurIPS), 2023
Bitrate-Constrained DRO: Beyond Worst Case Robustness To Unknown Group Shifts
Amrith Setlur, Don Dennis, Benjamin Eysenbach, Aditi Raghunathan, Chelsea Finn, Virginia Smith and Sergey Levine
International Conference on Learning Representations (ICLR), 2023
Heterogeneity for the Win: Communication Efficient Distributed Clustering
Don Dennis, Tian Li, Virginia Smith
International Conference on Machine Learning (ICML), 2021 (Spotlight).
Shallow RNN: Accurate Time-series Classification on Resource Constrained Devices
Don Dennis, Durmus Alp Emre Acar, Vikram Mandikal, Vinu Sankar Sadasivan, Harsha Vardhan Simhadri, Venkatesh Saligrama, Prateek Jain
Advances in Neural Information Processing Systems (NeurIPS), 2019
GesturePod: Programmable Gesture Recognition for Augmenting Assistive Devices
Shishir Patil, Don Dennis, Chirag Pabbaraju, Rajanikant Deshmukh, Harsha Vardhan Simhadri, Manik Varma, Prateek Jain
ACM User Interface Software and Technology Symposium (UIST), 2019
Multiple Instance Learning for Sequential Data Classification on Resource Constrained Devices
Don Dennis, Chirag Pabbaraju, Harsha Vardhan Simhadri, Prateek Jain
Advances in Neural Information Processing Systems (NeurIPS), 2018
Single Cycle RISC-V Micro Architecture Processor and its FPGA Prototype
Don Dennis, Ayushi Priyam, Sukhpreet Singh Virk, Sajal Agrawal, Tanuj Sharma, Arijit Mondal, Kailash Chandra Ray
International Symposium on Embedded Computing and System Design (ISED), 2017

Workshops and Demos

Revisiting Cascaded Ensembles for Efficient Inference
Steven Kolawole, Don Dennis, Ameet Talwalkar, Virginia Smith
ES-FOMO Workshop at International Conference on Learning Representations (ICLR), 2024
Progressive Knowledge Distillation: Balancing Inference Latency and Accuracy at Runtime
Don Dennis, Abhishek Shetty, Anish Sevekari, Kazuhito Koishida, Virginia Smith
ES-FOMO Workshop at International Conference on Machine Learning (ICML), 2024
EdgeML: Edge of Machine Learning --- Demonstration of Low Resource Keyword Spotting
Don Dennis, Harsha Simhadri, Prateek Jain
MLPCD2 Workshop at Advances in Neural Information Processing Systems (NeurIPS), 2018
GesturePod: Demonstrating On-Device Gesture Recognition
Shishir Patil, Don Dennis, Chirag Pabbaraju, Harsha Simhadri, Manik Varma, Prateek Jain
Microsoft Booth 203, Advances in Neural Information Processing Systems (NeurIPS), 2018
Talk-Bot: Federated Human Detection for Collaborative Multi-Angle Videography
Don Dennis, Harshit Singh, Karan Jakhar, Prashant Baghel
International Symposium on Embedded Computing and System Design (ISED), 2016