HSA4ESMLS PPoSS: LARGE: Co-designing Hardware, Software, and Algorithms to Enable Extreme-Scale Machine Learning Systems

Publication

Junyi Li, Heng Huang. “Resolving the Tug-of-War: A Separation of Communication and Learning in Federated Learning”. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), in press.

Junyi Li, Feihu Huang, Heng Huang. “Communication-Efficient Federated Bilevel Optimization with Global and Local Lower Level Problems”. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), in press.

Wenhan Xian, Heng Huang. “Finding Local Minima Efficiently in Decentralized Optimization”. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), in press.

Xidong Wu, Jianhui Sun, Zhengmian Hu, Junyi Li, Aidong Zhang, Heng Huang. “Federated Conditional Stochastic Optimization”. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), in press.

Xidong Wu, Jianhui Sun, Zhengmian Hu, Aidong Zhang, Heng Huang. “Solving a Class of NonConvex Minimax Optimization in Federated Learning”. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), in press.

Zhengmian Hu, Heng Huang. “Optimization and Bayes: A Trade-off for Overparameterized Neural Networks”. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), in press.

Shangqian Gao, Burak Uzkent, Yilin Shen, Heng Huang, Hongxia Jin. “Learning to Jointly Share and Prune Weights for Grounding Based Vision and Language Models”. The Eleventh International Conference on Learning Representations (ICLR 2023).

Xiangyu Yin, Kai Huang, Erick Forno, Wei Chen, Heng Huang, Wei Gao. “PTEase: Objective Airway Examination for Pulmonary Telemedicine using Commodity Smartphones”. 21st Annual International Conference on Mobile Systems, Applications and Services (MobiSys 2023), pp. 110-123.

Zhengmian Hu, Heng Huang. “Tighter Analysis for ProxSkip”. Fortieth International Conference on Machine Learning (ICML 2023), pp. 13469–13496.

Zhengmian Hu, Xidong Wu, Heng Huang. “Beyond Lipschitz Smoothness: A Tighter Analysis for Nonconvex Optimization”. Fortieth International Conference on Machine Learning (ICML 2023), pp. 13652–13678.

Xidong Wu, Zhengmian Hu, Jian Pei, Heng Huang. “Serverless Biased Stochastic Methods for Multi[1]Party Collaborative Imbalanced Data Mining”. 29th SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2023), pp. 2648–2659.

Xidong Wu, Zhengmian Hu, Heng Huang. “Decentralized Riemannian Algorithm for Nonconvex Minimax Problems”. Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023), pp. 10370–10378.

Xidong Wu, Feihu Huang, Zhengmian Hu, Heng Huang. “Faster Adaptive Federated Learning”. Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023), pp. 10379–10387.

Feihu Huang, Junyi Li, Shangqian Gao, Heng Huang. “Enhanced Bilevel Optimization via Bregman Distance”. Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS 2022), pp. 28928–28939.

Xiangyu Yin, Kai Huang, Erick Forno, Wei Chen, Heng Huang, Wei Gao. “Out-Clinic Pulmonary Disease Evaluation via Acoustic Sensing and Multi-Task Learning on Commodity Smartphones”. ACM International Conference on Embedded Networked Sensor Systems (SenSys 2022), pp. 1182–1188

Xidong Wu, Feihu Huang, Heng Huang. “Fast Stochastic Recursive Momentum Methods for Im[1]balanced Data Mining”. The 22nd IEEE International Conference on Data Mining (ICDM 2022), pp. 578–587.

Wenhan Xian, Feihu Huang, Heng Huang. “Communication-Efficient Adam-Type Algorithms for Distributed Data Mining”. The 22nd IEEE International Conference on Data Mining (ICDM 2022), pp. 1245–1250.

Shangqian Gao, Feihu Huang, Yanfu Zhang, Heng Huang. “Disentangled Differentiable Network Pruning”. European Conference on Computer Vision (ECCV 2022), pp. 328–345.

Alireza Ganjdanesh, SHangqian Gao, Heng Huang. “Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps”. European Conference on Computer Vision (ECCV 2022), pp. 278–296.

Jinming Zhuang, Zhuoping Yang, Peipei Zhou. High Performance, Low Power Matrix Multiply Design on ACAP: from Architecture, Design Challenges and DSE Perspectives. 60th ACM/IEEE Design Automation Conference, San Francisco, California, USA, (DAC’23)

Jinming Zhuang, Jason Lau, Hanchen Ye, Zhuoping Yang, Yubo Du, Jack Lo, Kristof Denolf, Stephen Neuendorffer, Alex K. Jones, Jingtong Hu, Deming Chen, Jason Cong, Peipei Zhou. CHARM: Composing Heterogeneous AcceleRators for Matrix Multiply on Versal ACAP Architecture. Proceedings of the 2023 ACM/SIGDA International Symposium on Field Programmable Gate Arrays (FPGA’23)

Jianhui Sun, Sanchit Sinha, Aidong Zhang, Enhance Diffusion to Improve Robust Generalization, Proceedings of the 29th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2023), Long Beach, CA, USA, August 6-10, 2023.

Hongfei Xue, Boen Cao, Yan Ju, Aidong Zhang, Lu Su, M^4esh: mmWave-based 3D Human Mesh Construction for Multiple Subjects, 2022 Conference on Embedded Networked Sensor Systems (SenSys 2022), Boston, Nov 7 – 9, 2022.

Hongfei Xue, Qiming Cao, Chenglin Miao, Yan Ju, Haochen Hu, Aidong Zhang, Lu Su, mmUPE: mmWave-based Unseen Pose Estimation, MobiCom2023, the 29th Annual International Conference On Mobile Computing And Networking, 2-6 Oct 2023, Madrid, Spain.

Sanchit Sinha, Mengdi Huai, Jianhui Sun, and Aidong Zhang, Understanding and Enhancing Robustness of Concept-based Models, the Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI-2023), Washington, DC, February 7-14, 2023.

Lingxi Wu, Rahul Sreekumar, Rasool Sharifi, Kevin Skadron, Mircea Stan, Ashish Venkat. Hardware Trojans in eNVM Neuromorphic Devices. In Proceedings of the 26th Design, Automation and Test in Europe Conference (DATE), April, 2023. Nominated for Best Paper Award.

Jiechao Gao, Wenpeng Wang, Fateme Nikseresht, Viswajith Govinda Rajan, and Bradford Campbell. PFDRL: Personalized Federated Deep Reinforcement Learning for Residential Energy Management. In Proceedings of the 52nd International Conference on Parallel Processing (ICPP ’23).

Fateme Nikseresht, Wenpeng Wang, Viswajith Govinda Rajan, Jiechao Gao, and Bradford Campbell. Enabling Ubiquitous Occupancy Detection in Smart Buildings: A WiFi FTM-based Approach. In 2023 19th International Conference on Distributed Computing in Sensor Systems (DCOSS).