Shuai Zheng

Applied Scientist
Amazon Web Services
2100 University Ave, East Palo Alto, CA, USA
szhengac@connect.ust.hk
Github

About Me

I am working as an Applied Scientist at Amazon Web Services. I received my Ph.D. degree in computer Science and Engineering at Hong Kong University of Science and Technology in 2019, supervised by Professor James T. Kwok. I obtained my M.Phil. degree in Computer Science and Engineering from Hong Kong University of Science and Technology in 2015. Before joining HKUST, I received my Bachelor degree in Software Engineering from Beijing Jiaotong University in 2013.

Research Interests

  • Large-Scale Machine Learning Algorithm
  • Stochastic Optimization and Distributed Optimization
  • Optimization in Deep Learning
  • Deep Learning
  • Reinforcement Learning
  • Neural Machine Translation

Working Experience

  • Applied Scientist Intern, AWS Deep Learning, Amazon AI
    East Palo Alto, CA, USA, Feb 2018 - Aug 2018
  • Research Intern, VIPL Group, Institute of Computing Technology, Chinese Academy of Sciences
    Beijing, China, August 2012 - April 2013

Projects

  • Gluon NLP: GluonNLP is a toolkit that enables easy text preprocessing, datasets loading and neural models building to help you speed up your Natural Language Processing (NLP) research.

Publications

  1. Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback
    Shuai Zheng, Ziyue Huang, James T. Kwok
    The 33rd Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, December 2019

  2. Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data [supplementary]
    Shuai Zheng, James T. Kwok
    The 35th International Conference on Machine Learning (ICML), Stockholm, Sweden, July 2018

  3. Follow the Moving Leader in Deep Learning [supplementary]
    Shuai Zheng, James T. Kwok
    The 34th International Conference on Machine Learning (ICML), Sydney, Australia, August 2017

  4. Fast-and-Light Stochastic ADMM [supplementary] [longer arxiv version]
    Shuai Zheng, James T. Kwok
    The 25th International Joint Conference on Artificial Intelligence (IJCAI), New York, New York, USA, July 2016

  5. Fast Nonsmooth Regularized Risk Minimization with Continuation [supplementary]
    Shuai Zheng, Ruiliang Zhang, James T. Kwok
    The 30th AAAI Conference on Artificial Intelligence (AAAI), Phoenix, Arizona, USA, Feb 2016

  6. Asynchronous Distributed Semi-Stochastic Gradient Optimization [supplementary]
    Ruiliang Zhang, Shuai Zheng, James T. Kwok
    The 30th AAAI Conference on Artificial Intelligence (AAAI), Phoenix, Arizona, USA, Feb 2016

  7. Accurate Integration of Aerosol Predictions by Smoothing on a Manifold [code][data]
    Shuai Zheng, James T. Kwok
    The 28th AAAI Conference on Artificial Intelligence (AAAI), Quebec City, Canada, July 2014

  8. Flexible Navigation in Smartphones and Tablets using Scalable Storyboards
    Shuai Zheng, Luis Herranz, Shuqiang Jiang
    The 3rd ACM International Conference on Multimedia Retrieval (ICMR), Dallas, Texas, USA, April 2013

Preprints

Awards

  • Postgraduate Studentship, HKUST 2015 - 2019
  • Travel Award, AAAI 2014, IJCAI 2016, ICML (2017, 2018)
  • Undergraduate Scholarship, BJTU 2012

Academic Services

  • PC member of AAAI Conference on Artificial Intelligence (AAAI) 2019 - 2020
  • PC member of Asian Conference on Machine Learning (ACML) 2018 - 2019
  • Reviewer of International Conference on Machine Learning (ICML) 2017, 2019
  • Reviewer of Neural Information Processing Systems (NeurIPS) 2018 - 2019
  • Reviewer of International Conference on Artificial Intelligence and Statistics (AISTATS) 2019 - 2020
  • Reviewer of Machine Learning Journal (MLJ)
  • Reviewer of IEEE Access
  • Reviewer of IEEE Transactions on Automatic Control (IEEE TAC)
  • Reviewer of IEEE Transactions on Signal Processing (IEEE TSP)
  • Reviewer of ACM Transactions on Knowledge Discovery from Data (TKDD)
  • Reviewer of IEEE/ACM Transactions on Networking (TON)
  • Reviewer of IEEE Transactions on Signal and Information Processing over Networks (IEEE TSIPN)
  • Reviewer of IEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS)

Talks & Presentations

  • Learning to Learn Driver's Routing
    Hong Kong, May 2019, HKUST
  • Scalable Neural Machine Translation
    East Palo Alto, CA, USA, August 2018, Amazon AI
  • Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data [video]
    Stockholm, Sweden, July 2018, ICML
  • Follow the Moving Leader in Deep Learning [video]
    Sydney, Australia, August 2017, ICML

Teaching Experience

  • TA of COMP5212 Machine Learning (PG)
  • TA of MSBD5012 Machine Learning (MSC)
  • TA of COMP4211 Machine Learning (UG)
  • TA of COMP4331 Introduction to Data Mining (UG)
  • TA of COMP2012H Honors Object-Oriented Programming and Data Structures (UG)