my photo

News

  • 12/2021: We have a new paper accepted at AAAI 2022 which is the first work that studies the best-of-both-worlds problem in online learning to rank, under the position-based model.

  • 09/2021: Two papers are accepted at NeurIPS. One talks about a new graph quantity that could be more tight for graph bandits with weakly observable graphs. And the other one gives the first positive result for Thompson sampling algorithm in combinatorial bandits with approximation (greedy) oracle.

  • 07/2021: Here is the slides for my talk of the title "Online Learning to Rank with Click Models: An Overview" in the 2nd Workshop on Deep Reinforcement Learning for Information Retrieval at SIGIR'2021 (DRL4IR).

  • 04/2021: We have a new paper accepted in SIGIR 2021. The work improves the current bandit algorithm for conversational recommendation system by considering comparison feedback.

  • 09/2020: We have a new paper accepted in NeurIPS 2020. The work provides the first regret bound on online influence maximization under linear threshold model.

  • 09/2019: We have a new paper on the Gambler's problem. The work is accepted at ICLR 2020 and the workshop of OptRL in NeurIPS 2019.


Professional Services

Award
    Outstanding Reviewer (8%) for NeurIPS-2021
Journal Reviewer for
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)
  • Machine Learning: Special Issue on Reinforcement Learning for Real Life 2020
  • Journal of Global Optimization
  • IEEE Journal on Selected Areas in Information Theory
  • Manufacturing and Service Operations Management
Conference Reviewer for
  • International Conference on Learning Representations (ICLR) 2022-2021
  • International Conference on Artificial Intelligence and Statistics (AISTATS) 2022, 2020
  • International Conference on Autonomous Agents and Multiagent Systems (AAMAS) 2022-2021
  • International Conference on Machine Learning (ICML) 2021-2019
  • Conference on Neural Information Processing Systems (NeurIPS) 2021-2018
  • The ACM-SIAM Symposium on Discrete Algorithms (SODA) 2021
  • AAAI Conference on Artificial Intelligence (AAAI) 2021-2020 2018
  • Conference on Uncertainty in Artificial Intelligence (UAI) 2021-2019
  • The International Colloquium on Automata, Languages and Programming (ICALP) 2020
  • Reinforcement Learning for Real Life Workshop (at ICML 2021)
  • International Conference on Neural Computation Theory and Applications (NCTA) 2019
  • Ubicomp Workshop on Continual and Multimodal Learning for Internet of Things (CML-IoT 2019)

Publications

*Equal contribution; #Corresponding author
  • Simultaneously Learning Stochastic and Adversarial Bandits under the Position-based Model
    Cheng Chen, Canzhe Zhao, Shuai Li#.
    Accepted in AAAI. 2022.

  • Combinatorial Bandits under Strategic Manipulations [arXiv][code]
    Jing Dong, Ke Li, Shuai Li, Baoxiang Wang#.
    Accepted in WSDM. 2022.

  • The Hardness Analysis of Thompson Sampling for Combinatorial Semi-bandits with Greedy Oracle [arXiv]
    Fang Kong, Yueran Yang, Wei Chen, Shuai Li#.
    Accepted in NeurIPS. 2021.

  • Understanding Bandits with Graph Feedback [arXiv]
    Houshuang Chen, Zengfeng Huang, Shuai Li, Chihao Zhang#. (alphabetical order)
    Accepted in NeurIPS. 2021.

  • Combinatorial online learning based on optimizing feedbacks (in Chinese) [link]
    Fang Kong, Yueran Yang, Wei Chen, Shuai Li#.
    Big Data Research. 2021.

  • A robust and generalizable immune-related signature for sepsis diagnostics [link]
    Yueran Yang*, Yu Zhang*, Shuai Li#, Xubin Zheng, Man Hon Wong, Kwong-Sak Leung, Lixin Cheng#
    IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB). 2021.

  • Clustering of Conversational Bandits for User Preference Learning and Elicitation [link]
    Junda Wu*, Canzhe Zhao*, Tong Yu, Jingyang Li, Shuai Li#.
    Proceedings of the 30th ACM International Conference on Information & Knowledge Management (CIKM). 2021.

  • Deconfounded and Explainable Interactive Vision-Language Retrieval of Complex Scenes [link]
    Junda Wu, Tong Yu, Shuai Li#.
    Proceedings of the 29th ACM International Conference on Multimedia (MM). 2021.

  • Comparison-based Conversational Recommender System with Relative Bandit Feedback [link][code]
    Zhihui Xie, Tong Yu, Canzhe Zhao, Shuai Li#.
    The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2021.

  • A Graph-Enhanced Click Model for Web Search [link]
    Jianghao Lin, Weiwen Liu, Xinyi Dai, Weinan Zhang, Shuai Li, Ruiming Tang, Xiuqiang He, Jianye Hao and Yong Yu.
    The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2021.

  • An Adversarial Imitation Click Model for Information Retrieval [arXiv][link][code][video]
    Xinyi Dai, Jianghao Lin, Weinan Zhang, Shuai Li, Weiwen Liu, Ruiming Tang, Xiuqiang He, Jianye Hao, Jun Wang, Yong Yu.
    30th The Web Conference (WWW). 2021.

  • Online Influence Maximization under Linear Threshold Model [arXiv][link][slides][poster]
    Shuai Li, Fang Kong, Kejie Tang, Qizhi Li, Wei Chen.
    The 34th Conference on Neural Information Processing Systems (NeurIPS). 2020.

  • A Survey on Online Influence Maximization (in Chinese) [link]
    Fang Kong, Qizhi Li, Shuai Li#.
    Computer Science, 2020.

  • The Gambler’s Problem and Beyond [arXiv]
    Baoxiang Wang, Shuai Li, Jiajin Li, Siu On Chan.
    Eighth International Conference on Learning Representations (ICLR), 2020.
    Also presented at the OptRL workshop in NeurIPS 2019.

  • Stochastic Online Learning with Probabilistic Graph Feedback [arXiv][link][slides][poster]
    Shuai Li, Wei Chen, Zheng Wen, Kwong-Sak Leung.
    The 34th AAAI Conference on Artificial Intelligence (AAAI), 2020.

  • Predicting Associations among Drugs, Targets and Diseases by Tensor Decomposition for Drug Repositioning [link]
    Ran Wang, Shuai Li, Lixin Cheng, Man-Hon Wong, Kwong-Sak Leung.
    BMC Bioinformatics, 2019.
    Previous conference version:
    Drug-Protein-Disease Association Prediction and Drug Repositioning Based on Tensor Decomposition [link]
    Ran Wang, Shuai Li, Man-Hon Wong, Kwong-Sak Leung.
    IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 2018.

  • Improving Prediction of Phenotypic Drug Response on Cancer Cell Lines Using Deep Convolutional Network [link]
    Pengfei Liu, Hongjian Li, Shuai Li, Kwong-Sak Leung.
    BMC Bioinformatics, 2019.

  • Improved Algorithm on Online Clustering of Bandits [link][arXiv][code][slides]
    Shuai Li, Wei Chen, S Li, Kwong-Sak Leung.
    The 28th International Joint Conference on Artificial Intelligence (IJCAI), 2019.

  • Online Learning to Rank with Features [link][arXiv][code][slides][poster]
    Shuai Li, Tor Lattimore, Csaba Szepesvari.
    The 36th International Conference on Machine Learning (ICML), 2019.

  • TopRank: A Practical Algorithm for Online Stochastic Ranking [link][arXiv][poster]
    Tor Lattimore, Branislav Kveton, Shuai Li, Csaba Szepesvari.
    The 32nd Conference on Neural Information Processing Systems (NeurIPS). 2018.

  • Offline Evaluations of Ranking Policies with Click Models [link][arXiv][slides][poster][video]
    Shuai Li, Yasin Abbasi-Yadkori, Branislav Kveton, S. Muthukrishnan, Vishwa Vinay, Zheng Wen.
    The 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD Research Track). 2018.
    Also presented in the CausalML Workshop of ICML 2018.

  • Contextual Dependent Click Bandit Algorithm for Web Recommendation [pdf]
    Weiwen Liu, Shuai Li, Shengyu Zhang.
    International Computing and Combinatorics Conference (COCOON), pp. 39-50. Springer, Cham, 2018.

  • Online Clustering of Contextual Cascading Bandits [link][arXiv][slides][poster]
    Shuai Li, Shengyu Zhang.
    The 32nd AAAI Conference on Artificial Intelligence (AAAI). 2018.

  • Contextual Combinatorial Cascading Bandits [link][slides][poster]
    Shuai Li, Baoxiang Wang, Shengyu Zhang, Wei Chen.
    The 33rd International Conference on Machine Learning (ICML), pp. 1245-1253. 2016.
    Also presented in the International Doctoral Forum (oral), Hong Kong, 2016.

  • A Hybrid Distributed Framework for SNP Selections [pdf]
    Pengfei Liu, Shuai Li, Weiying Yi, Kwong-Sak Leung.
    Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), p. 192.
    The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 2016.

  • Design for Triangular Rational Bezier Harmonic and Biharmonic Surfaces (in Chinese) [pdf]
    Shuai Li, Xiaoqian Xu, Guojin Wang
    Journal of Zhejiang University (Science Edition) 2012 39 (2).