Lili Mou, PhD

Calendar

Email:
LMOU [dot] ualberta [at] ca
doublepower [dot] mou [at] gmail [dot] com
Note: Please send to at most one email address of mine.


Dr. Lili Mou is an Assistant Professor at the Department of Computing Science, University of Alberta. Lili received his BS and PhD degrees in 2012 and 2017, respectively, from School of EECS, Peking University. After that, he worked as a postdoctoral fellow at the University of Waterloo and a research scientist at Adeptmind (a startup in Toronto, Canada). His research interests include deep learning applied to natural language processing as well as programming language processing. He has publications at top conferences and journals, including AAAI, ACL, CIKM, COLING, EMNLP, ICASSP, ICML, IJCAI, INTERSPEECH, NAACL-HLT, and TACL (in alphabetic order). He also has tutorials at EMNLP-IJCNLP'19 and ACL'20. [CV]

Admitting

I am admitting all-level students. The application should be addressed to the University portal,
but the prospective students could also contact me directly with CV and a statement of interest.

Requirements for prospective students: Self-funded visiting students and scholars are always welcome.



Teaching

CMPUT 651 Deep Learning for NLP [Fall 2019]

Independent Study:
I feel happy to offer the Independent Study course for both undergraduate and graduate students.
A student interested in such a research course should write me a letter of motivation.
The project idea could come from either the student or the instructor, and ideally both.

Seminars

In our seminars, we discuss machine learning theories, algorithms,
and applications (with special interest in NLP). We start from the foundations,
and move to the frontiers.

Please visit here for contents.

Publications

Copyright announcement: Copyrights of published papers might be held by publishers. All rights are reserved for other materials, including drafts, slides, and source code. Whenever not conflicting with copyright laws, I permit free use for non-commerical purposes. Please cite my papers if you use them for research. In particular, if a paper is accompanied with source code, the URL is available in the paper. Please notice, however, there's no guarantee that my code is executable in your environment.

Useful links: Complete list, Google Scholar, DBLP

Book

  • Lili Mou, Zhi Jin. Tree-Based Convolutional Neural Networks: Principles and Applications, Springer, 2018. [url]

New

  • Xianggen Liu, Lili Mou, Haotian Cui, Zhengdong Lu, Sen Song. Finding decision jumps in text classification. Neurocomputing, vol 371, pages 177--187, 2020. [url]

  • Yunli Wang, Yu Wu, Lili Mou, Zhoujun Li, Wenhan Chao. Harnessing pre-trained neural networks with rules for formality style transfer. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3571--3576, 2019. [pdf]

  • Bowen Li, Lili Mou, Frank Keller. An imitation learning approach to unsupervised parsing. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL-short), pages 3485--3492, 2019. [pdf, slides (courtesy of BL)] (Best paper nomination)

  • Vineet John, Lili Mou, Hareesh Bahuleyan, Olga Vechtomova. Disentangled representation learning for non-parallel text style transfer. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL), pages 424--434, 2019. [pdf]

  • Yu Bao, Hao Zhou, Shujian Huang, Lei Li, Lili Mou, Olga Vechtomova, Xin-Yu Dai, Jiajun Chen. Generating sentences from disentangled syntactic and semantic spaces. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL), pages 6008--6019, 2019. [pdf]

  • Hareesh Bahuleyan, Lili Mou, Hao Zhou, Olga Vechtomova. Stochastic Wasserstein autoencoder for probabilistic sentence generation. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT short), pages 4068--4076, 2019. [pdf, slides]

  • Ning Miao, Hao Zhou, Lili Mou, Rui Yan, Lei Li. CGMH: Constrained sentence generation by Metropolis-Hastings sampling. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI), pages 6834--6942, 2019. [pdf]

  • Zeyu Sun, Qihao Zhu, Lili Mou, Yingfei Xiong, Ge Li, Lu Zhang. A grammar-based structural CNN decoder for code generation. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI), pages 7055--7062, 2019. [pdf]

  • Bolin Wei,1 Shuai Lu,1 Lili Mou, Hao Zhou, Pascal Poupart, Ge Li, Zhi Jin. Why do neural dialog systems generate short and meaningless replies? A comparison between dialog and translation. In Proceedings of the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 7290--7294, 2019. [pdf]

Selected Refereed Papers

[Selection is NOT based on the venue or length of a paper.]
  • Hareesh Bahuleyan,1 Lili Mou,1 Olga Vechtomova, Pascal Poupart. Variational attention for sequence-to-sequence models. In Proceedings of the International Conference on Computational Linguistics (COLING), pages 1672--1682, 2018. Also presented at TADGM Workshop @ICML, 2018. [pdf, slides]

  • Lili Mou, Zhengdong Lu, Hang Li, Zhi Jin. Coupling distributed and symbolic execution for natural language queries. In Proceedings of the 34th International Conference on Machine Learning (ICML), pages 2518--2526, 2017. Also presented in ICLR Workshop, 2017. [pdf, slides (courtesy of ZL), slides]

  • Lili Mou, Zhao Meng, Rui Yan, Ge Li, Yan Xu, Lu Zhang, Zhi Jin. How transferable are neural networks in NLP applications? In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 478--489, 2016. [pdf]

  • Yunchuan Chen, Lili Mou, Yan Xu, Ge Li, Zhi Jin. Compressing neural language models by sparse word representations. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL), pages 226--235, 2016. [pdf]

  • Lili Mou, Ge Li, Lu Zhang, Tao Wang, Zhi Jin. Convolutional neural networks over tree structures for programming language processing. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI), pages 1287--1293, 2016. [pdf]

  • Lili Mou,1 Hao Peng,1 Ge Li, Yan Xu, Lu Zhang, Zhi Jin. Discriminative neural sentence modeling by tree-based convolution. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2315--2325, 2015. [pdf, slides]

  • Yan Xu, Lili Mou, Ge Li, Yunchuan Chen, Hao Peng, Zhi Jin. Classifying relations via long short term memory networks along shortest dependency paths. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1785--1794, 2015. [pdf, slides (courtesy of YX)]

1=equal contribution.

Academic Service

Primary reviewer

NAACL'16 (best reviewers), COLING'16, ACL'17, AAAI'18, NAACL'18, ACL'18, COLING'18 (PC and Mentor),
ACL'19, IJCAI'19, NeurIPS'19, Computer Speech & Language, TKDE

Talk

Lili Mou, Hao Zhou, Lei Li. Discreteness in Neural Natural Language Processing. Tutorial at EMNLP-IJCNLP, 2019. [Part I, Part II, Part III]

Guest Lectures

Guest Lecture of the "Deep Learning Techniques and Applications" course (11 May 2017):
Neural Networks in NLP: The Curse of Indifferentiability [slides: I, II, III]
Mini-Project Tutorial for Undergrad. Res. Opportunities Conf. @ U Waterloo (22 and 23 Sep 2017):
Adversarial Training and Security in Machine Learning [slides, code]
Guest Lecture of the "Text Analytics" course (4 July 2019):
Sampling and Stochastic Search for Text Generation [pdf]

Co-Supervised Students

2014.7--2015.6
Hao Peng (undergraduate)
with publication at
EMNLP-15.
2015.7--2016.3
Rui Men (undergraduate)
with publication at
ACL-16.
2015.7--2017.6
Zhao Meng (undergraduate)
with publications at
EMNLP-16, CIKM-17 & AAAI-18 (student poster).
2015.7--2018.2
Bolin Wei (undergraduate
-> master's student) with
publication at ICASSP-19.
2016.1--2017.1
Yiping Song (PhD student)
with publication at
INTERSPEECH-16.
2017.9--2018.8
Hareesh Bahuleyan (master's student) with publication
at COLING-18 & NAACL-19.
2017.9--2018.11
Nabiha Asghar (PhD student)
with arXiv preprint
2017.9--2018.8
Vineet John (master's student)
with publication
at ACL-19


Entertainment

Lili Mou's major hobbies include practicing calligraphy, watching yueju,
visiting traditional Chinese architectures, taking MOOCs, and many others.

Gallery