research.html

<!DOCTYPE html>
<html lang="en-us">
  <head>
  <style type="text/css">
  .pub
  {
  	margin-top:2px;
  }
  .main
  {
  	width:85%;
  	padding-left:5%;
  	text-align:justify;
  }
  </style>
    <meta charset="UTF-8">
    <title>Furu Wei's Homepage</title>
  </head>
  <body>
    <h1 style="padding-left:5%"><a href="index.html" style="text-decoration: none;">Furu Wei &#x2190;</a></h1>
    
    <div class="main" style="font-size:12pt;margin-top:-10px">
    Partner Research Manager (首席研究员/全球合伙人), Microsoft Research Asia (MSRA)
    </div>
    
	<div style="height:10px"></div>
    
	<h3 style="padding-left:5%">Recent Talks</h3>
	<div class="main">
	<ol>
	<li class="pub">06/06/2021 - GAITC 2021 自然语言理解专题论坛，特邀报告，"Unified Language Model Pre-training"</li>
	<li class="pub">23/10/2020 - CNCC 2020，特邀报告，"Unified Language Model Pre-training"</li>
	<li class="pub">12/10/2020 - CCMT 2020，特邀报告，"Recent Progress in Language Model Pre-training"</li>
	<li class="pub">22/12/2018 - <a href="https://aidl.caai.cn/" target="_blank">CAAI-AIDL</a>（中国人工智能学会AI前沿讲习班），第六期《自然语言处理》，“自然语言阅读理解”</li>
	<li class="pub">08/08/2018 - 第九届CCF优博论坛，特邀报告</li>
	<li class="pub">05/26/2018 - CCF YOCSEF二十周年暨青年精英大会“思想秀”，特邀报告</li>
	<li class="pub">07/23/2017 - 第二届“语言与智能高峰论坛”，年轻科学家专场报告</li>
    </ol>
    </div>
        
	<h3 style="padding-left:5%">Publications</h3>
	<div class="main">
	<a href="http://scholar.google.com/citations?user=G-V1VpwAAAAJ&hl=en" target="_blank">Google Scholar</a> | <a href="http://dblp.uni-trier.de/pers/hd/w/Wei:Furu" target="_blank">DBLP</a>
	</br></br>#: Students I mentored at Microsoft Research.
	<div style="width:100%;text-align:justify"> 
	<h4>Tech Report, arXiv & Preprints</h4>
	<ol>
	
	<li class="pub"><strong>Foundation Transformers</strong>. Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei. <a href="https://arxiv.org/abs/2210.06423" target="_blank">arXiv</a> 2022. // <b>Magneto</b> </li>
	
			<li class="pub"><strong><font color="black">Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks</font></strong>. Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei. <a href="https://arxiv.org/abs/2208.10442v1" target="_blank">arXiv</a> 2022. // <strong><a href="https://aka.ms/beit-3" target="_blank">BEiT-3</a></strong>: A Milestone of The Big Convergence of Large-scale Pre-training Across Tasks, Languages, and Modalities. </li>
	
		<li class="pub"><strong>BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers</strong>. Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, Furu Wei. <a href="https://arxiv.org/abs/2208.06366" target="_blank">arXiv</a> 2022. </li>
	
	<li class="pub"><strong>Language Models are General-Purpose Interfaces</strong>. Yaru Hao, Haoyu Song, Li Dong, Shaohan Huang, Zewen Chi, Wenhui Wang, Shuming Ma, Furu Wei. <a href="https://arxiv.org/abs/2206.01127" target="_blank">arXiv</a> 2022. </li>
	
	<li class="pub"><strong>VL-BEiT: Generative Vision-Language Pretraining</strong>. Hangbo Bao, Wenhui Wang, Li Dong, Furu Wei. <a href="https://arxiv.org/abs/2206.06336" target="_blank">arXiv</a> 2022. </li>
	
		<li class="pub"><strong>DeepNet: Scaling Transformers to 1,000 Layers</strong>. Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Dongdong Zhang, Furu Wei. <a href="https://arxiv.org/abs/2203.00555" target="_blank">arXiv</a> 2022. </li>
		
		<li class="pub"><strong>Lossless Acceleration for Seq2seq Generation with Aggressive Decoding</strong>. Tao Ge, Heming Xia, Xin Sun, Si-Qing Chen, Furu Wei. <a href="https://arxiv.org/abs/2205.10350" target="_blank">arXiv</a> 2022. // <strong>(Generalized) Aggressive Decoding</strong> </li>
		
		<li class="pub">SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data. Ziqiang Zhang, Sanyuan Chen, Long Zhou, Yu Wu, Shuo Ren, Shujie Liu, Zhuoyuan Yao, Xun Gong, Lirong Dai, Jinyu Li, Furu Wei. <a href="https://arxiv.org/abs/2209.15329" target="_blank">arXiv</a> 2022. </li>
		
			<li class="pub">Visually-Augmented Language Modeling. Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei. <a href="https://arxiv.org/abs/2205.10178" target="_blank">arXiv</a> 2022. </li>
			
			<li class="pub">Prototypical Calibration for Few-shot Learning of Language Models. Zhixiong Han, Yaru Hao, Li Dong, Furu Wei. <a href="https://arxiv.org/abs/2205.10183" target="_blank">arXiv</a> 2022. </li>
	
			<li class="pub">Corrupted Image Modeling for Self-Supervised Visual Pre-Training. Yuxin Fang, Li Dong, Hangbo Bao, Xinggang Wang, Furu Wei. <a href="https://arxiv.org/abs/2202.03382" target="_blank">arXiv</a> 2022. // ELECTRA version of BEiT/MAE.</li>
									
					<li class="pub">Lossless Speedup of Autoregressive Translation with Generalized Aggressive Decoding. Heming Xia, Tao Ge, Furu Wei, Zhifang Sui. <a href="https://arxiv.org/abs/2203.16487" target="_blank">arXiv</a> 2022.</li>
				
		<li class="pub">DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. Shuming Ma, Li Dong, Shaohan Huang, Dongdong Zhang, Alexandre Muzio, Saksham Singhal, Hany Hassan Awadalla, Xia Song, Furu Wei. <a href="https://arxiv.org/abs/2106.13736" target="_blank">arXiv</a> 2021. // <a href="https://github.com/microsoft/unilm/tree/master/deltalm" target="_blank"><strong>DeltaLM @ github</strong></a></li>
		<li class="pub">XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders. Shuming Ma, Jian Yang, Haoyang Huang, Zewen Chi, Li Dong, Dongdong Zhang, Hany Hassan Awadalla, Alexandre Muzio, Akiko Eriguchi, Saksham Singhal, Xia Song, Arul Menezes, and Furu Wei. <a href="https://arxiv.org/abs/2012.15547" target="_blank">arXiv</a> 2020. // <a href="https://github.com/microsoft/unilm/tree/master/xlmt" target="_blank"><strong>XLM-T @ github</strong></a></li>
	
	</ol>
	
	<h4>Conferences</h4>
	<ol>
	
	<li class="pub">EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation. Tao Ge, Furu Wei. EMNLP 2022. <a href="https://arxiv.org/abs/2202.07959" target="_blank">arXiv</a> 2022.</li>
	
	<li class="pub">XDoc: Unified Pre-training for Cross-Format Document Understanding. Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang and Furu Wei. EMNLP 2022. </li>
	
	<li class="pub">Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, hongcheng guo, Zhoujun Li and Furu Wei. EMNLP 2022. </li>
	
	<li class="pub">Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt. Lianzhe Huang, Shuming Ma, Dongdong Zhang, Furu Wei, Houfeng Wang. EMNLP 2022. <a href="https://arxiv.org/abs/2202.11451" target="_blank">arXiv</a> 2022.</li>
	
	<li class="pub">SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training. Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li and Furu Wei. EMNLP 2022. </li>
	
		<li class="pub">PromptBERT: Improving BERT Sentence Embeddings with Prompts. Ting Jiang, Jian Jiao, Shaohan Huang, Zihan Zhang, deqing wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Denvy Deng and Qi Zhang. EMNLP 2022. </li>
	
	<li class="pub">Snapshot-Guided Domain Adaptation for ELECTRA. Daixuan Cheng, Shaohan Huang, Jianfeng Liu, Yuefeng Zhan, Hao Sun, Furu Wei, Denvy Deng and Qi Zhang. EMNLP 2022. </li>
	
	<li class="pub">Distilled Dual-Encoder Model for Vision-Language Understanding. Zekun Wang, Wenhui Wang, Haichao Zhu, ming liu, Bing Qin and Furu Wei. EMNLP 2022. </li>
	
	<li class="pub">On the Representation Collapse of Sparse Mixture of Experts. Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei. NeurIPS 2022. <a href="https://arxiv.org/abs/2204.09179" target="_blank">arXiv</a> 2022. // X-MoE </li>
	
	<li class="pub">VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. Wenhui Wang, Hangbo Bao, Li Dong, Furu Wei. NeurIPS 2022. <a href="https://arxiv.org/abs/2111.02358" target="_blank">arXiv</a> 2021. </li>
	
	<li class="pub">BEiT: BERT Pre-Training of Image Transformers. Hangbo Bao, Li Dong, Songhao Piao, and Furu Wei. <a href="https://arxiv.org/abs/2106.08254" target="_blank">arXiv</a> 2021. <strong>ICLR 2022 Oral</strong> (54/3391). <a href="https://github.com/microsoft/unilm/tree/master/beit" target="_blank"><strong>BEiT @ github</strong></a> // A path to BERT moment for CV.</li>
	
	<li class="pub">LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking. Yupan Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei. <a href="https://arxiv.org/abs/2204.08387" target="_blank">arXiv</a> 2021. ACM MM 2022. // <a href="https://github.com/microsoft/unilm/tree/master/layoutlmv3" target="_blank"><strong>LayoutLMv3 @ github</strong></a></li>
	
	<li class="pub">DiT: Self-supervised Pre-training for Document Image Transformer. Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei. <a href="https://arxiv.org/abs/2203.02378" target="_blank">arXiv</a> 2021. ACM MM 2022. // <a href="https://github.com/microsoft/unilm/tree/master/dit" target="_blank"><strong>DiT @ github</strong></a></li>
					
	<li class="pub">Knowledge Neurons in Pretrained Transformers. Damai Dai, Li Dong, Yaru Hao, Zhifang Sui, Furu Wei. ACL 2022. <a href="https://arxiv.org/abs/2104.08696" target="_blank">arXiv</a> 2021. </li>
	
		<li class="pub">XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei. ACL 2022. <a href="https://arxiv.org/abs/2106.16138" target="_blank">arXiv</a> 2021. </li>
		
			<li class="pub">MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding. Junlong Li, Yiheng Xu, Lei Cui, Furu Wei. ACL 2022. <a href="https://arxiv.org/abs/2110.08518" target="_blank">arXiv</a> 2021. </li>
			
		<li class="pub">XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding. Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei. ACL 2022 (Findings). <a href="https://arxiv.org/abs/2104.08836" target="_blank">arXiv</a> 2021. // LayoutXLM </li>
		
		<li class="pub">StableMoE: Stable Routing Strategy for Mixture of Experts. Damai Dai, Li Dong, Shuming Ma, Bo Zheng, Zhifang Sui, Baobao Chang, Furu Wei. ACL 2022 (Main).. ACL 2022 (Main). </li>
		
			<li class="pub">SpeechT5: Unified-Modal Encoder-Decoder Pre-training for Spoken Language Processing. Junyi Ao, Rui Wang, Long Zhou, Shujie Liu, Shuo Ren, Yu Wu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei. ACL 2022. <a href="https://arxiv.org/abs/2110.07205" target="_blank">arXiv</a> 2021. </li>
		
		<li class="pub">THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei. ACL 2022 (Main). </li>
		
		<li class="pub">Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation. Guanhua Chen, Shuming Ma, Yun Chen, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei. ACL 2022 (Main).</li>
		
		<li class="pub">Attention Temperature Matters in Abstractive Summarization Distillation. Shengqiang Zhang, Xingxing Zhang, Hangbo Bao, Furu Wei. ACL 2022 (Main). </li>
		
		<li class="pub">Neural Label Search for Zero-Shot Multi-Lingual Extractive Summarization. Ruipeng Jia, Xingxing Zhang, Yanan Cao, Shi Wang, Zheng Lin, Furu Wei. ACL 2022 (Main).</li>
		
		<li class="pub">Controllable Natural Language Generation with Contrastive Prefixes. Jing Qian, Li Dong, Yelong Shen, Furu Wei, Weizhu Chen. ACL 2022 (Findings).</li>
		
		<li class="pub">CLIP Models are Few-Shot Learners: Empirical Studies on VQA and Visual Entailment. Haoyu Song, Li Dong, Weinan Zhang, Ting Liu, Furu Wei. ACL 2022 (Main). </li>
		
		<li class="pub">A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model. Xin Sun, Tao Ge, Shuming Ma, Jingjing Li, Furu Wei, Houfeng Wang. IJCAI 2022. </li>
		
		<li class="pub">Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation. Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Shuangzhi Wu, Hongcheng Guo, Zhoujun Li, Furu Wei. IJCAI 2022. </li>
		
		<li class="pub">High-resource Language-specific Training for Multilingual Neural Machine Translation. Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Zhoujun Li, Furu Wei. IJCAI 2022. </li>
		
		<li class="pub">A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model. Xin Sun, Tao Ge, Shuming Ma, Jingjing Li, Furu Wei, Houfeng Wang. IJCAI 2022. </li>
		
		<li class="pub">Swin Transformer V2: Scaling Up Capacity and Resolution. Ze Liu, Han Hu, Yutong Lin, Zhuliang Yao, Zhenda Xie, Yixuan Wei, Jia Ning, Yue Cao, Zheng Zhang, Li Dong, Furu Wei, Baining Guo. CVPR 2022. </li>
			
	<li class="pub">Sequence Level Contrastive Learning for Text Summarization. Shusheng Xu, Xingxing Zhang, Yi Wu, Furu Wei. AAAI 2022.</li>
	<li class="pub">LayoutReading: Pre-training of Text and Layout for Reading Order Detection. Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang and Furu Wei. EMNLP 2021.</li>
	<li class="pub">mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Saksham Singhal, Xian-Ling Mao, Heyan Huang, Xia Song and Furu Wei. EMNLP 2021.</li>
	<li class="pub">Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song and Furu Wei. EMNLP 2021.</li>
	<li class="pub">Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders. Guanhua Chen, Shuming Ma, Yun Chen, Li Dong, Dongdong Zhang, Jia Pan, Wenping Wang and Furu Wei. EMNLP 2021.</li>
	<li class="pub">Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting. Wangchunshu Zhou, Tao Ge, Canwen Xu, Ke Xu and Furu Wei. EMNLP 2021.</li>
	<li class="pub">Jointly Learning to Repair Code and Generate Commit Message. Jiaqi Bai, Long Zhou, Ambrosio Blanco, Shujie Liu, Furu Wei, Ming Zhou and Zhoujun Li. EMNLP 2021.</li>
	<li class="pub">Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression. Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian McAuley and Furu Wei. EMNLP 2021.</li>
		
	<li class="pub">LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding. Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, and Lidong Zhou. <a href="https://arxiv.org/abs/2012.14740" target="_blank">arXiv</a>, ACL 2021. // <a href="https://github.com/microsoft/unilm/tree/master/layoutlm" target="_blank"><strong>LayoutLM @ github</strong></a></li>
	
	<li class="pub">MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, and Furu Wei. <a href="https://arxiv.org/abs/2012.15828" target="_blank">arXiv</a>, ACL 2021. // <a href="https://github.com/microsoft/unilm/tree/master/minilm" target="_blank"><strong>MiniLM @ github</strong></a></li>
	
	<li class="pub">Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment. Zewen Chi, Li Dong, Bo Zheng, Shaohan Huang, Xian-Ling Mao, Heyan Huang and Furu Wei. ACL 2021.</li>
	<li class="pub">Consistency Regularization for Cross-Lingual Fine-Tuning. Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song and Furu Wei. ACL 2021.</li>
	<li class="pub">Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding. Xin Sun, Tao Ge, Furu Wei and Houfeng Wang. ACL 2021.</li>
	<li class="pub">xMoCo: Cross Momentum Contrastive Learning for Open-Domain Question Answering. Nan Yang, Furu Wei, Binxing Jiao, Daxin Jiang and Linjun Yang. ACL 2021.</li>
	
	<li class="pub">Learning to Sample Replacements for ELECTRA Pre-Training. Yaru Hao, Li Dong, Hangbo Bao, Ke Xu and Furu Wei. ACL 2021.</li>
	<li class="pub">Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains. Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong and Furu Wei. ACL 2021.</li>
	<li class="pub">Memory-Efficient Differentiable Transformer Architecture Search. Yuekai Zhao, Li Dong, Yelong Shen, Zhihua Zhang, Furu Wei and Weizhu Chen. ACL 2021.</li>
	<li class="pub">SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation. Shuo Ren, Long Zhou, Shujie Liu, Furu Wei, Ming Zhou and Shuai Ma. ACL 2021.</li>
	<li class="pub">Grammar-Based Patches Generation for Automated Program Repair. Yu Tang, Long Zhou, Ambrosio Blanco, Shujie Liu, Furu Wei, Ming Zhou and Muyun Yang. ACL 2021.</li>
	<li class="pub">Multi-lingual Agreement for Multi-lingual Neural Machine Translation. Jian Yang, Yuwei Yin, Shuming Ma, Haoyang Huang, Dongdong Zhang, Zhoujun Li and Furu Wei. ACL 2021.</li>

	<li class="pub">UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data. Chengyi Wang, Yu Wu, Yao Qian, Kenichi Kumatani, Shujie Liu, Furu Wei, Michael Zeng, Xuedong Huang. <a href="https://arxiv.org/abs/2101.07597" target="_blank">arXiv</a>, ICML 2021.

	
	<li class="pub">InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, and Ming Zhou. NAACL 2021. <a href="https://arxiv.org/abs/2007.07834" target="_blank">arXiv</a>. // <a href="https://github.com/microsoft/unilm/tree/master/infoxlm" target="_blank"><strong>InfoXLM @ github</strong></a> // <strong>Multilingual/Cross-lingual UniLM</strong></li>
	
	<li class="pub">Self-Attention Attribution: Interpreting Information Interactions Inside Transformer. Yaru Hao, Li Dong, Furu Wei, and Ke Xu. AAAI 2021. // <font color="red"> <strong>Best Paper Runners Up</strong></font></li>
	
	<li class="pub">MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, and Ming Zhou. <a href="https://arxiv.org/abs/2002.10957" target="_blank">NeurIPS</a> 2020. // <a href="https://github.com/microsoft/unilm/tree/master/minilm" target="_blank"><strong>MiniLM @ github</strong></a></li>
	
	<li class="pub">BERT Loses Patience: Fast and Robust Inference with Early Exit. Wangchunshu Zhou, Canwen Xu, Tao Ge, Julian McAuley, Ke Xu, and Furu Wei. NeurIPS 2020.</li>
	
	<li class="pub">UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training. Hangbo Bao<sup>#</sup>, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon. <a href="https://arxiv.org/abs/2002.12804" target="_blank">ICML</a> 2020. // <a href="https://github.com/microsoft/unilm/" target="_blank"><strong>UniLMv2 @ github</strong></a></li>
	
		<li class="pub">LayoutLM: Pre-training of Text and Layout for Document Image Understanding. Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, and Ming Zhou. KDD 2020. <a href="https://arxiv.org/abs/1912.13318" target="_blank">arXiv</a> // <a href="https://github.com/microsoft/unilm/tree/master/layoutlm" target="_blank"><strong>LayoutLM @ github</strong></a></li>
	
	<li class="pub">Unified Language Model Pre-training for Natural Language Understanding and Generation. Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, and Hsiao-Wuen Hon. Proc. NeurIPS 2019. <a href="https://arxiv.org/pdf/1905.03197.pdf" target="_blank">arXiv</a>. // <a href="https://github.com/microsoft/unilm" target="_blank"><strong>UniLM @ github</strong></a> </li>
	
		<li class="pub">BERT-of-Theseus: Compressing BERT by Progressive Module Replacing. Canwen Xu, Wangchunshu Zhou, Tao Ge, Furu Wei and Ming Zhou. EMNLP 2020. </li>
<li class="pub">Language Generation with Multi-hop Reasoning on Commonsense Knowledge Graph. Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei, Xiaoyan Zhu and Minlie Huang. EMNLP 2020. </li>
<li class="pub">Pre-training for Abstractive Document Summarization by Reinstating Source Text. Yanyan Zou, Xingxing Zhang, Wei Lu, Furu Wei and Ming Zhou. EMNLP 2020. </li>
<li class="pub">Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction. Mengyun Chen, Tao Ge, Xingxing Zhang, Furu Wei and Ming Zhou. EMNLP 2020. </li>

<li class="pub">Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers. Shusheng Xu, Xingxing Zhang, Yi Wu, Furu Wei and Ming Zhou. EMNLP 2020 (Findings).</li>
<li class="pub">Improving Grammatical Error Correction with Machine Translation Pairs. Wangchunshu Zhou, Tao Ge, Chang Mu, Ke Xu, Furu Wei and Ming Zhou. EMNLP 2020 (Findings).</li>
<li class="pub">Scheduled DropHead: A Regularization Method for Transformer Models. Wangchunshu Zhou, Tao Ge, Furu Wei, Ming Zhou and Ke Xu. EMNLP 2020 (Findings). </li>

<li class="pub">At Which Level Should We Extract? An Empirical Analysis on Extractive Document Summarization. Qingyu Zhou, Furu Wei and Ming Zhou. COLING 2020. </li>
<li class="pub">DocBank: A Benchmark Dataset for Document Layout Analysis. Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li and Ming Zhou. COLING 2020. </li>
<li class="pub">Unsupervised Fine-tuning for Text Clustering. Shaohan Huang, Furu Wei, Lei Cui, Xingxing Zhang and Ming Zhou. COLING 2020. </li>

<li class="pub">Can Monolingual Pretrained Models Help Cross-Lingual Classification? Zewen Chi, Li Dong, Furu Wei, Xianling Mao and Heyan Huang. AACL 2020. </li>
<li class="pub">Investigating Learning Dynamics of BERT Fine-Tuning. Yaru Hao, Li Dong, Furu Wei and Ke Xu. AACL 2020. </li>
<li class="pub">Generating Commonsense Explanation by Extracting Bridge Concepts from Reasoning Paths. Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei, Xiaoyan Zhu and Minlie Huang. AACL 2020. </li>
<li class="pub">UnihanLM: Coarse-to-Fine Chinese-Japanese Language Model Pretraining with the Unihan Database. Canwen Xu, Tao Ge, Chenliang Li and Furu Wei. AACL 2020. </li>
	
	<li class="pub">Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. Xiujun Li, Xi Yin, Chunyuan Li, Xiaowei Hu, Pengchuan Zhang, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, and Jianfeng Gao. Proc. ECCV 2020. <a href="https://arxiv.org/pdf/2004.06165.pdf" target="_blank">arXiv</a>. // <a href="https://github.com/microsoft/oscar" target="_blank"><strong>Oscar @ github</strong></a> </li>
	
	<li class="pub">Harvesting and Refining Question-Answer Pairs for Unsupervised QA. Zhongli Li, Wenhui Wang, Li Dong, Furu Wei and Ke Xu. ACL 2020. </li>
	
	<li class="pub">VL-BERT: Pre-training of Generic Visual-Linguistic Representations. Weijie Su, Xizhou Zhu, Yue Cao, Bin Li, Lewei Lu, Furu Wei, and Jifeng Dai. ICLR 2020. <a href="https://arxiv.org/abs/1908.08530" target="_blank">arXiv</a>. // <strong>VL-BERT</strong>: Vision + Language Pre-training</li>
	
	<li class="pub">Self-Adversarial Learning with Comparative Discrimination for Text Generation. Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei, and Ming Zhou. ICLR 2020. <a href="https://openreview.net/forum?id=B1l8L6EtDS" target="_blank">link</a>. </li>

	<li class="pub">Cross-Lingual Natural Language Generation via Pre-Training. Zewen Chi, Li Dong, Furu Wei, Wenhui Wang, Xian-Ling Mao, and Heyan Huang. Proc. AAAI 2020. <a href="https://arxiv.org/pdf/1909.10481.pdf" target="_blank">arXiv</a>. // XNLG </li>
	
	<li class="pub">Fact-aware Sentence Split and Rephrase with Permutation Invariant Training. Yinuo Guo, Tao Ge and Furu Wei. Proc. AAAI 2020.</li>
	
	<li class="pub">Visualizing and Understanding the Effectiveness of BERT. Yaru Hao, Li Dong, Furu Wei and Ke Xu. Proc. EMNLP 2019. <a href="https://arxiv.org/abs/1908.05620" target="_blank">arXiv</a>.</li>
	<li class="pub">Video Dialog via Progressive Inference and Cross-Transformer. Weike Jin, Zhou Zhao, Mao Gu, Jun Xiao, Furu Wei and Yueting Zhuang. Proc. EMNLP 2019. <a href="https://arxiv.org/abs/1908.05620" target="_blank">arXiv</a>.</li>
	
	<li class="pub">Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension. Hangbo Bao<sup>#</sup>, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Lei Cui, Songhao Piao and Ming Zhou. Proc. MRQA Workshop at EMNLP 2019. <a href="https://mrqa.github.io/assets/papers/3_Paper.pdf" target="_blank">link</a>.// <strong>nlnet</strong></li> 
	
	<li class="pub">Neural Melody Composition from Lyrics. Hangbo Bao<sup>#</sup>, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu<sup>#</sup>, Chuanqi Tan<sup>#</sup>, Songhao Piao, and Ming Zhou. <a href="https://arxiv.org/abs/1809.04318" target="_blank">arXiv</a>. Proc. NLPCC 2019.</li>
	<li class="pub">Document-based Question Answering Improves Query-focused Multi-Document Summarization. Weikang Li, Xingxing Zhang, Yunfang Wu, Furu Wei and Ming Zhou. Proc. NLPCC 2019.</li>
	
	<li class="pub">HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization. Xingxing Zhang, Furu Wei and Ming Zhou. Proc. ACL 2019.</li>
	<li class="pub">Learning to Ask Unanswerable Questions for Machine Reading Comprehension. Haichao Zhu, Li Dong, Furu Wei, Wenhui Wang, Bing Qin and Ting Liu. Proc. ACL 2019.</li>
	<li class="pub">Retrieval-Enhanced Adversarial Training for Neural Response Generation. Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei and Ting Liu. Proc. ACL 2019.</li>
	<li class="pub">BERT-based Lexical Substitution. Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei and Ming Zhou. Proc. ACL 2019.</li>
	<li class="pub">Automatic Grammatical Error Correction for Sequence-to-sequence Text Generation: An Empirical Study. Tao Ge, Xingxing Zhang, Furu Wei and Ming Zhou. Proc. ACL 2019.</li>
	
	<li class="pub">LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts. Shuming Ma, Lei Cui, Damai Dai, Furu Wei, and Xu Sun. AAAI 2019. <a href="https://arxiv.org/abs/1809.04938" target="_blank">arXiv</a>.</li>
	<li class="pub">Read + Verify: Machine Reading Comprehension with Unanswerable Questions. Minghao Hu<sup>#</sup>, Furu wei, Yuxing Peng, Zhen Huang, Nan Yang, and Ming Zhou. AAAI 2019. <a href="https://arxiv.org/abs/1808.05759" target="_blank">arXiv</a>. </li>
	<li class="pub">Dictionary-Guided Editing Networks for Paraphrase Generation. Shaohan Huang, Yu Wu<sup>#</sup>, Furu Wei, and Ming Zhou. AAAI 2019. <a href="https://arxiv.org/abs/1806.08077" target="_blank">arXiv</a>.</li>
	<li class="pub">Response Generation by Context-aware Prototype Editing. Yu Wu<sup>#</sup>, Furu Wei, Shaohan Huang, Zhoujun Li, and Ming Zhou. AAAI 2019. <a href="https://arxiv.org/abs/1806.07042" target="_blank">arXiv</a>.</li>

	<li class="pub">Tao Ge, Furu Wei and Ming Zhou. Fluency Boost Learning and Inference for Neural Grammatical Error Correction. Proc. ACL 2018. Check out the <a href="https://arxiv.org/abs/1807.01270" target="_blank">technical report</a>.</li>
	<li class="pub">Qingyu Zhou<sup>#</sup>, Nan Yang, Furu Wei, Shaohan Huang, Ming Zhou and Tiejun Zhao. Neural Document Summarization by Jointly Learning to Score and Select Sentences. Proc. ACL 2018. <a href="https://arxiv.org/abs/1807.01270" target="_blank"></a>.</li> 
	<li class="pub">Ziqiang Cao, Wenjie Li, Sujian Li and Furu Wei. Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization. Proc. ACL 2018.</li>
	<li class="pub">Lei Cui, Furu Wei and Ming Zhou. Neural Open Information Extraction. Proc. ACL 2018.</li>
	<li class="pub">Hongyuan Zhu, Qi Liu, Nicholas Jing Yuan, Chuan Qin, Jiawei Li, Kun Zhang, Guang Zhou, Furu Wei, Yuanchun Xu, and Enhong Chen. XiaoIce Band: A Melody and Arrangement Generation Framework for Pop Music. Proc. KDD 2018. // <font color="red"> <strong>Best Student Paper</strong> </font></li>
	
	<li class="pub">Minghao Hu<sup>#</sup>, Yuxing Peng, Furu Wei, Zhen Huang, Dongsheng Li, Nan Yang, and Ming Zhou. Attention-Guided Answer Distillation for Machine Reading Comprehension. Proc. EMNLP 2018.</li>
	<li class="pub">Xingxing Zhang, Mirella Lapata, Furu Wei and Ming Zhou. Neural Latent Extractive Document Summarization. Proc. EMNLP 2018.</li>
	<li class="pub">Tao Ge, Qing Dou, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei and Ming Zhou. Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition. Proc. EMNLP 2018.</li>
	<li class="pub">Chuanqi Tan<sup>#</sup>, Furu Wei, Qingyu Zhou<sup>#</sup>, Nan Yang, Weifeng Lv, and Ming Zhou. I Know There Is No Answer: Modeling Answer Validation for Machine Reading Comprehension. Proc. NLPCC2018. // accepted by EMNLP 2018 and withdrawn</li>
	
	<li class="pub">Chuanqi Tan<sup>#</sup>, Furu Wei, Wenhui Wang, Nan Yang, Weifeng Lv, and Ming Zhou. Multiway Attention Networks for Modeling Sentence Pairs. Proc. IJCAI 2018.</li>
	<li class="pub">Chaoqun Duan, Lei Cui, Xinchi Chen<sup>#</sup>, Furu Wei, Conghui Zhu, Tiejun Zhao, and Ming Zhou. Attention-Fused Deep Matching Network for Natural Language Inference. Proc. IJCAI 2018.</li>
	<li class="pub">Minghao Hu<sup>#</sup>, Yuxing Peng, Zhen Huang, Xipeng Qiu, Furu Wei, and Ming Zhou. Reinforced Mnemonic Reader for Machine Reading Comprehension. Proc. IJCAI 2018.</li> 
	
	<li class="pub">Chuanqi Tan<sup>#</sup>, Furu Wei, Nan Yang, and Ming Zhou. S-Net: From Answer Extraction to Answer Synthesis for Machine Reading Comprehension. Proc. AAAI 2018. Check out the <a href="https://arxiv.org/pdf/1706.04815.pdf" target="_blank">technical report</a> of S-NET.</li>
	<li class="pub">Qingyu Zhou<sup>#</sup>, Nan Yang, Furu Wei, and Ming Zhou. Sequential Copying Networks. Proc. AAAI 2018.</li>
	<li class="pub">Ziqiang Cao<sup>#</sup>, Furu Wei, and Wenjie Li. Faithful to the Original: Fact Aware Neural Abstractive Summarization. Proc. AAAI 2018. // This paper introduces a new and interesting research problem for abstractive summarizaiton.</li> 
	<li class="pub">Haichao Zhu<sup>#</sup>, Furu Wei, Bing Qin, and Ting Liu. Hierarchical Attention Flow for Multiple-choice Reading Comprehension. Proc. AAAI 2018.</li>
	<li class="pub">Chuanqi Tan<sup>#</sup>, Furu Wei, Pengjie Ren<sup>#</sup>, Weifeng Lv and Ming Zhou. Entity Linking for Queries by Searching Wikipedia Sentences. Proc. EMNLP 2017.</li>
	<li class="pub">Wenhui Wang<sup>#</sup>, Nan Yang, Furu Wei, Baobao Chang and Ming Zhou. Gated Self-Matching Networks for Reading Comprehension and Question Answering. Proc. ACL 2017. Check out the <a href="https://www.microsoft.com/en-us/research/publication/mrc/" target="_blank">technical report</a> of R-NET.</li>
	<li class="pub">Qingyu Zhou<sup>#</sup>, Nan Yang, Furu Wei and Ming Zhou. Selective Encoding for Abstractive Sentence Summarization. Proc. ACL 2017.</li>
	<li class="pub">Lei Cui, Shaohan Huang<sup>#</sup>, Furu Wei, Chuanqi Tan<sup>#</sup>, Chaoqun Duan and Ming Zhou. SuperAgent: A Customer Service Chatbot for E-commerce Websites. Proc. ACL 2017 (demo).</li>
	<li class="pub">Qingyu Zhou<sup>#</sup>, Nan Yang, Furu Wei, Chuanqi Tan<sup>#</sup>, Hangbo Bao<sup>#</sup>, and Ming Zhou. Neural Question Generation from Text: A Preliminary Study. Proc. NLPCC 2018</li>
	<li class="pub">Pengjie Ren, Zhumin Chen, Zhaochun Ren, Furu Wei, Jun Ma and Maarten de Rijke. Leveraging Contextual Sentence Relations for Extractive Summarization Using a Neural Attention Model. Proc. SIGIR	 2017.</li>
	<li class="pub">Li Dong<sup>#</sup>, Shaohan Huang<sup>#</sup>, Furu Wei, Mirella Lapata, Ming Zhou and Ke Xu. Learning to Generate Product Reviews with Neural Attention. Proc. EACL 2017.</li>
	<li class="pub">Ziqiang Cao, Wenjie Li, Sujian Li and Furu Wei. Improving Multi-Document Summarization via Text Classification. Proc. AAAI 2017.</li>
	<li class="pub">Ziqiang Cao, Wenjie Li, Sujian Li, Furu Wei, Yanran Li. Joint Learning of Focusing and Summarization with Neural Attention. Proc. COLING 2016.</li>
	<li class="pub">Ziqiang Cao, Chengyao Chen, Wenjie Li, Sujian Li, Furu Wei, Ming Zhou. Build Tweet Guided Multi-Document Summarization Dataset. Proc. AAAI 2016.</li>
	<li class="pub">Pengjie Ren<sup>#</sup>, Furu Wei, Zhumin Chen, Jun Ma and Ming Zhou. A Redundancy-Aware Sentence Regression Framework for Extractive Summarization. Proc. COLING 2016.</li>
	<li class="pub">Chuanqi Tan<sup>#</sup>, Furu Wei, Li Dong, Weifeng Lv and Ming Zhou. Solving and Generating Chinese Character Riddles. Proc. EMNLP 2016.</li>
	<li class="pub">Yichun Yin<sup>#</sup>, Furu Wei, Li Dong, Kaimeng Xu, Ming Zhang and Ming Zhou. Unsupervised Word and Dependency Path Embeddings for Aspect Term Extraction. Proc. IJCAI 2016.</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Ming Zhou and Ke Xu. Question Answering over Freebase with Multi-Column Convolutional Neural Networks. Proc. ACL 2015.</li>
	<li class="pub">Ziqiang Cao<sup>#</sup>, Furu Wei, Ming Zhou, Sujian Li, Wenjie Li and Ming Zhou. Learning Summary Prior in Extractive Summarization. Proc. ACL 2015 (short paper).</li>
	<li class="pub">Yang Liu<sup>#</sup>, Furu Wei, Sujian Li, Heng Ji and Ming Zhou. A Dependency-Based Neural Network for Relation Classification. Proc. ACL 2015 (short paper).</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Hong Sun<sup>#</sup>, Ming Zhou and Ke Xu. A Hybrid Neural Model for Type Classification of Entity Mentions. Proc. IJCAI 2015.</li>
	<li class="pub">Ziqiang Cao<sup>#</sup>, Furu Wei, Li Dong<sup>#</sup>, Sujian Li and Ming Zhou. Ranking with Recursive Neural Networks and Its Application to Multi-document Summarization. Proc. AAAI 2015.</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Yichun Yin<sup>#</sup>, Ming Zhou and Ke Xu. Splusplus: A Feature-Rich Two-stage Classifier for Sentiment Analysis of Tweets. Proc. SemEval 2015.</li>
	<li class="pub">Zhou Zhao<sup>#</sup>, Furu Wei, Ming Zhou, Wilfred Ng. Cold-Start Expert Finding in Community Question Answering via Graph Regularization. Proc. DASFAA 2015.</li>
	<li class="pub">Hong Sun<sup>#</sup>, Furu Wei, and Ming Zhou. Answer Extraction with Multiple Extraction Engines for Web-Based Question Answering. Proc. NLPCC 2014.</li>
	<li class="pub">Duyu Tang<sup>#</sup>, Furu Wei, Bing Qin,&nbsp; Li Dong, Ting Liu, and Ming Zhou. A Joint Segmentation and Classification Framework for Sentiment Analysis. Proc. EMNLP 2014.</li>
	<li class="pub">Duyu Tang<sup>#</sup>, Furu Wei, Bing Qin, Ming Zhou and Ting Liu. Building Large-Scale Twitter-Specific Sentiment Lexicon: A Representation Learning Approach. Proc. COLING 2014.</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Ming Zhou, and Ke Xu. Adaptive Multi-Compositionality for Recursive Neural Models with Applications to Sentiment Analysis. Proc. AAAI 2014.</li>
	<li class="pub">Duyu Tang<sup>#</sup>, Furu Wei, Nan Yang, Ming Zhou, Bing Qin and Ting Liu. Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification. Proc. ACL 2014.</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Ming Zhou, Ke Xu, Duyu Tang<sup>#</sup> and Chuanqi Tan<sup>#</sup>. Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification. Proc.&nbsp;ACL 2014.</li>
	<li class="pub">Duyu Tang<sup>#</sup>, Furu Wei, Bing Qin, Ting Liu and Ming Zhou. Coooolll: A Deep Learning System for Twitter Sentiment Classification. Proc.&nbsp;SemEval 2014.</li>
	<li class="pub">Zhou Zhao<sup>#</sup>, James Cheng, Furu Wei, Ming Zhou, Wilfred Ng, and Yingjun Wu. SocialTransfer: Transferring Social Knowledge for Cold-Start Crowdsourcing. Proc. CIKM 2014.</li>
	<li class="pub">Zhou Zhao<sup>#</sup>, Furu Wei, Ming Zhou, and Wilfred Ng. Crowd-Selection Query Processing in Crowdsourcing Databases: A Task-Driven Approach. Proc. EDBT 2014.</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Yajuan Duan<sup>#</sup>, Xiaohua Liu, Ming Zhou and Ke Xu. The Automated Acquisition of Suggestions from Tweets. Proc. AAAI 2013.</li>
	<li class="pub">Dehong Gao<sup>#</sup>, Furu Wei, Wenjie Li, Xiaohua Liu and Ming Zhou. Co-training Based Bilingual Sentiment Lexicon Learning. Proc. AAAI 2013 (late-breaking paper).</li>
	<li class="pub">Xiaohua Liu, Yitong Li, HaochengWu, Ming Zhou, Furu Wei, and Yi Lu. Entity Linking for Tweets. Proc. ACL 2013.</li>
	<li class="pub">Yajuan Duan<sup>#</sup>, Zhumin Chen, Furu Wei, Ming Zhou, and Heung-Yeung Shum. Twitter Topic Summarization by Ranking Tweets Using Social Influence and Content Quality. Proc. COLING 2012. </li>
	<li class="pub">Xinfan Meng<sup>#</sup>, Furu Wei, Ge Xu, Xiaohua Liu, Ming Zhou and Houfeng Wang. Lost in Translations? Building Sentiment Lexicons using Context Based Machine translation. Proc. COLING 2012.</li>
	<li class="pub">Xiaohua Liu, Yitong Li, Furu Wei, and Ming Zhou. Graph-based Multi-Tweet Summarization Using Social Signals. Proc. COLING 2012.</li>
	<li class="pub">Xinfan Meng<sup>#</sup>, Furu Wei, Xiaohua Liu, Ming Zhou, and Houfeng Wang. Entity-Centric Topic-Oriented Opinion Summarization in Twitter. Proc. KDD 2012.</li>
	<li class="pub">Xinfan Meng<sup>#</sup>, Furu Wei, Xiaohua Liu, Ming Zhou, Ge Xu, and Houfeng Wang. Cross-Lingual Mixture Model for Sentiment Classification. Proc. ACL 2012.</li>
	<li class="pub">Xiaohua Liu,<b>&nbsp;</b>Ming Zhou, Furu Wei, Zhongyang Fu, and Xiangyang Zhou. Joint Inference of Named Entity Recognition and Normalization for Tweets. Proc. ACL 2012. </li>
	<li class="pub">Xiaohua Liu, Furu Wei, and Ming Zhou. QuickView: NLP-based Tweet Search. Proc. ACL 2012 (System Demonstration).</li>
	<li class="pub">Yajuan Duan<sup>#</sup>,Furu Wei, Ming Zhou and Heung-Yeung Shum. Graph-based Collective Classification for Tweets. Proc. CIKM 2012.</li>
	<li class="pub">Xiaohua Liu, Zhongyang Fu, Xiangyang Zhou, Furu Wei, and Ming Zhou. Collective Nominal Semantic Role Labeling for Tweets. Proc. AAAI 2012.</li>
	<li class="pub">Xiaohua Liu, Xiangyang Zhou, Zhongyang Fu, Furu Wei, and Ming Zhou. Exacting Social Events for Tweets Using A Factor Graph. Proc. AAAI 2012.</li>
	<li class="pub">Mengdie Hu, Shixia Liu, Furu Wei, Yingcai Wu, John Stasko, and Kwan-Liu Ma. Breaking News on Twitter. Proc. CHI 2012.</li>
	<li class="pub">Xiaolong Wang<sup>#</sup>, Furu Wei, Xiaohua Liu, Ming Zhou, and Ming Zhang. Topic Sentiment Analysis in Twitter: A Graph-based Hashtag Sentiment Classification Approach, Proc. CIKM, 2011</li>
	<li class="pub">Xiaohua Liu, Shaodian Zhang, Furu Wei, and Ming Zhou. Recognizing Named Entities in Tweets, Proc. ACL, 2011</li>
	<li class="pub">Xiaohua Liu, Long Jiang, Furu Wei, Ming Zhou, and QuickView Team Microsoft. QuickView: advanced search of tweets. Proc. SIGIR (Demo paper), 2011</li>
	<li class="pub">Furu Wei, Shixia Liu, Yangqiu Song, Shimie Pan, Michelle X. Zhou, Weihong Qian, Lei Shi, Li Tan, Qiang Zhang. 2010. TIARA: A Visual Exploratory Text Analytic System. Proc. KDD, pp 153-162. </li>
	<li class="pub">Li Shi, Weihong Qian, Furu Wei, and Li Tan. 2010. VisWorks Network and Text Visual Analytics. Proc. VAST Challenge 2010 Award Entry, pp 269-270.</li>
	<li class="pub">Lei Shi, Furu Wei, Shixia Liu, Li Tan, Xiaoxiao Lian, and Zhou X Michelle. 2010. Understanding Text Corpora with Multiple Facets. Proc. VAST, pp 99-106.</li>
	<li class="pub">Yangqiu Song, Shimei Pan, Shixia Liu, Furu Wei, Michelle X. Zhou, and Weihong Qian. 2010. Constrained Co-clustering for Textual Documents. Proc. AAAI, pp 581-586.</li>
	<li class="pub">Furu Wei, Wenjie Li and Yanxiang He. 2009. Co-Feedback Ranking for Query-focused Summarization. Proc. ACL, pp 117-120.</li>
	<li class="pub">Furu Wei, Wenjie Li and Yanxiang He. 2009. iRANK: An Interactive Ranking Framework and Its Application in Query-Focused Summarization. Proc. CIKM, pp 1557-1560.</li>
	<li class="pub">Wei Wang, Furu Wei, Wenjie Li and Sujian Li. 2009. HyperSum: A Hypergraph Based Semi-Supervised Sentence Ranking for Query-Oriented Summarization. Proc. CIKM, 1855-1858.</li>
	<li class="pub">Furu Wei, Wenjie Li, Qin Lu, and Yanxiang He. 2008. Query-Sensitive Mutual Reinforcement Chain with Its Application in Query-Oriented Multi-Document Summarization. Proc. SIGIR, pp 283-290.</li>
	<li class="pub">Wenjie Li, Peng Zhang, Furu Wei, Yuexian Hou, and Qin Lu. 2008. A Novel Feature-based Approach to Chinese Entity Relation Extraction. Proc. ACL, pp 89-92.</li>
	<li class="pub">Wenjie Li, Furu Wei, Qin Lu, and Yanxiang He. 2008. PNR2: Ranking Sentence with Positive and Negative Reinforcement for Query-Oriented Update Summarization. Proc. COLING, pp 489-496.</li>
	<li class="pub">Furu Wei, Wenjie Li, Qin Lu, and Yanxiang He. 2008. A Cluster-Sensitive Graph Model for Query-Oriented Multi-document Summarization. Proc. ECIR, pp 446-453.</li>
	</ol>
	
	<h4>Journals</h4>
	<ol>
	<li class="pub">WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing. Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Furu Wei. IEEE Journal of Selected Topics in Signal Processing. <a href="https://arxiv.org/abs/2110.13900" target="_blank">arXiv</a> 2021. </li>
	<li class="pub">Transforming wikipedia into augmented data for query-focused summarization. Haichao Zhu, Li Dong, Furu Wei, Bing Qin, Ting Liu. IEEE/ACM Transactions on Audio, Speech and Language Processing. 2022.</li>
	
	<li class="pub">Qingyu Zhou<sup>#</sup>, Nan Yang, Furu Wei, Shaohan Huang, Ming Zhou, and Tiejun Zhao. A Joint Sentence Scoring and Selection Framework for Neural Extractive Document Summarization. IEEE/ACM Transactions on Audio, Speech and Language Processing. 2020.</li>
	<li class="pub">Pengjie Ren, Zhumin Chen, Zhaochun Ren, Furu Wei, Liqiang Nie, and Jun Ma. Sentence Relations for Extractive Summarization with Deep Neural Networks. ACM Transactions on Information Systems (TOIS). 2018.</li>
	<li class="pub">Chuanqi Tan<sup>#</sup>, Furu Wei, Nan Yang, Bowen Du, Weifeng Lv, and Ming Zhou. Context-Aware Answer Sentence Selection with Hierarchical Gated Recurrent Neural Networks. IEEE/ACM Transactions on Audio, Speech and Language Processing. 2018.</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Shujie Liu, Ming Zhou, Ke Xu. A Statistical Parsing Framework for Sentiment Classification. Computational Linguistics. 2015.</li>
	<li class="pub">Li Dong<sup>#</sup>, Furu Wei, Ke Xu, Shixia Liu, and Ming Zhou. Adaptive Multi-Compositionality for Recursive Neural Network Models. IEEE/ACM Transactions on Audio, Speech and Language Processing. 2015.</li>
	<li class="pub">Duyu Tang<sup>#</sup>, Furu Wei, Bing Qin, Nan Yang, Ting Liu and Ming Zhou. Sentiment Embeddings with Applications to Sentiment Analysis. IEEE Transactions on Knowledge and Data Engineering. 2015.</li>
	<li class="pub">Dehong Gao<sup>#</sup>, Furu Wei, Wenjie Li, and Ming Zhou. Cross-lingual Sentiment Lexicon Learning with Bilingual Word Graph Label Propagation. Computational Linguistics. 2014.</li>
	<li class="pub">Duyu Tang<sup>#</sup>, Bing Qin, Furu Wei, Li Dong, Ting Liu, Ming Zhou. A Joint Segmentation and Classification Framework for Sentence Level Sentiment Classification. IEEE/ACM Transactions on Audio, Speech and Language Processing. 2015.</li>
	<li class="pub">Yang Liu<sup>#</sup>, Sujian Li, Furu Wei, Heng Ji. Relation Classification via Modeling Augmented Dependency Paths. IEEE/ACM Transactions on Audio, Speech and Language Processing. 2015.</li>
	<li class="pub">Mengchen Liu, Shixia Liu, Xizhou Zhu, Qinying Liao, Furu Wei, Shimei Pan. An Uncertainty-Aware Approach for Exploratory Microblog Retrieval. IEEE Transactions on Visualization and Computer Graphics. 2015.</li>
	<li class="pub">Wei Wang, Sujian Li, Jiwei Li,&nbsp;Wenjie Li, Furu Wei. Exploring hypergraph-based semi-supervised ranking for query-oriented summarization. Information Sciences, 237: 271–286. 2013.</li>
	<li class="pub">Xiaohua Liu, Furu Wei, Shaodian Zhang, and Ming Zhou. Named Entity Recognition for Tweets. ACM Transactions on Intelligent Systems and Technology (TIST). 2012.</li>
	<li class="pub">Yangqiu Song, Shimei Pan, Shixia Liu, Furu Wei, Michelle X. Zhou, Weihong Qiang, Constrained Text Co-clustering with Supervised and Unsupervised Constraints. IEEE Transactions on Knowledge and Data Engineering. 2014</li>
	<li class="pub">Furu Wei, Wenjie Li, Qin Lu, and Yanxiang He. Applying Two-Level Mutual Reinforcement Ranking Algorithm in Query-Oriented Multi-document Summarization. Journal of the American Society for Information Science and Technology (JASIST), 60(9): 2119-2131. 2009.</li>
	<li class="pub">Furu Wei, Wenjie Li, and Shixia Liu. A Rank-Learn-Combine Framework for Unsupervised Ensemble Ranking. Journal of the American Society for Information Science and Technology (JASIST), 61(6): 1232 - 1243. 2010.</li>
	<li class="pub">Furu Wei, Wenjie Li, Qin Lu, and Yanxiang He. A Document-Sensitive Graph Model for Multi-Document Summarization. Knowledge and Information Systems (KAIS), 22(2): 245-259. 2010.</li>
	<li class="pub">Yingcai Wu, Furu Wei, Shixia Liu, Norman Au, Weiwei Cui, Hong Zhou and Huamin Qu. OpinionSeer: Interactive Visualization of Online Hotel Customer Feedback. IEEE Transactions on Visualization and Computer Graphics (TVCG), 16(6):1109 - 1118. 2010.</li>
	<li class="pub">Yingcai Wu, Thomas Provan, Furu Wei, Shixia Liu, and Kwan-Liu Ma. Semantic-Preserving Word Clouds by Seam Carving. Computer Graphics Forum: The International Journal of the Eurographics Association (Proc. EuroVis 2011), 30(3): 741-750. 2011.</li>
	<li class="pub">Weiwei Cui, Yingcai Wu, Shixia Liu, Furu Wei, Michelle X. Zhou. Context-preserving Dynamic Word Cloud Visualization. IEEE Computer Graphics and Applications (IEEE CG&amp;A), 30(6):42 - 53. 2010.</li>
	<li class="pub">Furu Wei, Wenjie Li, and Yanxiang He. 2011. Document-Aware Graph Models for Query-Oriented Multi-Document Summarization. Multimedia Analysis, Processing and Communication, Z. Li, J. Kacprzyk, D. Tao, W. Lin, E. Izquierdo, and H. Wang, Eds. Springer-Verlag, Vol. 346, pp 655-678. 2011.</li>
	</ol>
    </div>
    </div>
    
    <h3 style="padding-left:5%">Patents</h3>
	<div class="main">
	<ol>
	<li class="pub">GENERATION OF SLIDE FOR PRESENTATION. 2018.</li>
	<li class="pub">GENERATING DOCUMENT SUMMARY. 2018.</li>
	<li class="pub">AUTOMATICALLY PROVIDING INFORMATION IN AN APPLICATION. 2018</li>
	<li class="pub">METHOD AND APPARATUS OF DIGEST BROADCAST (AI News Podcast). 2018.</li>
	<li class="pub">AUTONOMOUS GENERATION OF MELODY. 2018.</li>
	<li class="pub">Customized Text Processing. 2018.</li>
	<li class="pub">Chat Conversation Based on Knowledge Base Specific to Object (Building Customer Support Agent from E-commerce Websites). 2017.</li>
	<li class="pub">Automatic Song Generation. 2017.</li>
	<li class="pub">Automatic Song Generation (Lyrics). 2017.</li>
	<li class="pub">Automatic Talkshow for News Reader. 2015.</li>
	<li class="pub">Auto-linking – automatically link comments to a sentence in a news article. 2015.</li>
	<li class="pub">Method and System for Comment-Centered News Reader. 2015.</li>
	<li class="pub">Learning-Based Processing of Natural Language Questions. 2012.</li>
	<li class="pub">Target Based Indexing of Micro-blog Content. 2011.</li>
    </ol>
    </div>

    <h3 style="padding-left:5%">Students</h3>
    <div class="main">
    <ul>
    <li class="pub">Haichao Zhu (PhD, HIT)</li>
    <li class="pub">Ruochen Xu (PhD, CMU -> Microsoft)</li>
    <li class="pub"><a href="http://shumingma.com/" target="_blank">Shuming Ma</a> (Master, PKU -> <strong>MSRA NLC Group</strong>)</li>
    <li class="pub"><a href="https://yizhong-wang.com/" target="_blank">Yizhong Wang</a> (Master, PKU -> PhD, UW)</li>
    <li class="pub">Yu Wu (PhD, Beihang University -> <strong>MSRA NLC Group</strong>)</li>
    <li class="pub"><a href="https://machenxiao.com/" target="_blank">Chenxiao Ma</a> (Undergraduate, Beihang University)</li>
    <li class="pub">Minghao Hu (PhD, NDU)</li>
    <li class="pub">Xinchi Chen (PhD, Fudan University)</li>
    <li class="pub">Wenhui Wang (Master, PKU -> <strong>MSRA NLC Group</strong>)</li>
    <li class="pub">Hangbo Bao (PhD, HIT & MSRA)</li>
    <li class="pub">Yikang Shen (Master, Beihang University -> PhD, Université de Montréal)</li>
	<li class="pub"><a href="http://ir.sdu.edu.cn/~pengjieren/index.html" target="_blank">Pengjie Ren</a> (PhD, Shandong University)</li>
    <li class="pub"><a href="https://res.qyzhou.me/" target="_blank">Qingyu Zhou</a> (PhD, HIT & MSRA Joint Program)</li>
    <li class="pub">Yunlong Ma (PhD, Dalian University of Technology)</li>
    <li class="pub"><a href="http://nlp-yang.github.io/" target="_blank">Yang Liu</a> (Master, PKU -> PhD, University of Edinburgh -> Microsoft)</li>
    <li class="pub">Yichun Yin (PhD, PKU -> Huawei)</li>
    <li class="pub">Lei Guo (PhD, Shandong University)</li>
    <li class="pub">Jin Hu (Master, PKU -> Google)</li>
    <li class="pub"><a href="http://www4.comp.polyu.edu.hk/~cszqcao/" target="_blank">Ziqiang Cao</a> (Master, PKU -> PhD, Hongkong Polyu): <span style="color:blue">Microsoft Fellowship 2016</span></li>
    <li class="pub">Shaohan Huang (Undergraduate & Master, Beihang University -> <strong>MSRA NLC Group</strong>)</li>
    <li class="pub">Ruyao Wu (designer)</li>
    <li class="pub"><a href="http://www.microsoft.com/en-us/research/people/dutang/" target="_blank">Duyu Tang</a> (PhD, HIT -> <strong>MSRA NLC Group</strong>): <span style="color:blue">Baidu Fellowship 2014</span></li>
    <li class="pub">Chuanqi Tan (Undergraduate -> PhD, Beihang University -> Alibaba DAMO Academy)</li>
    <li class="pub">Zhou Zhao (PhD, HKUST -> Associate Professor at Zhejiang University）</li>
    <li class="pub">Fengze Jiang (PhD, HUST)</li>
    <li class="pub">Xing Huang (Designer, Beihang University -> Master, PKU)</li>
    <li class="pub">Dehong Gao (PhD, Hongkong Polyu -> Alibaba)</li>
    <li class="pub">Lijuan Liu (Master, Peking University -> Microsoft Bing Search (STCA))</li>
    <li class="pub">Zuohui Tian (Master, HIT)</li>
    <li class="pub"><a href="http://dong.li/" target="_blank">Li Dong</a> (Undergraduate -> PhD, Beihang University & University of Edinburgh -> <strong>MSRA NLC Group</strong>): <span style="color:blue">Microsoft Fellowship 2015</span></li>
    <li class="pub">Yaming Sun (Master -> PhD, HIT)</li>
    <li class="pub">Hong Sun (PhD, TJU & MSRA -> Microsoft Bing Search (STCA))</li>
    <li class="pub">Yajuan Duan (PhD, USTC & MSRA -> Microsoft Bing Search (STCA))</li>
    <li class="pub">Xinfan Meng (PhD, Peking University -> Facebook)</li>
    <li class="pub">Xiaolong Wang (Peking University -> PhD, UIUC)</li>
    </ul>
    </div>
    
    <p></p>
    
  </body>
</html>