User profiles for Xiaodong Liu

Xiaodong Liu

Microsoft Research, Redmond
Verified email at microsoft.com
Cited by 17753

Climatic warming in the Tibetan Plateau during recent decades

X Liu, B Chen - International Journal of Climatology: A Journal …, 2000 - Wiley Online Library
Adequate knowledge of climatic change over the Tibetan Plateau (TP) with an average elevation
of more than 4000 m above sea level (asl) has been insufficient for a long time owing to …

On the variance of the adaptive learning rate and beyond

L Liu, H Jiang, P He, W Chen, X Liu, J Gao… - arXiv preprint arXiv …, 2019 - arxiv.org
The learning rate warmup heuristic achieves remarkable success in stabilizing training,
accelerating convergence and improving generalization for adaptive stochastic optimization …

Domain-specific language model pretraining for biomedical natural language processing

…, R Tinn, H Cheng, M Lucas, N Usuyama, X Liu… - ACM Transactions on …, 2021 - dl.acm.org
Pretraining large neural language models, such as BERT, has led to impressive gains on
many natural language processing (NLP) tasks. However, most pretraining efforts focus on …

Asynchronous Holocene optimum of the East Asian monsoon

…, JE Kutzbach, W Xihao, W Suming, L Xiaodong… - Quaternary Science …, 2000 - Elsevier
The spatial and temporal distribution of summer monsoon precipitation (or effective moisture)
during the Holocene has been reconstructed on the basis of geological data, including …

[HTML][HTML] Efficient genome editing in plants using a CRISPR/Cas system

Z Feng, B Zhang, W Ding, X Liu, DL Yang, P Wei… - Cell research, 2013 - nature.com
In the past few years, the development of sequencespecific DNA nucleases has progressed
rapidly and such nucleases have shown their power in generating efficient targeted …

Deberta: Decoding-enhanced bert with disentangled attention

P He, X Liu, J Gao, W Chen - arXiv preprint arXiv:2006.03654, 2020 - arxiv.org
Recent progress in pre-trained neural language models has significantly improved the
performance of many natural language processing (NLP) tasks. In this paper we propose a new …

Unified language model pre-training for natural language understanding and generation

…, N Yang, W Wang, F Wei, X Liu… - Advances in neural …, 2019 - proceedings.neurips.cc
This paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned
for both natural language understanding and generation tasks. The model is pre-trained …

Multi-task deep neural networks for natural language understanding

X Liu, P He, W Chen, J Gao - arXiv preprint arXiv:1901.11504, 2019 - arxiv.org
In this paper, we present a Multi-Task Deep Neural Network (MT-DNN) for learning
representations across multiple natural language understanding (NLU) tasks. MT-DNN not only …

[HTML][HTML] Interplay between the Westerlies and Asian monsoon recorded in Lake Qinghai sediments since 32 ka

…, W Liu, Z Jin, X Liu, P Cheng, Y Liu, L Ai, X Li, X Liu… - Scientific reports, 2012 - nature.com
Two atmospheric circulation systems, the mid-latitude Westerlies and the Asian summer
monsoon (ASM), play key roles in northern-hemisphere climatic changes. However, the …

Multigeneration analysis reveals the inheritance, specificity, and patterns of CRISPR/Cas-induced gene modifications in Arabidopsis

…, R Zheng, L Yang, L Zeng, X Liu… - Proceedings of the …, 2014 - National Acad Sciences
The CRISPR (clustered regularly interspaced short palindromic repeat)/Cas (CRISPR-associated)
system has emerged as a powerful tool for targeted gene editing in many organisms, …