神经机器翻译前沿进展专题讲座.pptx

神经机器翻译前沿进展;机器翻译;发展历史;数据驱动的机器翻译;统计机器翻译;基于短语的统计机器翻译;统计机器翻译的优缺点;难点：长距离调序;统计机器翻译示例;深度学习带来新思路;机器翻译方法对比;神经机器翻译;编码器-解码器框架;递归神经网络的优缺点;长短时记忆;神经网络学到了什么？;编码器-解码器架构的优缺点;基于注意力的神经机器翻译;注意力;神经机器翻译中的注意力;注意力机制提升长句翻译效果;注意力机制的其他应用;近期研究进展;进展1：受限词汇量;进展2：细粒度意义单元;进展3：先验约束;进展4：记忆机制;进展5：训练准则;进展6：单语数据利用;进展7：多语言;进展8：多模态;神经机器翻译教程和开源工具;统计机器翻译 Vs 神经机器翻译;神经机器翻译面临的挑战;总结;谢谢！;Franz Och and Hermann Ney. 2002. Discriminative Training and Maximum Entropy Models for Statistical Machine Translation. In Proceedings of ACL. Philipp Koehn, Franz Och, and Daniel Marcu. 2003. Statistical Phrase-based Translation. In Proceedings of NAACL. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to Sequence Learning with Neural Networks. In Proceedings of NIPS. Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the Difficulty of Training Recurrent Neural Networks. In Proceedings of ICML. Sepp Hochreiter and Jurgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computation. ;Dzmitry Bahdanau, KyungHyun Cho, and Yoshua Bengio. 2015. Neural Machine Translation by Jointly Learning to Align and Translate. In Proceedings of ICLR. Jianpeng Cheng, Li Dong, and Mirella Lapata. 2016a. Long Short-Term Memory-Networks for Machine Reading. In Proceedings of EMNLP. Yong Cheng, Shiqi Shen, Zhongjun He, Wei He, Hua Wu, Maosong Sun, and Yang Liu. 2016b. Agreement-based Joint Training for Bidirectional Attention-based Neural Machine Translation. In Proceedings of IJCAI. Kelvin Xu, Jimmy Lei Ba, Ryan Jiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhutdinov, Richard Zemel, and Yoshua Bengio. 2015. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. In Proceedings of ICML. Minh-Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, and Wojciech Zaremba. 2015a. Addressing the Rare Word Problem in Neural Machine Translation. In Proceedings of ACL.;Sebastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. 2015. On Using Very Large Target Vocabulary for Neural Machine Translation.