TY - GEN
T1 - Statistical Feature Aided Intelligent Deep Learning Machine Translation in Internet of Things
AU - Zhang, Yidian
AU - Zhang, Lin
AU - Lan, Ping
AU - Li, Wenyong
AU - Yang, Dan
AU - Wu, Zhiqiang
N1 - Publisher Copyright:
© 2021, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
PY - 2021
Y1 - 2021
N2 - Internet of Things (IoT) networks have been widely deployed to achieve communication among machines and humans. Machine translation can enable human-machine interactions for IoT equipment. In this paper, we propose to combine the neural machine translation (NMT) and statistical machine translation (SMT) to improve translation precision. In our design, we propose a hybrid deep learning (DL) network that uses the statistical feature extracted from the words as the data set. Namely, we use the SMT model to score the generated words in each decoding step of the NMT model, instead of directly processing their outputs. These scores will be converted to the generation probability corresponding to words by classifiers and used for generating the output of the hybrid MT system. For the NMT, the DL network consists of the input layer, embedding layer, recurrent layer, hidden layer, and output layer. At the offline training stage, the NMT network is jointly trained with SMT models. Then at the online deployment stage, we load the fine-trained models and parameters to generate the outputs. Experimental results on French-to-English translation tasks show that the proposed scheme can take advantage of both NMT and SMT methods, thus higher translation precision could be achieved.
AB - Internet of Things (IoT) networks have been widely deployed to achieve communication among machines and humans. Machine translation can enable human-machine interactions for IoT equipment. In this paper, we propose to combine the neural machine translation (NMT) and statistical machine translation (SMT) to improve translation precision. In our design, we propose a hybrid deep learning (DL) network that uses the statistical feature extracted from the words as the data set. Namely, we use the SMT model to score the generated words in each decoding step of the NMT model, instead of directly processing their outputs. These scores will be converted to the generation probability corresponding to words by classifiers and used for generating the output of the hybrid MT system. For the NMT, the DL network consists of the input layer, embedding layer, recurrent layer, hidden layer, and output layer. At the offline training stage, the NMT network is jointly trained with SMT models. Then at the online deployment stage, we load the fine-trained models and parameters to generate the outputs. Experimental results on French-to-English translation tasks show that the proposed scheme can take advantage of both NMT and SMT methods, thus higher translation precision could be achieved.
KW - Neural machine translation
KW - Neural network
KW - Statistical feature extraction
KW - Statistical machine translation
UR - https://www.scopus.com/pages/publications/85101362496
UR - https://www.scopus.com/inward/citedby.url?scp=85101362496&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-67514-1_20
DO - 10.1007/978-3-030-67514-1_20
M3 - Conference contribution
AN - SCOPUS:85101362496
SN - 9783030675134
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 247
EP - 260
BT - IoT as a Service - 6th EAI International Conference, IoTaaS 2020, Proceedings
A2 - Li, Bo
A2 - Li, Changle
A2 - Yang, Mao
A2 - Yan, Zhongjiang
A2 - Zheng, Jie
PB - Springer Science and Business Media Deutschland GmbH
T2 - 6th EAI International Conference on IoT as a Service, IoTaaS 2020
Y2 - 19 November 2020 through 20 November 2020
ER -