Statistical Feature Aided Intelligent Deep Learning Machine Translation in Internet of Things

Yidian Zhang, Lin Zhang, Ping Lan, Wenyong Li, Dan Yang, Zhiqiang Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Internet of Things (IoT) networks have been widely deployed to achieve communication among machines and humans. Machine translation can enable human-machine interactions for IoT equipment. In this paper, we propose to combine the neural machine translation (NMT) and statistical machine translation (SMT) to improve translation precision. In our design, we propose a hybrid deep learning (DL) network that uses the statistical feature extracted from the words as the data set. Namely, we use the SMT model to score the generated words in each decoding step of the NMT model, instead of directly processing their outputs. These scores will be converted to the generation probability corresponding to words by classifiers and used for generating the output of the hybrid MT system. For the NMT, the DL network consists of the input layer, embedding layer, recurrent layer, hidden layer, and output layer. At the offline training stage, the NMT network is jointly trained with SMT models. Then at the online deployment stage, we load the fine-trained models and parameters to generate the outputs. Experimental results on French-to-English translation tasks show that the proposed scheme can take advantage of both NMT and SMT methods, thus higher translation precision could be achieved.
Original languageEnglish
Title of host publicationIoT as a Service - 6th EAI International Conference, IoTaaS 2020, Proceedings
EditorsBo Li, Changle Li, Mao Yang, Zhongjiang Yan, Jie Zheng
PublisherSpringer Science and Business Media Deutschland GmbH
Pages247-260
Number of pages14
ISBN (Print)9783030675134
DOIs
StatePublished - 2021
Externally publishedYes
Event6th EAI International Conference on IoT as a Service, IoTaaS 2020 - Xi'an, China
Duration: Nov 19 2020Nov 20 2020

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Volume346
ISSN (Print)1867-8211
ISSN (Electronic)1867-822X

Conference

Conference6th EAI International Conference on IoT as a Service, IoTaaS 2020
Country/TerritoryChina
CityXi'an
Period11/19/2011/20/20

ASJC Scopus Subject Areas

  • Computer Networks and Communications

Keywords

  • Neural machine translation
  • Neural network
  • Statistical feature extraction
  • Statistical machine translation

Cite this