Statistical Feature Aided Intelligent Deep Learning Machine Translation in Internet of Things

Yidian Zhang, Lin Zhang, Ping Lan, Wenyong Li, Dan Yang, Zhiqiang Wu

Research output: Contribution to journalArticlepeer-review

Abstract

Internet of Things (IoT) networks have been widely deployed to achieve communication among machines and humans. Machine translation can enable human-machine interactions for IoT equipment. In this paper, we propose to combine the neural machine translation (NMT) and statistical machine translation (SMT) to improve translation precision. In our design, we propose a hybrid deep learning (DL) network that uses the statistical feature extracted from the words as the data set. Namely, we use the SMT model to score the generated words in each decoding step of the NMT model, instead of directly processing their outputs. These scores will be converted to the generation probability corresponding to words by classifiers and used for generating the output of the hybrid MT system. For the NMT, the DL network consists of the input layer, embedding layer, recurrent layer, hidden layer, and output layer. At the offline training stage, the NMT network is jointly trained with SMT models. Then at the online deployment stage, we load the fine-trained models and parameters to generate the outputs. Experimental results on French-to-English translation tasks show that the proposed scheme can take advantage of both NMT and SMT methods, thus higher translation precision could be achieved.
Original languageEnglish
Pages (from-to)325-333
Number of pages9
JournalMobile Networks and Applications
Volume28
Issue number1
DOIs
StatePublished - Feb 2023
Externally publishedYes

ASJC Scopus Subject Areas

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications

Keywords

  • Neural machine translation
  • Neural network
  • Statistical feature extraction
  • Statistical machine translation

Cite this