Sigit Purnomo

Sigit Purnomo

Senior Lecturer at Informatics Department, Universitas Atma Jaya Yogyakarta

Collections of Github Repository in Python for Machine Translation

less than 1 minute read

I have tried to collect and curate some Python-based Github repository linked to the machine translation task, and the results were listed here. Please enjoy it to support your research about developing machine translation model using Python!

Last updated: July 25, 2020
Source : Github

No. Year Title Github
1 2019 subword-nmt - Unsupervised Word Segmentation for Neural Machine Translation and Text Generation View
2 2018 monoses - Unsupervised Statistical Machine Translation View
3 2018 UnsupervisedMT - Phrase-Based & Neural Unsupervised Machine Translation View
4 2018 nmt-keras - Neural Machine Translation with Keras (Theano/Tensorflow) View
5 2018 undreamt - Unsupervised Neural Machine Translation View
6 2017 nmtpytorch - Neural Machine Translation Framework in PyTorch View
7 2017 seq2seq - Minimal Seq2Seq model with Attention for Neural Machine Translation in PyTorch View
8 2017 OpenNMT-tf - Open Source Neural Machine Translation in TensorFlow View
9 2017 nmt - TensorFlow Neural Machine Translation Tutorial View
10 2017 sockeye - Sequence-to-sequence framework with MXNet with a focus on Neural Machine Translation View
11 2017 bytenet_translation - A TensorFlow Implementation of Machine Translation In Neural Machine Tra View
12 2017 OpenNMT-py - Open-Source Neural Machine Translation in PyTorch View

You may also enjoy

Extraction and attribution of public figures statements for journalism in Indonesia using deep learning

2 minute read

Published:

News articles are usually written by journalists based on statements taken from interviews with public figures. Attribution from such statements provides important information and it can be extracted from news articles to build a knowledge base by developing a sequential tagging scheme such as entity recognition. This research applies two deep learning architectures: recurrent neural networks-based and transformer-based, to establish public figures statement attribution and extraction models in the Indonesian Language. The experiments are conducted using five deep-learning model architectures with two different corpus sizes to investigate the impact of corpus size on each model’s performance. The experiments show that the best model for the RNN-based architecture is PFSA-ID-BLWCA which achieves 81.34 % F1 score, and the best model for the transformer-based is PFSA-ID-TWCA which obtains 81.01 % F1 score. This research also discovers that the size of the corpus influences the model performances. Furthermore, the study lays a foundation to overcome the attribution extraction in another language, especially low-resource languages, with some necessary adjustments.

PFSA-ID: An Annotated Indonesian Corpus and Baseline Model of Public Figures Statements Attributions

2 minute read

Published:

By far, the corpus for the quotation extraction and quotation attribution tasks in Indonesian is still limited in quantity and depth. This study aims to develop an Indonesian corpus of public figure statements attributions and a baseline model for attribution extraction, so it will contribute to fostering research in information extraction for the Indonesian language.

Understanding quotation extraction and attribution: towards automatic extraction of public figure’s statements for journalism in Indonesia

3 minute read

Published:

Extracting information from unstructured data becomes a challenging task for computational linguistics. Public figure’s statement attributed by journalists in a story is one type of information that can be processed into structured data. Therefore, having the knowledge base about this data will be very beneficial for further use, such as for opinion mining, claim detection and fact-checking. This study aims to understand statement extraction tasks and the models that have already been applied to formulate a framework for further study.

Research about Named Entity Recognition Published in ArXiv

2 minute read

Published:

Named Entity Recognition (NER) is a task in Information Extraction consisting in identifying and classifying just some types of information elements, called Named Entities (NE). I have tried to collect and curate some publications form Arxiv that related to NER, and the results were listed here. Please enjoy it!