Published January 1, 2018 | Version v1
Conference paper Open

A Trie-structured Bayesian Model for Unsupervised Morphological Segmentation

  • 1. Middle East Tech Univ ODTU, Informat Inst, Cognit Sci Dept, TR-06800 Ankara, Turkey
  • 2. Hacettepe Univ Beytepe, Dept Comp Engn, TR-06800 Ankara, Turkey

Description

In this paper, we introduce a trie-structured Bayesian model for unsupervised morphological segmentation. We adopt prior information from different sources in the model. We use neural word embeddings to discover words that are morphologically derived from each other and thereby that are semantically similar. We use letter successor variety counts obtained from tries that are built by neural word embeddings. Our results show that using different information sources such as neural word embeddings and letter successor variety as prior information improves morphological segmentation in a Bayesian model. Our model outperforms other unsupervised morphological segmentation models on Turkish and gives promising results on English and German for scarce resources.

Files

bib-4b43982e-6e8e-4a80-9c3d-eb6af8cc6b86.txt

Files (197 Bytes)

Name Size Download all
md5:b392c6989a4533717706a6e452a2ce08
197 Bytes Preview Download