A review of Khmer word segmentation and part-of-speech tagging and an experimental study using bidirectional long short-term memory

 0 Người đánh giá. Xếp hạng trung bình 0

Tác giả: Amrudee Sukpan Nguyen, Sry Sreyteav

Ngôn ngữ: eng

Ký hiệu phân loại:

Thông tin xuất bản: Ho Chi Minh City Open University Journal of Science: Engineering and Technology, 2022

Mô tả vật lý: tr.23-34

Bộ sưu tập: Metadata

ID: 334064

Large contiguous blocks of unsegmented Khmer words can cause major problems for natural language processing applications such as machine translation, speech synthesis, information extraction, etc. Thus, word segmentation and part-of- speech tagging are two important prior tasks. Since the Khmer language does not always use explicit separators to split words, the definition of words is not a natural concept. Hence, tokenization and part-of-speech tagging of these languages are inseparable because the definition and principle of one task unavoidably affect the other. In this study, different approaches using in Khmer word segmentation and part-of-speech are reviewed and experimental study using a single long short-term memory network is described. Dataset from Asia Language Treebank is used to train and test the model. The preliminary experimental model achieved 95% accuracy rate. However, more testing to evaluate the model and compare it with different models is needed to conduct to select the more higher accuracy model.
Tạo bộ sưu tập với mã QR

THƯ VIỆN - TRƯỜNG ĐẠI HỌC CÔNG NGHỆ TP.HCM

ĐT: (028) 36225755 | Email: tt.thuvien@hutech.edu.vn

Copyright @2024 THƯ VIỆN HUTECH