Statistical Malay dependency parser for knowledge acquisition based on word dependency relation

Hassan Mohamed, Nazlia Omar, Mohd Juzaidin Ab Aziz, Suhaimi Ab Rahman

Research output: Contribution to journalConference article

Abstract

One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.

Original languageEnglish
Pages (from-to)188-193
Number of pages6
JournalProcedia - Social and Behavioral Sciences
Volume27
DOIs
Publication statusPublished - 22 Dec 2011
EventConference on Pacific Association for Computational Linguistics, PACLING 2011 - Kuala Lumpur, Malaysia
Duration: 19 Jul 201121 Jul 2011

Fingerprint

knowledge acquisition
grammar
Language
Natural Language Processing
Automatic Data Processing
Semantics
language
information processing
semantics
Values

All Science Journal Classification (ASJC) codes

  • Social Sciences(all)
  • Psychology(all)

Cite this

@article{4faf91793b1f49fd9a12daa174bd6ad3,
title = "Statistical Malay dependency parser for knowledge acquisition based on word dependency relation",
abstract = "One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.",
author = "Hassan Mohamed and Nazlia Omar and Aziz, {Mohd Juzaidin Ab} and {Ab Rahman}, Suhaimi",
year = "2011",
month = "12",
day = "22",
doi = "10.1016/j.sbspro.2011.10.597",
language = "English",
volume = "27",
pages = "188--193",
journal = "Procedia - Social and Behavioral Sciences",
issn = "1877-0428",
publisher = "Elsevier BV",

}

Statistical Malay dependency parser for knowledge acquisition based on word dependency relation. / Mohamed, Hassan; Omar, Nazlia; Aziz, Mohd Juzaidin Ab; Ab Rahman, Suhaimi.

In: Procedia - Social and Behavioral Sciences, Vol. 27, 22.12.2011, p. 188-193.

Research output: Contribution to journalConference article

TY - JOUR

T1 - Statistical Malay dependency parser for knowledge acquisition based on word dependency relation

AU - Mohamed, Hassan

AU - Omar, Nazlia

AU - Aziz, Mohd Juzaidin Ab

AU - Ab Rahman, Suhaimi

PY - 2011/12/22

Y1 - 2011/12/22

N2 - One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.

AB - One of the common problems faced when processing information gathered from any natural language is the 'semantic gap' where the 'meaning' of the sentences is not exactly extracted. In Malay Natural Language Processing (NLP), as our knowledge, there is no existing Malay Parser that can be used to develop a knowledge acquisition feature to extract 'meaning' from Malay articles based-on syntactic relations. This relation is basically the relation between a word and its dependents. This paper will examine the Dependency Grammar (DG) for developing Malay Grammar Parser and discuss the possibilities of developing probabilistic dependency Malay parser using the projected syntactic relation from annotated English corpus. The English side of a parallel corpus, project the analysis to the second language (Malay). Thus, the rules for adaptation from English DG to Malay DG will be defined. The projected tree structure in Malay will be used in training a stochastic analyzer. The training will produce a set of tree lattices which contains chunks of dependency trees for Malay attached with their probability value. A decoder will be developed to test the lattices. A DG for a new Malay sentence is built by combining the pre-determined lattices according to their plausible highest probability of combination.

UR - http://www.scopus.com/inward/record.url?scp=83755171540&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=83755171540&partnerID=8YFLogxK

U2 - 10.1016/j.sbspro.2011.10.597

DO - 10.1016/j.sbspro.2011.10.597

M3 - Conference article

AN - SCOPUS:83755171540

VL - 27

SP - 188

EP - 193

JO - Procedia - Social and Behavioral Sciences

JF - Procedia - Social and Behavioral Sciences

SN - 1877-0428

ER -