Generation of Bilingual Dictionaries using Structural Properties

Abstract. Building bilingual dictionaries from Wikipedia has been extensively studied in the area of computation linguistics. These dictionaries play a crucial role in Natural Language Processing(NLP) applications like Cross-Lingual Information Retrieval, Machine Translation and Named Entity Recogni...

Descripción completa

Detalles Bibliográficos
Autores: Dubey, Ajay, Varma, Vasudeva
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2013
País:México
Institución:Instituto Politécnico Nacional
Repositorio:Repositorio Digital del IPN
OAI Identifier:oai:www.repositoriodigital.ipn.mx:123456789/16613
Acceso en línea:http://www.repositoriodigital.ipn.mx/handle/123456789/16613
Access Level:acceso abierto
Palabra clave:Keywords. Bilingual dictionary, comparable corpora, structural elements.
id MX_2ed2d5e7bf4babfbaf1d0b5797f87d2f
oai_identifier_str oai:www.repositoriodigital.ipn.mx:123456789/16613
network_acronym_str MX
network_name_str México
repository_id_str
spelling Generation of Bilingual Dictionaries using Structural PropertiesGeneración de diccionarios bilingües usando las propiedades estructuralesDubey, AjayVarma, VasudevaKeywords. Bilingual dictionary, comparable corpora, structural elements.Abstract. Building bilingual dictionaries from Wikipedia has been extensively studied in the area of computation linguistics. These dictionaries play a crucial role in Natural Language Processing(NLP) applications like Cross-Lingual Information Retrieval, Machine Translation and Named Entity Recognition. To build these dictionaries, most of the existing approaches use information present in Wikipedia titles, info-boxes and categories. Interestingly, not many use the structural properties of a document like sections, subsections, etc. In this work we exploit the structural properties of documents to build a bilingual English-Hindi dictionary. The main intuition behind this approach is that documents in different languages discussing the same topic are likely to have similar structural elements. Though we present our experiments only for Hindi, our approach is language independent and can be easily extended to other languages. The major contribution of our work is that the dictionary contains translation and transliteration of words which include Named Entities to a large extent. We evaluate our dictionary using manually computed precision. We generated a massive list of 72k tokens using our approach with 0.75 precision.Instituto Politécnico Nacional - Centro de Investigación en Computación (CIC).Investigación en ComputaciónPDFRevista Computación y Sistemas; Vol. 17 No.22013-08-06T17:28:03Z2013-08-06T17:28:03Z2013-06-07info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleRevista Computación y Sistemas; Vol. 17 No.21405-5546http://www.repositoriodigital.ipn.mx/handle/123456789/16613reponame:Repositorio Digital del IPNinstname:Instituto Politécnico Nacionalinstacron:IPNen_USRevista Computación y Sistemas;Vol. 17 No.2info:eu-repo/semantics/openAccessoai:www.repositoriodigital.ipn.mx:123456789/166132026-02-18T16:45:26Z
dc.title.none.fl_str_mv Generation of Bilingual Dictionaries using Structural Properties
Generación de diccionarios bilingües usando las propiedades estructurales
title Generation of Bilingual Dictionaries using Structural Properties
spellingShingle Generation of Bilingual Dictionaries using Structural Properties
Dubey, Ajay
Keywords. Bilingual dictionary, comparable corpora, structural elements.
title_short Generation of Bilingual Dictionaries using Structural Properties
title_full Generation of Bilingual Dictionaries using Structural Properties
title_fullStr Generation of Bilingual Dictionaries using Structural Properties
title_full_unstemmed Generation of Bilingual Dictionaries using Structural Properties
title_sort Generation of Bilingual Dictionaries using Structural Properties
dc.creator.none.fl_str_mv Dubey, Ajay
Varma, Vasudeva
author Dubey, Ajay
author_facet Dubey, Ajay
Varma, Vasudeva
author_role author
author2 Varma, Vasudeva
author2_role author
dc.subject.none.fl_str_mv Keywords. Bilingual dictionary, comparable corpora, structural elements.
topic Keywords. Bilingual dictionary, comparable corpora, structural elements.
description Abstract. Building bilingual dictionaries from Wikipedia has been extensively studied in the area of computation linguistics. These dictionaries play a crucial role in Natural Language Processing(NLP) applications like Cross-Lingual Information Retrieval, Machine Translation and Named Entity Recognition. To build these dictionaries, most of the existing approaches use information present in Wikipedia titles, info-boxes and categories. Interestingly, not many use the structural properties of a document like sections, subsections, etc. In this work we exploit the structural properties of documents to build a bilingual English-Hindi dictionary. The main intuition behind this approach is that documents in different languages discussing the same topic are likely to have similar structural elements. Though we present our experiments only for Hindi, our approach is language independent and can be easily extended to other languages. The major contribution of our work is that the dictionary contains translation and transliteration of words which include Named Entities to a large extent. We evaluate our dictionary using manually computed precision. We generated a massive list of 72k tokens using our approach with 0.75 precision.
publishDate 2013
dc.date.none.fl_str_mv 2013-08-06T17:28:03Z
2013-08-06T17:28:03Z
2013-06-07
dc.type.none.fl_str_mv info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv Revista Computación y Sistemas; Vol. 17 No.2
1405-5546
http://www.repositoriodigital.ipn.mx/handle/123456789/16613
identifier_str_mv Revista Computación y Sistemas; Vol. 17 No.2
1405-5546
url http://www.repositoriodigital.ipn.mx/handle/123456789/16613
dc.language.none.fl_str_mv en_US
language_invalid_str_mv en_US
dc.relation.none.fl_str_mv Revista Computación y Sistemas;Vol. 17 No.2
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Revista Computación y Sistemas; Vol. 17 No.2
publisher.none.fl_str_mv Revista Computación y Sistemas; Vol. 17 No.2
dc.source.none.fl_str_mv reponame:Repositorio Digital del IPN
instname:Instituto Politécnico Nacional
instacron:IPN
instname_str Instituto Politécnico Nacional
instacron_str IPN
institution IPN
reponame_str Repositorio Digital del IPN
collection Repositorio Digital del IPN
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1858174805293924352
score 15.812429

Similares en LA Referencia