Littera Deusto

Modern Languages, Basque Studies and Humanities

Framework for Machine Translation Evaluation in ISLE (FEMTI)

mayo 23rd, 2008 · No hay Comentarios

The principal goal of FEMTI is to relate the different methods that are used to evaluate Machine Translation systems to the purpose and context of those systems. Therefore, we can find the MT Evaluation Glossary in the FEMTI website, that constitutes a series of guidelines that are the outcome of an international effort on evaluation of Machine Translation and other Natural Language Processing Applications, that was mainly funded through the ISLE Project by the US Government National Science Foundation and the Swiss and Danish Governments.

As requested in Questionnaire 3 of the Human Language Technologies course, I will focus on the part of the MT Evaluation Glossary that explains the Characteristics of the translation task, according to the FEMTI report. There are three characteristics, which have several subcategories.    

1. Assimilation:  

The ultimate purpose of the assimilation task (of which translation forms a part) is to monitor a (relatively) large volume of texts produced by people outside the organization, in (usually) several languages. It´s subcategories are document routing / sorting, information extraction / summarization and search

2. Dissemination:  

The ultimate purpose of dissemination is to deliver to others a translation of documents produced inside the organization. It´s main subcategories are; internal / in-house dissemination and external pubication

3. Communication:

The ultimate purpose of the communication task is to support multi-turn dialogues between people who speak different languages. The translation quality must be high enough for painless conversation, despite possible syntactically ill-formed input and idiosyncratic word and format usage. The ultimate purpose of dissemination is to deliver to others a translation of documents produced inside the organization. It´s subcategories are synchronous or interactive communication and asynchronous or delayed communication

 

http://www.isi.edu/natural-language/mteval/framed-glossary.html

Etiquetas:

  • Etiquetas