博文
句对齐、词对齐相关资源列表
|
由Rada Mihalcea维护。
Sentence Alignment and Word Alignment: Projects, Papers, Evaluation, etc.
Your help in filling in the gaps in this resource page will be much appreciated. Add missing resources using this online form.
- Alignment Projects
- Parallel Texts. Data for Word Alignment
- Guidelines for Word Alignment
- Guidelines for Sentence Alignment
- Software for Word Alignment
- Software for Sentence Alignment
- Papers on Word Alignment Evaluation
- Some Papers on Word Alignment
- MT Related Events
Alignment Projects
- ARCADE I
http://www.up.univ-mrs.fr/veronis/arcade/
First stage included a competition among 6 systems for sentence alignment. ARCADE II to start soon
Some studies on evaluation. Evaluation measures include standard precision, recall and F-measure.
Languages: French. - EGYPT
http://www.clsp.jhu.edu/ws99/projects/mt
Includes an word-alignment visualization tool Cairo.
Languages: Arabic, French, Czech, Timorese. - MULTEXT-EAST
http://nl.ijs.si/ME/CD/mte-home.html
Sentence alignment of Orwell's 1984 in languages from East Europe.
Languages: Bulgarian, Czech, Estonian, Hungarian, Lithuanian, Latvian, Romanian, Russian, Serbo-Croatian, Slovene. - PLUG
http://numerus.ling.uu.se/~corpora/plug/pwa/
Word Alignment tool available free of charge. (binaries)
Demo available for Swedish-English corpora.
Languages: Swedish. - GIZA ++
http://www-i6.informatik.rwth-aachen.de/Colleagues/och/software/GIZA++.html
Improvement over GIZA; includes an implementation of the models in F. Och, H. Ney. "Improved Statistical Alignment Models".
Parallel Texts. Data for Text Alignment
- Data from the ACL 2005 workshop on Parallel Texts (Romanian/English, English/Inuktitut, English/Hindi)
- Data from the HLT-NAACL 2003 workshop on Parallel Texts (Romanian/English, French/English)
- Proceedings of the European Parliament, Europarl, sentence aligned by Philipp Koehn (11 European languages)
- Dan Melamed's Blinker data. (French/English)
- Philip Resnik's STRAND data. Languages: French, Chinese, Basque, English.
- What is Unicode? (many languages)
- The Cathedral and the Bazaar. (15 languages).
- Linux documentation. (25 languages)
- Logos. Verba Volant Dictionary and quotations in 50 languages.
- LDC parallel texts (Spanish, French).
- Parallel text search interface
- EPPS Word Alignment Trial and Test Data (Patrik Lambert)
- Welsh-English parallel text
Guidelines for Word Alignment
- ARCADE
http://www.up.univ-mrs.fr/veronis/arcade/2nd/word/guide/ - BLINKER
http://citeseer.nj.nec.com/melamed98manual.html - HLT-NAACL 2003 Workshop on Parallel Texts
http://www.cs.unt.edu/~rada/wpt/WordAlignment.Guidelines.txt - Patrik Lambert, Guidelines for Word Alignment Evaluation and Manual Alignment
Guidelines for Sentence Alignment
- ARCADE
http://www.up.univ-mrs.fr/veronis/arcade/arcade1/2nd/sent/resultformat.html - BAF
http://www.iro.umontreal.ca/~simardm/lrec98/
Software for Word Alignment
- [Visualization tool] Alpaco
http://www.d.umn.edu/~tpederse/parallel.html - [Visualization/Evaluation tool] Lingua-AlignmentSet
http://www.lsi.upc.es/~lambert/software/AlignmentSet.html - [Visualization tool] UMIACS Word Alignment Interface
http://www.umiacs.umd.edu/~nmadnani/alignment/forclip.htm - [Visualization tool] Cairo
http://www.clsp.jhu.edu/ws99/projects/mt/toolkit/ - [Visualization tool] Hand Align
http://www.isi.edu/~hdaume/HandAlign/ (originally designed to align documents and summaries) - [Visualization tool] I*Link
http://www.ida.liu.se/~nlplab/ILink/ - [Visualization tool] UPlug
http://stp.ling.uu.se/cgi-bin/joerg/Uplug - [Visualization tool] Other visualization tools not available online. Contact authors for additional details.
http://montev.isi.edu:8000/align-tool/?CORPUS=de-news-morphix&AFILE=full-model1-50-50.gz
http://linearb.co.uk - [Alignment tool] GIZA ++
http://www-i6.informatik.rwth-aachen.de/Colleagues/och/software/GIZA++.html - [Alignment tool] Twente
http://wwwhome.cs.utwente.nl/~irgroup/align/download.html
Languages: Dutch, German, French, English - [Alignment tool] PLUG PWA
http://numerus.ling.uu.se/~corpora/plug/pwa/index.html - [Alignment tool] Kvec++, by Ted Pedersen and Nitin Varma
http://www.d.umn.edu/~tpederse/parallel.html - [Alignment tool] UPlug
http://stp.ling.uu.se/cgi-bin/joerg/Uplug - [Alignment tool / Translation models] Moses
http://www.statmt.org/moses/
Software for Sentence Alignment
- [Alignment tool] GMA
Geometric Mapping and Alignment
http://nlp.cs.nyu.edu/GMA - [Alignment tool] Bilingual sentence aligner (Microsoft)
http://research.microsoft.com/research/downloads/default.aspx - [Alignment tool] Align (A.Berger)
http://www.cs.unt.edu/~rada/wa/tools/aberger - [Alignment tool] Vanilla
An implementation of the Gale&Church sentence alignment algorithm
http://nl.ijs.si/telri/Vanilla/ - [Alignment tool] UPlug
http://stp.ling.uu.se/cgi-bin/joerg/Uplug - [Alignment tool] CTK: Champollion Tool Kit
http://champollion.sourceforge.net - [Alignment tool] Hunalign
http://mokk.bme.hu/resources/hunalign
Papers on Word Alignment Evaluation
- Word Alignment for Languages with Scarce Resources. Joel Martin and Rada Mihalcea and Ted Pedersen. Proceedings of the ACL 2005 Workshop on "Building and Using Parallel Texts: Data Driven Machine Translation and Beyond", Ann Arbor, MI, June 2005. [pdf]
- An Evaluation Exercise for Word Alignment. Rada Mihalcea and Ted Pedersen. Proceedings of the HLT-NAACL 2004 Workshop on "Building and Using Parallel Texts: Data Driven Machine Translation and Beyond", Edmonton, Canada, May 2003. [pdf]
- Evaluation of word alignment systems. Lars Ahrenberg, Magnus Merkel, Anna Sågvall Hein and Jörg Tiedemann. Proceedings of the Second International Conference on Linguistic Resources and Evaluation (LREC-2000), Athens, Greece, 31 May - 2 June, 2000, Volume III: 1255-1261. [pdf]
Some Papers on Word Alignment
- See the papers from the shared task on word alignment from the HLT-NAACL 2003 Workshop on "Building and Using Parallel Texts: Data Driven Machine Translation and Beyond"
http://www.cs.unt.edu/~rada/wpt - See Jean Veronis bibliography (up to 1998)
http://www.up.univ-mrs.fr/~veronis/biblios/ptp.htm - Using Similarity Scoring to Improve the Bilingual Dictionary for Sub-sentential Alignment, Katharina Probst and Ralf Brown, Proceedings of ACL 2002. [ps]
(Evaluation done with traditional precision and recall) - Improved Statistical Alignment Models, F. Och and H. Ney, Proceedings of ACL 2001.[ps]
- A Comparison of Alignment Models for Statistical Machine Translation, F. Och and H. Ney, Proceedings of COLING 2000. [ps].
- A comprehensive bilingual word alignment system. Application to disparate languages: Hebrew and English; Y. Choueka, et al., in Veronis, J., "Parallel Text Processing: Alignment and use of translation corpora." (Kluwer Academic, 2000).
- A knowledge-lite approach to word alignment; L. Ahrenberg, et al., in Veronis, J., "Parallel Text Processing: Alignment and use of translation corpora." (Kluwer Academic, 2000).
- From sentences to words and clauses; S. Piperidis, et al., in Veronis, J., "Parallel Text Processing: Alignment and use of translation corpora." (Kluwer Academic, 2000).
- Bracketing and aligning words and constituents in parallel text using Stochastic Inversion Transduction Grammars; D. Wu., in Veronis, J., "Parallel Text Processing: Alignment and use of translation corpora." (Kluwer Academic, 2000).
- A Simple Hybrid Aligner for Generating Lexical Correspondences in Parallel Texts, Lars Ahrenberg, Mikael Andersson, Magnus Merkel, COLING-ACL 1998. [ps].
- Flow Network Models for Word Alignment and Terminology Extraction from Bilingual Corpora, Éric Gaussier, Proceedings of COLING-ACL 1998. [ps].
- Line `em up: Advances in Alignment Technology and Their Impact on Translation Support Tools, Elliott Macklovitch, Marie-Louise Hannan, 2nd AMTA, Montreal, Canada, 1996. [ps].
(Includes some evaluation and error analysis) - S. Vogel, H. Ney and C. Tillmann. "HMM-Based Word Alignment in Statistical Translation". In Procs. of the ACL'96, pp. 836-841, Copenhagen Denmark. Aug. 1996.
- Aligning Noisy Parallel Corpora Across Language Groups: Word Pair Feature Matching by Dynamic Time Warping, Pascale Fung, Kathleen McKeown, AMTA 1994. [ps].
- I. Dagan, K. Church and W. Gale. Robust bilingual word alignment for machine aided translation. In Proceedings of the Workshop on Very Large Corpora: Academic and Industrial Perspectives, pp. 1--8, 1993.
- Several of Dan Melamed's publications http://www.cs.nyu.edu/~melamed/pubs.html
MT Related Events
- ACL 2005 workshop "Building and Using Parallel Texts: Data Driven Machine Translation and Beyond"
http://www.cs.unt.edu/~rada/wpt05 - HLT-NAACL 2003 workshop "Building and Using Parallel Texts: Data Driven Machine Translation and Beyond"
http://www.cs.unt.edu/~rada/wpt - NIST MT Evaluation
http://www.nist.gov/speech/tests/mt/mt2001/index.htm - LREC 2002 workshop "Machine Translation Evaluation: Human Evaluators Meet Automated Metrics"
http://www.issco.unige.ch/projects/isle/mteval-may02/ - COLING 2002 workshop "Workshop on Machine translation in Asia"
http://www.coling2002.sinica.edu.tw/w07-acceptedpapers.html - ACL 2001 workshop "Data Driven Machine Translation"
http://conferences.atala.org/conferences/fiches/data-driven-mt.html
Maintained by Rada Mihalcea. Last updated: March 13, 2005.
https://blog.sciencenet.cn/blog-36782-27790.html
上一篇：数据过量与大脑疲劳
下一篇：Large Corpora used in CTS
扫一扫，分享此博文