Alon Lavie
Distinguished Career Professor, Director of MSAII Program
Studies machine translation and its evaluation.
Alon Lavie's lab at CMU works on interpretability, evaluation & safety of LMs and multilingual, translation & linguistics. 15 papers since 2023, 1 at top venues, mostly ACL and Findings of EMNLP. 20 alumni. Applications close .
At a glance
- papers, 2023–2026
- 4/ year
- at T1 venues
- 7%
- PhD students
- —
- MS students
- —
- alumni listed
- 20
Papers by yearfrom the lab homepage, 2023–2026
- 1 papers2026 · T1 0 · collecting
- 3 papers2025 · T1 0
- 5 papers2024 · T1 0
- 6 papers2023 · T1 1
T1 venuesOtherVenues: ACL, Findings of EMNLP
Research focuspaper titles that use each topic's words
- Interpretability, evaluation & safety of LMs9 papers
- Multilingual, translation & linguistics7 papers
- translation3 papers
- machine translation1 paper
- technologies institute0 papers
Paper list
From the lab homepage.
20261 paper
20253 papers
- Proceedings of the Tenth Conference on Machine Translation (WMTFindings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help
- Proceedings of the Tenth Conference on Machine Translation (WMTHrabal, M., O. Glembek, A. Tamchyna, A. S. Hildebrand, A. Eckhard, M. Stola, S. Penkale, Z. Simeckova, O. Bojar, A. Lavie and C. Stewart. "CUNI and Phrase at WMT25 MT Evaluation Task" (opens in a new tab)
- Proceedings of the Twelfth Dialog System Technology ChallengeMendonca, J., L. Zhang, R. Mallidi, A. Lavie, I. Trancoso, L. F. D'Haro and J. Sedoc. "Overview of Dialog System Evaluation Track: Dimensionality, Language, Culture and Safety at DSTC 12" (opens in a new tab)
20245 papers
- Proceedings of the Ninth Conference on Machine Translation (WMTFreitag, M., N. Mathur, D. Deutsch, C.-K. Lo, E. Avramidis, R. Rei, B. Thompson, F. Blain, T. Kocmi, J. Wang, D. I. Adelani, M. Buchicchio, C. Zerva, and A. Lavie. "Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task" (opens in a new tab)
- Proceedings of the Workshop on NLP for Conversational AI (NLP4ConvAIMendonca, J., A. Lavie and I. Trancoso. "On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation" (opens in a new tab)
- Proceedings of the Annual Meeting of the Special Interest Group on Discourse and DialogueMendonca, J., I. Trancoso and A. Lavie "ECoh: Turn-level Coherence Evaluation for Multilingual Dialogues" (opens in a new tab)
- Findings of EMNLPMendonca, J., I. Trancoso and A. Lavie "Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs" (opens in a new tab)
- The Journal of Specialised TranslationSilva, B., M. Buchicchio, D. van Stigt, C. Stewart, H. Moniz, and A. Lavie. "Data-Driven Asian Adapted MQM Typology and Automation in Translation Quality Workflows" (opens in a new tab)
20236 papers
- Proceedings of the Annual Conference of the European Association for Machine TranslationCabeca, M., M. Buchicchio, M. Goncalves, C. Maroti, J. Godinho, P. Coelho, H. Moniz and A. Lavie. "Quality Fit for Purpose: Building Business Critical Errors Test Suites" (opens in a new tab)
- Proceedings of the Eighth Conference on Machine Translation (WMTFreitag, M., N. Mathur, C. Lo, E. Avramidis, R. Rei, B. Thompson, T. Kocmi, F. Blain, D. Deutsch, C. Stewart, C. Zerva, S. Castilho, A. Lavie and G. Foster. "Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent" (opens in a new tab)
- Proceedings of the Annual Meeting of the Special Interest Group on Discourse and DialogueMendonca, J., A. Lavie and I. Trancoso. "Towards Multilingual Automatic Open-Domain Dialogue Evaluation" (opens in a new tab)
- Proceedings of The Eleventh Dialog System Technology ChallengeMendonca, J., P. Pereira, H. Moniz, J. P. Carvalho, A. Lavie and I. Trancoso. "Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluation" (opens in a new tab)
- —Mendonca, J., P. Pereira, M. Menezes, V. Cabarrao, A. C. Farinha, H. Moniz, J. P. Carvalho, A. Lavie and I. Trancoso. "Dialogue Quality and Emotion Annotations for Customer Support Conversations" (opens in a new tab)
- ACL (T1)Rei, R., N. M. Guirreiro, M. Treviso, L. Coheur, A. Lavie and A. Martins, "The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics" (opens in a new tab)
Where alumni went20 listed
Apply to CMUFall 2027
CMU SCS Computer Science PhD
- Round
- Single round
- Opens
- GRE
- See program page
- English
- TOEFL / IELTS / Duolingo (F-1/J-1 non-native speakers)
- Fee
- USD 100 (USD 80 by early deadline)
Confirmed on the program page.
Similar labsnearest by research summary
- USStanford
Monica Lam
- Large language models
- CNTsinghua
Zhijian Ou
- Speech recognition & spoken language
- USUW
Yulia Tsvetkov
- Interpretability, evaluation & safety of LMs
- CNSJTU
Sufeng Duan
- Large language models
- CNSJTU
Gongshen Liu
- Large language models
- CNSJTU
Pan Hu
- Large language models
Your notes
Save this lab to keep notes.
Data
Some numbers could not be verified:
- The member list could not be found on the lab site.
- Collected
- Verified
- Papers
- The lab homepage
- Members
- Not collected
- Alumni
- Lab homepage
Tiers are venue classifications, not lab rankings.
CMUcloses