Sheila Castilho

Dr

Profile Photo

  

Sheila Castilho graduated in Linguistics and Education from the UNIOESTE University in Brazil. She holds a joint Master in Natural Language Processing from the University of Wolverhampton –UK and the University of Algarve – PT. She completed her PhD dissertation at Dublin City University in 2016. She was an Irish Research Council Research Fellow at the Adapt Centre. She is a programme committee member of a number of machine translation and NLP conferences (ACL, EMNLP, WMT, RANLP, EAMT and COLING) and has acted as a reviewer for high-profile journals (Natural Language Engineering, the Machine Translation Journal, Language Resources, and  JosTrans). She was part of the TraMOOC and iADAATPA projects. She has authored  several journal articles and book chapters on translation technology,  post-editing of machine translation, user evaluation of machine translation,  and translators’ perception of machine translation – over 40 publications to  date. She is a co-editor of the book 'Translation Quality Assessment: From  Principles to Practice', published in 2018 by Springer. She is also a co-editor  of the Machine Translation Journal special issue on ‘Human factors In NMT’,  published in 2019. She is the co-chair of the conference New Trends in Translation Technology (NeTTT’22). Her research interests include machine translation, post-editing, machine and human translation evaluation, document-level machine translation, usability, and translation technologies. Currently, she is an Assistant Professor at the School of Applied Languages and Intercultural Studies, and the programme chair of the Master in translation Studies and the Master in Translation Technology. 

Book Chapter

Year Publication
2018 (2018) 'On education and training in Translation Quality Assessment' In:
2018 (2018) 'Approaches to human and machine Translation Quality Assessment' In:
2018 (2018) 'Introduction' In:
2018 Doherty, S., Moorkens, J., Gaspari, F., Castilho, S. (2018) 'On Education and Training in Translation Quality Assessment' In: Translation Quality Assessment: From Principles to Practice. Berlin, Germany : Springer. [Link] [DOI]

Conference Publication

Year Publication
2024 João Cavalheiro Camargo; Sheila Castilho; Joss Moorkens (2024) Proceedings of the European Association for Machine Translation Perceptions of Educators on MTQA Curriculum and Instruction Sheffield, UK, 24/06/2024- 27/06/2024
2023 Castilho, S.; Mallon, C.; Meisterr, R.; Yue, S. (2023) Proceedings of the 24th Annual Conference of the European Association for Machine Translation, EAMT 2023 Do online Machine Translation Systems Care for Context? What About a GPT Model? [Link]
2022 Castilho, S. (2022) EAMT 2022 - Proceedings of the 23rd Annual Conference of the European Association for Machine Translation DELA Project: Document-level Machine Translation Evaluation [Link]
2021 Castilho, S. (2021) 5th Conference on Machine Translation, WMT 2020 - Proceedings On the Same Page? Comparing Inter-Annotator Agreement in Sentence and Document Level Human Machine Translation Evaluation [Link]
2021 (2021) European Chapter of the Association for Computational Linguistics - EACL 2021 Towards document-level human MT evaluation: On the Issues of annotator agreement, effort and misevaluation
2021 (2021) Sixth Conference on Machine Translation Dela corpus: A document-level corpus annotated with context-related issues
2021 Castilho, S.; Menezes, M.; Cavalheiro Camargo, J.L.; Way, A. (2021) WMT 2021 - 6th Conference on Machine Translation, Proceedings DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues [Link]
2021 Castilho, S. (2021) Human Evaluation of NLP Systems, HumEval 2021 - Proceedings of the Workshop, as part of the 16th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2021 Towards Document-Level Human MT Evaluation: On the Issues of Annotator Agreement, Effort and Misevaluation [Link]
2021 (2021) Proceedings of Machine Translation Summit XVIII: Users and Providers Track Building MT systems in low resourced languages for Public Sector users in Croatia, Iceland, Ireland, and Norway
2020 (2020) Proceedings of the 22nd Annual Conference of the European Association for Machine Translation A human evaluation of English-Irish statistical and neural machine translation
2020 Castilho, S. (2020) Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, EAMT 2020 Document-Level Machine Translation Evaluation Project: Methodology, Effort and Inter-Annotator Agreement [Link]
2020 Castilho, S.; Popovi, M.; Way, A. (2020) LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings On context span needed for machine translation evaluation [Link]
2020 (2020) 22nd Annual Conference of the European Association for Machine Translation Document-Level Machine Translation Evaluation Project: Methodology, Effort and Inter-Annotator Agreement
2020 (2020) Proceedings of the Fifth Conference on Machine Translation On the same page? comparing inter-annotator agreement in sentence and document level human machine translation evaluation
2020 (2020) Proceedings of the 12th Language Resources and Evaluation Conference On context span needed for machine translation evaluation
2020 Castilho, Sheila; Popovic, Maja; Way, Andy (2020) PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020) On Context Span Needed for Machine Translation Evaluation
2019 (2019) Proceedings of Machine Translation Summit XVII: Translator, Project and User Tracks Large-scale machine translation evaluation of the iADAATPA Project
2019 Popović, M.; Castilho, S. (2019) International Conference Recent Advances in Natural Language Processing, RANLP Are ambiguous conjunctions problematic for machine translation? [Link] [DOI]
2019 (2019) Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019) What influences the features of post-editese? a preliminary study
2018 (2018) Proceedings of the 21st Annual Conference of the European Association for Machine Translation Reading Comprehension of Machine Translation Output: What Makes for a Better Read?
2018 (2018) Proceedings of the 21st Annual Conference of the European Association for Machine Translation Project PiPeNovel: Pilot on Post-editing Novels
2018 Sosoni, Vilelmini; Kermanidis, Katia Lida; Stasimioti, Maria; Naskos, Thanasis; Takoulidou, Eirini; van Zaanen, Menno; Castilho, Sheila; Georgakopoulou, Panayota; Kordoni, Valia; Egg, Markus (2018) PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018) Translation Crowdsourcing: Creating a Multilingual Corpus of Online Educational Content
2018 Behnke, Maximiliana; Barone, Antonio Valerio Miceli; Sennrich, Rico; Sosoni, Vilelmini; Naskos, Thanasis; Takoulidou, Eirini; Stasimioti, Maria; van Zaanen, Menno; Castilho, Sheila; Gaspari, Federico; Georgakopoulou, Panayota; Kordoni, Valia; Egg, Markus; Kermanidis, Katia Lida (2018) PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018) Improving Machine Translation of Educational Content via Crowdsourcing
2018 (2018) Improving Machine Translation of Educational Content via Crowdsourcing
2018 (2018) The 21st Annual Conference of the European Association for Machine Translation Project PiPeNovel: Pilot on Post-editing Novels
2018 (2018) Translation Crowdsourcing: Creating a Multilingual Corpus of Online Educational Content
2017 Castilho, S., Gaspari, F., Moorkens, J., Way, A. (2017) EDULEARN 2017 - 9th annual International Conference on Education and New Learning Technologies INTEGRATING MACHINE TRANSLATION INTO MOOCS Barcelona, Spain, 03/07/2017- 05/07/2017 [DOI]
2017 (2017) Proceedings of the Sixth Workshop on Vision and Language Human Evaluation of Multi-modal Neural Machine Translation: A Case-Study on E-Commerce Listing Titles [Link]
2017 (2017) Proceedings of MT Summit XVI, the 16th Machine Translation Summit A Comparative Quality Evaluation of PBSMT and NMT using Professional Translators
2017 Castilho, Sheila; Gaspari, Federico; Moorkens, Joss; Way, Andy (2017) 9TH INTERNATIONAL CONFERENCE ON EDUCATION AND NEW LEARNING TECHNOLOGIES (EDULEARN17) INTEGRATING MACHINE TRANSLATION INTO MOOCS
2017 (2017) 20th Annual Conference of the European Association for Machine Translation, EAMT TraMOOC—translation for massive open online courses: recent developments in machine translation
2017 (2017) Proceedings of MT Summit XVI, the 16th Machine Translation Summit Translation Dictation vs. Post-editing with Cloud-based Voice Recognition: A Pilot Experiment
2017 (2017) Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers Using Images to Improve Machine-Translating E-Commerce Product Listings [Link]
2016 (2016) The Tenth International Conference on Language Resources and Evaluation, LREC ’1 Evaluating the impact of light post-editing on usability
2015 (2015) Proceedings of the sixth workshop on cognitive aspects of computational language learning Reading metrics for estimating task efficiency with MT output
2015 (2015) CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING Reading metrics for estimating task efficiency with MT output
2014 (2014) Proceedings of the 17th annual conference of the European association for machine translation Does post-editing increase usability? A study with Brazilian Portuguese as Target Language
2012 (2012) Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) PET: a tool for post-editing and assessing machine translation
2012 (2012) LREC PET: a Tool for Post-editing and Assessing Machine Translation
2012 (2012) LREC 2012 A review corpus annotated for negation, speculation and their scope
2012 (2012) EAMT 2012 Cross-lingual Sentence Compression for Subtitles
2012 Aziz, Wilker; de Sousa, Sheila C. M.; Specia, Lucia (2012) LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION PET: a Tool for Post-editing and Assessing Machine Translation
2011 (2011) Recent Advances in Natural Language Processing Conference, RANLP ’11 Annotating negation and speculation: the case of the review domain
2011 (2011) Proceedings of the International Conference Recent Advances in Natural Language Processing 2011 Assessing the post-editing effort for automatic and semi-automatic translations of DVD subtitles
2011 (2011) RANLP Assessing the Post-Editing Effort for Automatic and Semi-Automatic Translations of DVD Subtitles

Peer Reviewed Journal

Year Publication
2022 Petra Bago; Sheila Castilho; Edoardo Celeste; Jane Dunne; Federico Gaspari; Níels Rúnar Gíslason; Andre Kåsen; Filip Klubička; Gauti Kristmannsson; Helen McHugh; Róisín Moran; Órla Ní Loinsigh; Jon Arild Olsen; Carla Parra Escartín; Akshai Ramesh; Natalia Resende; Páraic Sheridan; Andy Way (2022) 'Sharing high-quality language resources in the legal domain to develop neural machine translation for under-resourced European languages'. Revista de Llengua i Dret (Journal of Language and Law), 78 :9-34. [Link] [DOI]
2022 Castilho, S.; Resende, N. (2022) 'Post-Editese in Literary Translations'. Information (Switzerland), 13 . [Link] [DOI]
2020 Laeubli, Samuel; Castilho, Sheila; Neubig, Graham; Sennrich, Rico; Shen, Qinlan; Toral, Antonio (2020) 'A Set of Recommendations for Assessing Human-Machine Parity in Language Translation'. Journal of Artificial Intelligence Research, 67 .
2020 Samuel Läubli; Sheila Castilho; Graham Neubig; Rico Sennrich; Qinlan Shen; Antonio Toral (2020) 'A Set of Recommendations for Assessing Human–Machine Parity in Language Translation'. Journal of Artificial Intelligence Research, . https://doi.org/10.1613/jair.1.11371
2019 (2019) 'Challenge test sets for MT evaluation'. Proceedings of Machine Translation Summit XVII Volume 3: Tutorial Abstracts, Dublin, Ireland. European Association for Machine Translation, .
2018 Moorkens, J., Toral, A., Castilho, S., Way, A. (2018) 'Translator's Perceptions of Literary Post-editing using Statistical and Neural Machine Translation'. TRANSLATION SPACES, 7 (2):240-262. [Link] [DOI]
2018 (2018) 'Acceptability of machine-translated content: A multi-language evaluation by translators and end-users'. Linguistica Antverpiensia, New Series--Themes in Translation Studies, . [DOI]
2018 (2018) 'Attaining the unattainable? reassessing claims of human parity in neural machine translation'. arXiv preprint arXiv:1808.10432, .
2018 Doherty, Stephen; Moorkens, Joss; Gaspari, Federico; Castilho, Sheila (2018) 'On Education and Training in Translation Quality Assessment'. TRANSLATION QUALITY ASSESSMENT: FROM PRINCIPLES TO PRACTICE, 1 . [DOI]
2018 Castilho, Sheila; Doherty, Stephen; Gaspari, Federico; Moorkens, Joss (2018) 'Approaches to Human and Machine Translation Quality Assessment'. TRANSLATION QUALITY ASSESSMENT: FROM PRINCIPLES TO PRACTICE, 1 . [DOI]
2018 Castilho, S.; Moorkens, J.; Gaspari, F.; Sennrich, R.; Way, A.; Georgakopoulou, P. (2018) 'Evaluating MT for massive open online courses: A multifaceted comparison between PBSMT and NMT systems'. Machine Translation, 32 . [Link] [DOI]
2017 Castilho, Sheila; O'Brien, Sharon (2017) 'Acceptability of machine-translated content: A multi-language evaluation by translators and end-users'. LINGUISTICA ANTVERPIENSIA NEW SERIES-THEMES IN TRANSLATION STUDIES, 16 .
2017 (2017) 'Acceptability of Machine Translated Content: A Multi-Language Evaluation by Translators and End Users'. Linguistica Antverpiensia, . [Link]
2017 (2017) 'Is Neural Machine Translation the New State of the Art?'. The Prague Bulletin of Mathematical Linguistics, .
2016 (2016) 'A comparative evaluation of phrase-based statistical and neural machine translation'. Presentation at Translating and the Computer, .
2016 Cadwell, P., Castilho, S., O’Brien, S., and Mitchell, L. (2016) 'Human Factors in Machine Translation and Post-Editing among Institutional Translators'. TRANSLATION SPACES, 5 (2):222-243. [DOI]
2016 (2016) 'Human factors in machine translation and post-editing among institutional translators'. TRANSLATION SPACES, . [Link]
2016 (2016) 'Content profiling and translation scenarios'. The Journal of Internationalization and Localization, .
2014 (2014) 'Does post-editing increase usability? A study with Brazilian Portuguese as Target Language'. .

Thesis

Year Publication
2016 (2016) Measuring acceptability of machine translated enterprise content. THES

Other Publication

Year Publication
2024 Moorkens, J.; Castilho, S.; Gaspari, F.; Toral, A.; Popović, M. (2024) Proposal for a Triple Bottom Line for Translation Automation and Sustainability: An Editorial Position Paper. [Link] https://doi.org/10.26034/cm.jostrans.2024.4706
2020 Läubli, S.; Castilho, S.; Neubig, G.; Sennrich, R.; Shen, Q.; Toral, A. (2020) A set of recommendations for assessing human-machine parity in language translation. [Link] [DOI]
2019 (2019) Chan Sin-Wai (ed): The human factor in machine translation.
2019 Sheila Castilho; Federico Gaspari; Joss Moorkens; Maja Popović; Antonio Toral (2019) Editors’ foreword to the special issue on human factors in neural machine translation. [Link] [DOI]
Certain data included herein are derived from the © Web of Science (2024) of Clarivate. All rights reserved.

Professional Associations

Association Function From / To
Association for Computational Linguistics 01/01/2018 -
European Association for Machine Translation 01/01/2016 -

Employment

Employer Position From / To
Dublin City University Research Fellow 14/06/2016 -

Education

Start date Institution Qualification Subject
01/04/2013 Dublin City University PhD
01/09/2009 Universidade do Algarve Master in Natural Language Processing and Human Language Technology
01/03/2003 Universidade Estadual do Oeste do Paraná - Campus de Foz do Iguaçu Licenciatura em Letras Inglês/Português
01/09/2009 University of Wolverhampton Master in Natural Language Processing and Human Language Technology

Research Projects

Title Role Description Start date End date
Document-level MachinE TransLation EvAluation DCU PI 01/10/2020 01/10/2022
Document-level evaluation: methodology, effort and inter-annotator agreement DCU PI 01/01/2020 31/12/2020
I'm a scientist, get me out of here award 01/11/2018 01/05/2019

Current Postgraduate Students

Student Name Degree Supervision
Asadidehziri ,Vahid PhD-track Supervisor
Cavalheiro Camargo ,Joao Lucas PhD Supervisor
Haq ,Sami Ul PhD-track Supervisor

Modules Coordinated

Term Title Subject
2023 LC503
2023 LC5740
2023 LC523
2023 LC501