Sheila Castilho

Dr

Profile Photo

  

Sheila Castilho graduated in Linguistics and Education from the UNIOESTE University in Brazil. She holds a joint Master in Natural Language Processing from the University of Wolverhampton –UK and the University of Algarve – PT. She completed her PhD dissertation at Dublin City University in 2016. She was an Irish Research Council Research Fellow at the Adapt Centre. She is a programme committee member of a number of machine translation and NLP conferences (ACL, EMNLP, WMT, RANLP, EAMT and COLING) and has acted as a reviewer for high-profile journals (Natural Language Engineering, the Machine Translation Journal, Language Resources, and  JosTrans). She was part of the TraMOOC and iADAATPA projects. She has authored  several journal articles and book chapters on translation technology,  post-editing of machine translation, user evaluation of machine translation,  and translators’ perception of machine translation – over 40 publications to  date. She is a co-editor of the book 'Translation Quality Assessment: From  Principles to Practice', published in 2018 by Springer. She is also a co-editor  of the Machine Translation Journal special issue on ‘Human factors In NMT’,  published in 2019. She is the co-chair of the conference New Trends in Translation Technology (NeTTT’22). Her research interests include machine translation, post-editing, machine and human translation evaluation, document-level machine translation, usability, and translation technologies. Currently, she is an Assistant Professor at the School of Applied Languages and Intercultural Studies, and the programme chair of the Master in translation Studies and the Master in Translation Technology. 

Book Chapter

Year Publication
2018 (2018) 'On education and training in Translation Quality Assessment' In:
2018 (2018) 'Approaches to human and machine Translation Quality Assessment' In:
2018 (2018) 'Introduction' In:
2018 Doherty, S., Moorkens, J., Gaspari, F., Castilho, S. (2018) 'On Education and Training in Translation Quality Assessment' In: Translation Quality Assessment: From Principles to Practice. Berlin, Germany : Springer. [Link] [DOI]

Conference Publication

Year Publication
2018 (2018) Improving Machine Translation of Educational Content via Crowdsourcing
2018 (2018) Translation Crowdsourcing: Creating a Multilingual Corpus of Online Educational Content
2018 (2018) The 21st Annual Conference of the European Association for Machine Translation Project PiPeNovel: Pilot on Post-editing Novels
2017 (2017) Proceedings of MT Summit XVI, the 16th Machine Translation Summit A Comparative Quality Evaluation of PBSMT and NMT using Professional Translators
2017 (2017) Proceedings of the Sixth Workshop on Vision and Language Human Evaluation of Multi-modal Neural Machine Translation: A Case-Study on E-Commerce Listing Titles [Link]
2017 Castilho, S., Gaspari, F., Moorkens, J., Way, A. (2017) EDULEARN 2017 - 9th annual International Conference on Education and New Learning Technologies INTEGRATING MACHINE TRANSLATION INTO MOOCS Barcelona, Spain, 03/07/2017- 05/07/2017 [DOI]
2017 (2017) Proceedings of MT Summit XVI, the 16th Machine Translation Summit Translation Dictation vs. Post-editing with Cloud-based Voice Recognition: A Pilot Experiment
2017 (2017) Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers Using Images to Improve Machine-Translating E-Commerce Product Listings [Link]
2016 (2016) The Tenth International Conference on Language Resources and Evaluation, LREC ’1 Evaluating the impact of light post-editing on usability
2015 (2015) CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING Reading metrics for estimating task efficiency with MT output
2012 (2012) LREC 2012 A review corpus annotated for negation, speculation and their scope
2012 (2012) EAMT 2012 Cross-lingual Sentence Compression for Subtitles
2012 (2012) LREC PET: a Tool for Post-editing and Assessing Machine Translation
2011 (2011) Recent Advances in Natural Language Processing Conference, RANLP ’11 Annotating negation and speculation: the case of the review domain
2011 (2011) RANLP Assessing the Post-Editing Effort for Automatic and Semi-Automatic Translations of DVD Subtitles
2021 (2021) Sixth Conference on Machine Translation Dela corpus: A document-level corpus annotated with context-related issues
2021 (2021) European Chapter of the Association for Computational Linguistics - EACL 2021 Towards document-level human MT evaluation: On the Issues of annotator agreement, effort and misevaluation
2020 (2020) Proceedings of the 12th Language Resources and Evaluation Conference On context span needed for machine translation evaluation
2020 (2020) Proceedings of the 22nd Annual Conference of the European Association for Machine Translation A human evaluation of English-Irish statistical and neural machine translation
2020 (2020) Proceedings of the Fifth Conference on Machine Translation On the same page? comparing inter-annotator agreement in sentence and document level human machine translation evaluation
2020 (2020) 22nd Annual Conference of the European Association for Machine Translation Document-Level Machine Translation Evaluation Project: Methodology, Effort and Inter-Annotator Agreement
2019 Popović, M.;Castilho, S. (2019) International Conference Recent Advances in Natural Language Processing, RANLP Are ambiguous conjunctions problematic for machine translation? [Link] [DOI]
2019 (2019) Proceedings of Machine Translation Summit XVII: Translator, Project and User Tracks Large-scale machine translation evaluation of the iADAATPA Project
2019 (2019) Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019) What influences the features of post-editese? a preliminary study
2018 (2018) Proceedings of the 21st Annual Conference of the European Association for Machine Translation Project PiPeNovel: Pilot on Post-editing Novels
2018 (2018) Proceedings of the 21st Annual Conference of the European Association for Machine Translation Reading Comprehension of Machine Translation Output: What Makes for a Better Read?
2017 (2017) 20th Annual Conference of the European Association for Machine Translation, EAMT TraMOOC—translation for massive open online courses: recent developments in machine translation
2015 (2015) Proceedings of the sixth workshop on cognitive aspects of computational language learning Reading metrics for estimating task efficiency with MT output
2014 (2014) Proceedings of the 17th annual conference of the European association for machine translation Does post-editing increase usability? A study with Brazilian Portuguese as Target Language
2012 (2012) Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) PET: a tool for post-editing and assessing machine translation
2011 (2011) Proceedings of the International Conference Recent Advances in Natural Language Processing 2011 Assessing the post-editing effort for automatic and semi-automatic translations of DVD subtitles

Peer Reviewed Journal

Year Publication
2020 Samuel Läubli;Sheila Castilho;Graham Neubig;Rico Sennrich;Qinlan Shen;Antonio Toral (2020) 'A Set of Recommendations for Assessing Human–Machine Parity in Language Translation'. Journal of Artificial Intelligence Research, . https://doi.org/10.1613/jair.1.11371
2018 Castilho S.; Moorkens J.; Gaspari F.; Sennrich R.; Way A.; Georgakopoulou P. (2018) 'Evaluating MT for massive open online courses: A multifaceted comparison between PBSMT and NMT systems'. Machine Translation, 32 (3):255-278. [DOI]
2018 Moorkens, J., Toral, A., Castilho, S., Way, A. (2018) 'Translator's Perceptions of Literary Post-editing using Statistical and Neural Machine Translation'. TRANSLATION SPACES, 7 (2):240-262. [Link] [DOI]
2017 (2017) 'Acceptability of Machine Translated Content: A Multi-Language Evaluation by Translators and End Users'. Linguistica Antverpiensia, . [Link]
2017 (2017) 'Is Neural Machine Translation the New State of the Art?'. The Prague Bulletin of Mathematical Linguistics, .
2016 (2016) 'Content profiling and translation scenarios'. The Journal of Internationalization and Localization, .
2016 (2016) 'Human factors in machine translation and post-editing among institutional translators'. TRANSLATION SPACES, . [Link]
2014 (2014) 'Does post-editing increase usability? A study with Brazilian Portuguese as Target Language'. .
2022 Castilho, S.;Resende, N. (2022) 'Post-Editese in Literary Translations'. Information (Switzerland), 13 . [Link] [DOI]
2022 Petra Bago;Sheila Castilho;Edoardo Celeste;Jane Dunne;Federico Gaspari;Níels Rúnar Gíslason;Andre Kåsen;Filip Klubička;Gauti Kristmannsson;Helen McHugh;Róisín Moran;Órla Ní Loinsigh;Jon Arild Olsen;Carla Parra Escartín;Akshai Ramesh;Natalia Resende;Páraic Sheridan;Andy Way (2022) 'Sharing high-quality language resources in the legal domain to develop neural machine translation for under-resourced European languages'. Revista de Llengua i Dret (Journal of Language and Law), 78 :9-34. [Link] [DOI]
2019 (2019) 'Challenge test sets for MT evaluation'. Proceedings of Machine Translation Summit XVII Volume 3: Tutorial Abstracts, Dublin, Ireland. European Association for Machine Translation, .
2018 (2018) 'Acceptability of machine-translated content: A multi-language evaluation by translators and end-users'. Linguistica Antverpiensia, New Series--Themes in Translation Studies, . [DOI]
2018 (2018) 'Attaining the unattainable? reassessing claims of human parity in neural machine translation'. arXiv preprint arXiv:1808.10432, .
2016 Cadwell, P., Castilho, S., O’Brien, S., and Mitchell, L. (2016) 'Human Factors in Machine Translation and Post-Editing among Institutional Translators'. TRANSLATION SPACES, 5 (2):222-243. [DOI]
2016 (2016) 'A comparative evaluation of phrase-based statistical and neural machine translation'. Presentation at Translating and the Computer, .

Editorial

Year Publication
2019 Sheila Castilho;Federico Gaspari;Joss Moorkens;Maja Popović;Antonio Toral (2019) Editors’ foreword to the special issue on human factors in neural machine translation. ED [Link] [DOI]

Thesis

Year Publication
2016 (2016) Measuring acceptability of machine translated enterprise content. THES

Other Publication

Year Publication
2020 Läubli, S.;Castilho, S.;Neubig, G.;Sennrich, R.;Shen, Q.;Toral, A. (2020) A set of recommendations for assessing human-machine parity in language translation. [Link] [DOI]
2019 (2019) Chan Sin-Wai (ed): The human factor in machine translation.
Certain data included herein are derived from the © Web of Science (2023) of Clarivate. All rights reserved.

Professional Associations

Association Function From / To
Association for Computational Linguistics 01/01/2018 -
European Association for Machine Translation 01/01/2016 -

Employment

Employer Position From / To
Dublin City University Research Fellow 14/06/2016 -

Education

Start date Institution Qualification Subject
01/04/2013 Dublin City University PhD
01/09/2009 Universidade do Algarve Master in Natural Language Processing and Human Language Technology
01/03/2003 Universidade Estadual do Oeste do Paraná - Campus de Foz do Iguaçu Licenciatura em Letras Inglês/Português
01/09/2009 University of Wolverhampton Master in Natural Language Processing and Human Language Technology

Research Projects

Title Role Description Start date End date
Document-level MachinE TransLation EvAluation DCU PI 01/10/2020 01/10/2022
Document-level evaluation: methodology, effort and inter-annotator agreement DCU PI 01/01/2020 31/12/2020
I'm a scientist, get me out of here award 01/11/2018 01/05/2019

Current Postgraduate Students

Student Name Degree Supervision
Asadidehziri ,Vahid PhD-track Supervisor
Cavalheiro Camargo ,Joao Lucas PhD-track Supervisor

Modules Coordinated

Term Title Subject
2023 LC503
2023 LC5740
2023 LC523
2023 LC501