Click on a year to read the news stories
Papers accepted to EACL2017:
- An Extensible Framework for Verification of Numerical Claims, J. Thorne, A. Vlachos, Proceedings of the Software Demonstrations pdf bib
- Continuous N-gram Representations for Authorship Attribution, Y. Sari, A. Vlachos, M. Stevenson, Proceedings of EACL: Volume 2, Short Papers pdf bib
- Book: Natural Language Processing for the Semantic Web, Diana Maynard, Kalina Bontcheva, Isabelle Augenstein. Morgan and Claypool, December 2016. ISBN:97816270590
- Journal paper: A Framework for Real-time Semantic Social Media Analysis. Diana Maynard, Ian Roberts, Mark A. Greenwood, Dominic Rout and Kalina Bontcheva. Web Semantics: Science, Services and Agents on the World Wide Web, 2017
- Conference paper: Towards an Infrastructure for Understanding and Interlinking Knowledge Co-Creation in European research, Diana Maynard, Adam Funk and Benedetto Lepori. ESWC 2017 Workshop on Scientometrics, Portoroz, Slovenia, May 2017
- Diana Maynard taught 2 practical tutorials at the AI Seminar on Social Media Content Analysis, UPC Barcelona, May 2017
- Diana Maynard gave an invited tutorial at the EU CLARIN-PLUS workshop on "Creation and Use of Social Media Resources", Lithuania, 2017
- Diana Maynard gave an invited talk at 2017 Joint EC-OECD workshop on Semantic Technologies and Semantic Web: Structuring Data for STI Policy Analysis, 19 June, Brussels
- Diana Maynard gave an invited talk at 2017 EPSRC The Future of Patent Analytics Workshop, 3 March, Cambridge, UK
- The KNOWMAK project has started. A 3 year EC H2020 project from 1 Jan'17 - 31 Dec’20. The University of Sheffield PI is Diana Maynard.
- Diana Maynard was Programme Chair of the ESWC conference in Portoroz, Slovenia in May.
- Diana Maynard has won an ESRC-funded award from Understanding Society to access and analyse EU Referendum UK household survey data, for the project "Brexit narratives of place and scale: a media environment analysis of the EU Referendum debate” Co-PIs: Jackie Harrison (Journalism), J. Miguel Kanai (Geography)
Papers accepted for COLING 2016:
- Representation and Learning of Temporal Relations. L. Derczynski (2016). COLING
- Broad Twitter Corpus: A Diverse Named Entity Recognition Resource. L. Derczynski, K. Bontcheva, I. Roberts (2016). COLING
- Stance classification in Rumours as a Sequential Task Exploiting the Tree Structure of Social Media Conversations. A. Zubiaga, E. Kochkina, M. Liakata, R. Procter, M. Lukasik. (2016). COLING
- Anita: An Intelligent Text Adaptation Tool. G. Paetzold, L. Specia. (2016). COLING
- Understanding the Lexical Simplification Needs of non-Native Speakers of English. G. Paetzold, L. Specia. (2016). COLING
- Collecting and Exploring Everyday Language for Predicting Psycholinguistic Properties of Words. G. Paetzold, L. Specia. (2016). COLING
- Imitation learning for language generation from unaligned data. G. Lampouras, A. Vlachos. (2016). COLING
- Carolina Scarton, Gustavo Paetzold and Lucia Specia will give a tutorial at COLING 2016, titledQuality estimation for language output applications
- We are please to announce that Gutsavo Paetzold has passed his PhD viva, having submitted only 2 years after joining as a PhD student.
- Leon Derczynski will give a course at ESSLLI 2017 with Matteo Magnani, titled "Networks and User-generated Content"
- Book in press in Springer Studies in Computational Intelligence: Automatically ordering events and times in text - L Derczynski
- Diana Maynard has had an article on automatic sarcasm detection published in Quartz Magazine
- Diana Maynard will give tutorials on NLP and Social Media Analysis at the 1st International Deep Learning, Big Data and Big Compute Camp, Rabat, Morocco, 24-28 October 2016. https://dlwensias.wordpress.com/2016/09/05/3/
- Paper published in European Psychiatry: Novel psychoactive substances: an investigation of temporal trends in social media and electronic health records - A Kolliakou, M Ball, L Derczynski, D Chandran, G Gkotsis, P Deluca, R Jackson, H Shetty, R Stewart
- Mark Stevenson and Adam Poulson are collaborating with ScHaRR and Human on a project to visualise emotion in social media at the Festival of the Mind - Link to the Guardian Article
- Paper: An IR-based Approach Utilising Query Expansion for Plagiarism Detection in MEDLINE. R. Nawab, M Stevenson and P. Clough (2016). IEEE/ACM Transactions of Computational Biology and Bioinformatics.
- Paper: The Effect of Word Sense Disambiguation Accuracy on Literature Based Discovery. J. Preiss and M. Stevenson (2016). BMC Decision Making and Medical Informatics.
- Paper: A Corpus of Potentially Contradictory Research Claims from Cardiovascular Research Abstracts. A. Alamri and M. Stevenson (2016). Journal of Biomedical Semantics, 7 (36).
Papers accepted for EMNLP 2016:
- Stance Detection with Bidirectional Conditional Encoding , Isabelle Augenstein, Tim Rocktäschel, Andreas Vlachos and Kalina Bontcheva
- Leon Derczynski has won an NVIDA hardware grant for summary generation from collections of text.
- Prof. Lucia Specia has been awarded an EC H2020 funded ERC Starting Grant. The project on Multimodal Context Modelling for Machine Translation (MultiMT) will start on 1 July 2016 for 5 years.
Papers accepted for ACL 2016
- Hawkes Processes for Continuous Time Sequence Classification: an Application to Rumour Stance Classification in Twitter. Michal Lukasik, P. K. Srijith, Duy Vu, Kalina Bontcheva, Arkaitz Zubiaga, Trevor Cohn.
- Metrics for Evaluation of Word-level Machine Translation Quality Estimation. Varvara Logacheva, Michal Lukasik and Lucia Specia.
Papers accepted for TSD2016:
- Automatic Restoration of Diacritics for Igbo Language . Ignatius Ezeani, Mark Hepple and Ikechukwu Onyenwe.
- Predicting Morphologically-Complex Unknown Words in Igbo. Ikechukwu Onyenwe and Mark Hepple
- Paper nominated for Best Paper Award at WebSci 2016: Miriam Fernandez, Harith Alani, Lara Piccolo, Christoph Meili, Diana Maynard and Meia Wippoo. Talking Climate Change via Social Media: Communication, Engagement and Behaviour, May 22-25 2016, Hannover, Germany.
- Diana Maynard taught a 3-hour practical tutorial at the AI Seminar on Social Media Content Analysis, UPC Barcelona, 9-13 May 2016.
- Leon Derczynski is co-organising a workshop on Noisy User-generated Text (WNUT) at COLING in Osaka, Japan, 10th December 2016.
- Diana Maynard will teach two 6-hour courses, "Introduction to NLP" and "Practical social media and sentiment analysis" at the University of Essex Big Data and Analytics Summer School in September 2016. http://www.essex.ac.uk/iads/events/summer-school.aspx
- Andreas Vlachos will be speaking at the Lisbon Machine Learning Summer School about imitation learning for structured prediction.
- Andreas Vlachos will be speaking at the Knowledge Representation Workshop at the University of Liverpool on 28th June 2016.
- Paper: Noise reduction and targeted exploration in imitation learning for Abstract Meaning Representation parsing. James Goodman, Andreas Vlachos and Jason Naradowsky. ACL 2016.
- Paper: Emergent: A novel data-set for stance classification. William Ferreira and Andreas Vlachos. NAACL 2016.
- Paper: Large-scale Multitask Learning for Machine Translation Quality Estimation . Kashif Shah and Lucia Specia. NAACL 2016.
- Paper: Phrase Level Segmentation and Labelling of Machine Translation Errors. Frederic Blain, Varvara Logacheva, and Lucia Specia. In Proc. of Language Resources and Evaluation Conference (LREC), May 2016, Portoroz, Slovenia
- Paper: Challenges of Evaluating Sentiment Analysis Tools on Social Media. Diana Maynard and Kalina Bontcheva. In Proc. of Language Resources and Evaluation Conference (LREC), May 2016, Portoroz, Slovenia
- Paper: Complementarity, F-score, and NLP Evaluation. Leon Derczynski. In Proc. of Language Resources and Evaluation Conference (LREC), May 2016, Portoroz, Slovenia
- Paper: GATE-Time: Extraction of Temporal Expressions and Events Leon Derczynski, Jannik Strötgen, Diana Maynard, Mark A. Greenwood, Manuel Jung. In Proc. of Language Resources and Evaluation Conference (LREC), May 2016, Portoroz, Slovenia
- Dr. Diana Maynard has been awarded a grant for a fully-funded 4-year PhD student project by the Grantham Centre for Sustainable Futures, to start in October 2016, on the topic of disaster relief reporting and climate change. The Grantham Scholar will be supervised by Diana Maynard and co-supervised by Prof. Jacqueline Harrison from the Dept of Journalism and Prof. Shaun Quegan from the Centre for Terrestrial Carbon Dynamics.
- The next annual GATE training course will be held from 6-10 June 2016.
- Mark Stevenson was awarded a grant from Defence Science and Technology Laboratory: "Hypothesis Generation and Visualisation from Data"
- Paper: A Graph-based Approach to Topic Clustering for Online News. Ahmet Aker, Emina Kurtic, Balamurali Andiyakkal Rajendran, Monica Paramita, Emma Barker, Mark Hepple and Rob Gaizauskas. ECIR 2016.
- Paper: Automated Content Analysis: A Sentiment Analysis on Malaysian Government Social Media. Siti Salwa Hasbullah and Diana Maynard. In Proc. of ACM International Conference on Ubiquitous Information Management and Communication (IMCOM), January 2016, Danang, Vietnam.
- The COMRADES project has started. A 3 year EC H2020 project from 1 Jan'16 - 31 Dec'18. The University of Sheffield PI is Prof. Kalina Bontcheva
- We are pleased to announce two new NLP Professors: Kalina Bontcheva and Lucia Specia have both been promoted to Personal Chair.
- A piece was published in the Guardian technology blog on Tuesday 8.12.2015 on our work in the EU-funded SENSEI project.
- Tutorial given by Diana Maynard at Search Solutions 2015, British Computer Society, London, November 2015: "Text analysis with GATE"
- Mark Stevenson is co-organising a workshop on Topic Models: Post-processing and Applications at CIKM 2015 with Nikolaos Aletras (UCL), Jey Han Lau (King's College London) and Timothy Baldwin (University of Melbourne).
- Andrés Duque from UNED in Madrid visited the group for 3 months (October - December 2015)
- Paper: Understanding climate change tweets: an open source toolkit for social media analysis. D. Maynard and K. Bontcheva. In Proc. of EnviroInfo 2015, Copenhagen, Sep. 2015.PDF
- Poster: Real-time Social Media Analytics through Semantic Annotation and Linked Open Data. D. Maynard, M. A. Greenwood, I. Roberts, G. Windsor, K. Bontcheva. Proceedings of WebSci 2015, Oxford, UK
- Paper: "Generalised Brown Clustering and Roll-Up Feature Generation". Leon Derczynski, Sean Chester. AAAI 2016.
- We are pleased to announce that Dr. Andreas Vlachos has joined the group from 1 September 2015.
- Paper: Evaluating Topic Representations for Exploring Document Collections. N. Aletras, T. Baldwin, J. Lau and M. Stevenson (to appear), Journal of the Association for Information Science and Technology
- Paper: Exploring Relation Types for Literature-based Discovery. J. Preiss, M. Stevenson and R. Gaizauskas. (to appear), Journal of the American Medical Informatics Association.
- Paper: Why are these similar? Investigating item similarity types in a large Digital Library. A. Gonzalez-Agirre, N. Aletras, G. Rigau, M. Stevenson and E. Agirre. (to appear), Journal of the Association for Information Science and Technology
- Paper: Cognitive Styles within an Exploratory Search System for Digital Libraries. P. Goodale, P. Clough, S. Fernando, N. Ford and M. Stevenson (2014), Journal of Documentation, 70(6):970-996.
- Paper: Improving Distant Supervision using Inference Learning. R. Roller, E. Agirre, A. Soroa and M. Stevenson (2015). In Proceedings of the 53rd Annual Meeting of the Association for Computational Lingusitics and the 7th International Conference on Natural Language Processing of the Asican Federation of Natural Language Processing (ACL-IJCNLP 2015), Beijing, China.
- Paper: A Hybrid Distributional and Knowledge-based Model of Lexical Semantics. N. Aletras and M. Stevenson (2015). In Proceedings of the Fourth Joint Conference on Lexical and Computational Semantics, pages 20--29, Denver, Colorado
- Paper: Investigating Continuous Space Language Models for Machine Translation Quality Estimation. Kashif Shah, Raymond W. M. Ng, Fethi Bougares and Lucia Specia. EMNLP, 2015 (To Appear)
- Paper: SHEF-NN: Translation Quality Estimation with Neural Networks. Kashif Shah, Varvara Logacheva, Gustavo Paetzold, Frédéric Blain, Daniel Beck, Fethi Bougares and Lucia Specia. WMT, 2015 (To Appear)
- Paper: A study on the stability and effectiveness of features in quality estimation for spoken language translation. Raymond W. M. Ng, Kashif Shah, Lucia Specia and Thomas Hain. Interspeech, 2015.
- Paper: Quality estimation for ASR K-best list rescoring in spoken language translation. Raymond W. M. Ng, Kashif Shah, Wilker Aziz, Lucia Specia and Thomas Hain. ICASSP, 2015.
- Article: A Bayesian non-linear method for feature selection in machine translation quality estimation Kashif Shah, Trevor Cohn and Lucia Specia. Journal of Machine Translation, 2015.
- The Pheme project is co-supporting Clinical TempEval again in 2016, a shared evaluation task with the NIH THYME project and Harvard Children's Hospital, which will run at SemEval.
- Special issue on "Time and Information Retrieval" in the Information Processing & Management journal was published, with Leon Derczynski as lead guest editor.
- Martin Leginus from Aalborg University, co-supervised by Leon Derczynski, won the Best Student Paper award at WEBIST with his work improving tag clouds using entity disambiguation in streams.
- Sean Chester from Aarhus University will visit and give a seminar in late September.
- Book deal signed with O'Reilly on Temporal Information Processing for Language, by Leon Derczynski working with James Pustejovsky and Marc Verhagen (both from Brandeis).
- Our entry in the W-NUT entity recognition challenge in tweets won 3rd place for untyped entity recognition.
- Paper: Extracting Relations Between Non-Standard Entities using Distant Supervision and Imitation Learning.Isabelle Augenstein, Andreas Vlachos, Diana Maynard. EMNLP 2015.
- Article: Distantly Supervised Web Relation Extraction for Knowledge Base Population. Isabelle Augenstein, Diana Maynard, Fabio Ciravegna. Semantic Web Journal.
- Tutorial with Barry Norton at ESWC Summer School 2015: "Information Extraction with Linked Data"
- Article from the group published in the journal Information Processing and Management: Leon Derczynski, Diana Maynard, Giuseppe Rizzo, Marieke van Erp, Genevieve Gorrell, Raphaël Troncy, Johann Petrak, Kalina Bontcheva. 2015. Analysis of Named Entity Recognition and Linking for Tweets.
- Paper presented at the SemEval workshop: Steven Bethard, Leon Derczynski, Guergana Savova, James Pustejovsky, Marc Verhagen. 2015. SemEval-2015 Task 6: Clinical TempEval.
- Paper presented at the SemEval workshop: Fatih Uzdilli, Martin Jaggi, Dominic Egger, Pascal Julmy, Leon Derczynski, Mark Cieliebak. 2015. Swiss-Chocolate: Combining Flipout Regularization and Random Forest with Artificially Built Subsystems to Boost Text-Classification for Sentiment.
- Paper from the group presented at the SemEval workshop: Hegler Tissot, Genevieve Gorrell, Angus Roberts, Leon Derczynski, Marcos Didonet del Fabro. 2015. UFPRSheffield: Contrasting Rule-based and Support Vector Machine Approaches to Time Expression Identification in Clinical TempEval.
- Book chapter form the group to appear in The Handbook of Linguistic Annotation (edited by Nancy Ide and James Pustejovsky): Kalina Bontcheva, Leon Derczynski, Ian Roberts. 2015. Crowdsourcing Named Entity Recognition and Entity Linking Corpora.
- Paper from the group presented at the ISA-11 workshop: Hegler Tissot, Angus Roberts, Leon Derczynski, Genevieve Gorrell, Marcos Didonet del Fabro. 2015. Analysis of Temporal Expressions Annotated in Clinical Notes.
- Paper presented at the WEBIST conference: Martin Leginus, Leon Derczynski, Peter Dolog. 2015. Enhanced Information Access to Social Streams through Word Clouds with Entity Grouping.
- Paper from the group at the W-NUT workshop: Leon Derczynski, Isabelle Augenstein, Kalina Bontcheva. 2015. USFD: Twitter NER with Drift Compensation and Linked Data.
- Diana Maynard will give a Tutorial on "Practical Sentiment Analysis" at Essex University Summer School on Big Data and Analytics, 24-28 August 2015
- Book chapter publication. Diana Maynard and Jonathon Hare. Entity-based Opinion Mining from Text and Multimedia. In "Advances in Social Media Analysis", Mohamed Gaber, Nirmalie Wiratunga, Ayse Goker, and Mihaela Cocea (eds.) 2015, Springer.
- Diana Maynard gave a keynote speech at 5th International Conference on Web Intelligence, Mining and Semantics (WIMS), July 13-15, 2015, Cyprus. "What you Tweet is What You Get: challenges and opportunities for social media analysis in industry"
- The annual GATE training course was held in Sheffield from 8-12 June, with 21 participants.
- Diana Maynard gave a tutorial on "Text Analysis with GATE" at the Reading University Workshop on Big Social Data, 24 April 2015.
- A paper by Roland Roller and Mark Stevenson (Self-supervised Relation Extraction using UMLS) won the best paper award atCLEF 2014
- Paper published in the Journal of Biomedical Informatics: B. McInnes and M. Stevenson (2014) Determining the Difficulty of Word Sense Disambiguation. Journal of Biomedical Informatics, 47:83-90.
- Paper accepted for the journal Studies in the Digital Humanities: M. Hall, P. Goodale, P. Clough and M. Stevenson (2014) The PATHS System for Exploring Digital Cultural Heritage. Studies in the Digital Humanities.
- Paper published in the journal Information Retrieval: M. Hall, S. Fernando, P. Clough, A. Soroa, E. Agirre and M. Stevenson (2014) Evaluating hierarchical organisation structures for exploring digital libraries. Information Retrieval 17(4):351-379.
- Paper accepted for the journal Science of Computer Programming M. Shahbaz, P. McMinn and M. Stevenson (2014) Automatic generation of valid and invalid test data for string validation routines using web searches and regular expressions. Science of Computer Programming.
- Paper from the group published at ACL 2014: N. Aletras and M. Stevenson (2014) Labelling Topics using Unsupervised Graph-based Methods. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL 2014), pages 631--636, Baltimore, Maryland
- Paper from the group published at Digital Libraries 2014: N. Aletras, T. Baldwin, J. Lau and M. Stevenson (2014) Representing Topics Labels for Exploring Digital Libraries. In Digital Libraries 2014 (ACM/IEEE Joint Conference on Digital Libraries (JCDL 2014) and International Conference on Theory and Practice of Digital Libraries (TPDL 2014), London, UK
- Paper from the group published at EACL 2014: N. Aletras and M. Stevenson (2014) Measuring the Similarity between Automatically Generated Topics. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pages 22--27, Gothenburg, Sweden
Papers from the group published at EMNLP 2014:
- Wilker Aziz and Lucia Specia. 2014. Exact Decoding for Phrase-Based Statistical Machine Translation. EMNLP, Doha.
- Daniel Beck, Trevor Cohn and Lucia Specia. 2014. Joint Emotion Analysis via Multi-task Gaussian Processes. EMNLP, Doha.
- Kashif Shah, Trevor Cohn and Lucia Specia. 2014. A Bayesian non-Linear Method for Feature Selection in Machine Translation Quality Estimation. Machine Translation.
- The University of Sheffield (Sheffield NLP Group) was ranked 3rd in the list of institutions that have published the most LREC papers.
- The Clinical TempEval exercise will run at SemEval 2015, a collaboration between researcher at Brandeis University, U. Alabama Birmingham and Leon Derczynski for the University of Sheffield
- Leon Derczynski will give two guest lectures at a course on Network Science and online Social Network Analysis at Uppsala Universitet in May
Members of the group have chapters in 2 new books:
- Documenting Contemporary Society by Preserving Relevant Information from Twitter In 'Twitter and Society', edited by K. Weller, A. Bruns, J. Burgess, M. Mahrt and C. Puschmann, 2014. T. Risse, W. Peters, P. Senellart, D. Maynard
- Crowdsourcing Named Entity Recognition and Entity Linking Corpora in "The Handbook of Linguistic Annotation" edited by Nancy Ide & James Pustejovsky. Kalina Bontcheva, Leon Derczynski, Ian RobertsMatteo Magnani and Leon Derczynski will teach a week-long course at ESSLLI 2014 in Tubingen in August, on "Human Information Networks"
We have 2 demos accepted at EACL 2014:
- The GATE Crowdsourcing Plugin: Crowdsourcing Annotated Corpora Made Easy Kalina Bontcheva, Ian Roberts and Leon Derczynski
- DKIE: Open Source Information Extraction for Danish Leon Derczynski, Camilla Vilhelmsen Derczynski Field, Kenneth Sejdenfaden Bøgh
The group have 6 papers accepted at LREC 2014
- Corpus Annotation through Crowdsourcing: Towards Best Practice Guidelines Marta Sabou, Kalina Bontcheva, Leon Derczynski, Arno Scharl
- An efficient and user-friendly tool for machine translation quality estimation Kashif Shah, Marco Turchi, Lucia Specia
- Who cares about sarcastic tweets? Investigating the impact of sarcasm on sentiment analysis Diana Maynard
- Bilingual dictionaries for all EU languages, LREC Ahmet Aker, Monica Paramita, Marcis Pinnis, Robert Gaizauskas
- Bootstrapping Term Extractors for Multiple Languages Ahmet Aker, Monica Paramita, Emma Barker, Robert Gaizauskas
- Spatio-temporal grounding of claims made on the web, in Pheme Leon Derczynski, Kalina Bontcheva
- A paper is accepted in JASIST journal: Generating Descriptive Multi-Document Summaries of Geo-Located Entities Using Entity Type Models. JASIST Ahmet Aker, Robert Gaizauskas
- The PHEME project has started. A 3 year EC FP7 project from 1 Jan'14 - 31 Dec'16 with 9 partners worth a total of € 4,269,938 with an EC contribution of € 2,916,000. The University of Sheffield PI is Dr Kalina Bontcheva
Three full papers from the group have been accepted at RANLP 2013, to be held in the spa town of Hisarya, Bulgaria
- "Twitter Part-of-Speech Tagging for All: Overcoming Sparse and Noisy Data" Derczynski, L., Ritter, A., Clarke, S. & Bontcheva, K.
- "Recognising and Interpreting Named Temporal Expressions" M. Brucato, M., Derczynski, L., Llorens, H., Bontcheva, K. & Jensen, C.S.
- "TwitIE: A Fully-featured Information Extraction Pipeline for Microblog Text" Bontcheva, K., Derczynski, L., Funk, A., Greenwood, M.A., Maynard, D. & Aswani, N.
- The group has had a discussion paper accepted at the International Conference on the Theory of Information Retrieval: "Information Retrieval for Temporal Bounding" Derczynski, L. & Gaizauskas, R.
2 short papers & 3 demonstrations have been accepted by the group at ACL 2013
- "Reducing Annotation Effort for Quality Estimation via Active Learning" Beck, D., Specia, L. & Cohn, T.
- "Temporal Signals Help Label Temporal Relations" Derczynski, L. & Gaizauskas, R.
- "QuEst - A translation quality estimation framework" Specia, L., Shah, K., Guilherme Camargo de Souza, J. & Cohn, T.
- "PATHS: A System for Accessing Cultural Heritage Collections" Agirre, E., Aletras, N., Clough, P., Fernando, S., Goodale, P., Hall, M., Soroa, A. & Stevenson, M.
- "AnnoMarket: An Open Cloud Platform for NLP" Bontcheva, K., Tablan, V., Roberts, I., Cunningham, H. & Dimitrov, M.
- Two out of the three nominations for the ACM SIGWEB Ted Nelson prize at Hypertext 2013, Paris are both from Sheffield's NLP group. (link)
5 papers by the group accepted at ACL 2013
- "Extracting bilingual terminologies from comparable corpora" Aker, A., Paramita, M. & Gaizauskas, R.
- "An Infinite Hierarchical Bayesian Model of Phrasal Translation" Cohn, T. & Haffari, G.
- "Modelling Annotator Bias with Multi-task Gaussian Processes: An Application to Machine Translation Quality Estimation" Cohn, T & Specia, L.
- "Markov Translation using Non-parametric Bayesian Inference" Feng, Y. & Cohn, T.
- "A user-centric model of voting intention from Social Media" Lampos, V., Preotiuc-Pietro, D. & Cohn, T.
3 papers by the group accepted for NAACL 2013
- "Representing Topics Using Images" Aletras, N. and Stevenson, M.
- "Unsupervised Domain Tuning to Improve Word Sense Disambiguation" Preiss, J. and Stevenson, M.
- "DALE: A Word Sense Disambiguation System for Biomedical Documents Trained using Automatically Labeled Examples (demo)" Preiss, J. and Stevenson, M.
- The ForgetIT: Concise Preservation by combining Managed Forgetting and Contextualized Remembering project has started. A 3 year EC FP7 project from 1 Feb'13 - 31 Jan'16. The project has 11 partners worth a total of € 9,085,190 with an EC contribution of € 6,590,000. The University of Sheffield PI is Prof. Hamish Cunningham
- The VisualSense: Tagging visual data with semantic descriptions project has started. A 3 year EPSRC project from 1 Jan'13 - 31 Dec'15. The project has 4 partners and is part of the Chist-Era EC funding programme. The University of Sheffield PI is Prof. Rob Gaizauskas
Older news stories
22nd June 2017 Nikola Mrksic (University of Cambridge) - Neural Belief Tracker: Data-Driven Dialogue State Tracking using Semantically Specialised Vector Spaces
One of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user's goal at every step of the dialogue. However, most current approaches have difficulty scaling to larger, more complex dialogue domains. This is due to their dependency on either: a) Spoken Language Understanding models that require large amounts of annotated training data; or b) hand-crafted lexicons for capturing some of the linguistic variation in users' language. We propose a novel Neural Belief Tracking (NBT) framework which overcomes these problems by building on recent advances in representation learning. NBT models reason over pre-trained, semantically specialised word vectors, learning to compose them into distributed representations of user utterances and dialogue context. Our evaluation on two datasets shows that this approach surpasses past limitations, matching the performance of state-of-the-art models which rely on hand-crafted semantic lexicons and outperforming them when such lexicons are not provided. Finally, we will discuss how the properties of underlying vector spaces impact model performance, and how the fact that the proposed model operates purely over word vectors allows immediate deployment of belief tracking models for other languages.
2016 - 2017
8th June 2017 Dirk Hovy (University of Copenhagen) -
1st June 2017 Ondrej Dusek (Charles University Prague) -
11th May 2017 PhD Student Talks
4th May 2017 Julie Weeds (University of Sussex) -
30th March 2017 Yannis Konstas (University of Washington) -
23rd March 2017 Sebastian Reidel (University College London) -
16th March 2017 Joachim Bingel (University of Copenhagen) -
9th March 2017 Marek Rei (University of Cambridge) -
16th February 2017 Pranava Madhyastha (The University of Sheffield) -
26th January 2017 Marco Turchi (Fondazione Bruno Kessler) -
8th December 2016 PhD student talks
1st December 2016 Francesca Toni, Imperial College London - From computational argumentation to relation-based argument mining.
- In this talk I will overview foundations, tools and (some) applications of computational argumentation, focusing on three popular frameworks, namely Abstract Argumentation, Bipolar Argumentation and Quantitative Argumentation Debates (QuADs). These frameworks can be supported by and support the mining of attack/support relations amongst arguments. Moreover, I will discuss the following questions: is the use of quantitative measures of strength of arguments, as proposed e.g. for QuADs, a good way to assess the dialectical strength of arguments mined from text or the goodness of argument mining techniques?
24th November 2016 Mikel Forcada, Universitat d'Alacant (Spain) - Gap-filling as a method to evaluate the usefulness of raw machine translation.
- Most machine translation is consumed raw by ordinary people wanting to make sense of text in languages they cannot understand, for a variety of purposes. In contrast, while subjective judgements of machine translation quality (fluency, adequacy) have been commonplace for decades, surprisingly very little research has addressed the evaluation of the actual usefulness of raw machine-translated text - and almost none about the actual way in which readers make sense of it. Direct evaluation is costly as it has to look into the success of machine-translation-mediated tasks. After a quick review of existing indirect approaches, I describe a possible low-cost method to indirectly evaluate the comprehension of machine-translated text by target-language monolinguals, which may effectively be seen as a simplification -and perhaps a generalization- of reading comprehension tests based on questionnaires. Readers of machine-translated excerpts are asked to fill word gaps in a professional translation of the same excerpt. Word gaps can be ______ anywhere in the reference _______, but preferably at content _______. Results of preliminary gap-filling evaluation work are critically reviewed, and suggestions for future research are outlined.
17th November 2016 Gerasimos Lampouras , University of Sheffield - Imitation learning for language generation from unaligned data.
- Natural language generation (NLG) is the task of generating natural language from a meaning representation. Rule-based approaches require domain-specific and manually constructed linguistic resources, while most corpus based approaches rely on aligned training data and/or phrase templates. The latter are needed to restrict the search space for the structured prediction task defined by the unaligned datasets. In this work we propose the use of imitation learning for structured prediction which learns an incremental model that handles the large search space while avoiding explicitly enumerating it. We adapted the Locally Optimal Learning to Search framework which allows us to train against non-decomposable loss functions such as the BLEU or ROUGE scores while not assuming gold standard alignments. We evaluate our approach on three datasets using both automatic measures and human judgements and achieve results comparable to the state-of-the-art approaches developed for each of them. Furthermore, we performed an analysis of the datasets which examines common issues with NLG evaluation.
3rd November 2016 Mark-Jan Nederhof , University of St Andrews - Transition-based dependency parsing as latent-variable constituent parsing.
- We provide a theoretical argument that a common form of projective transition-based dependency parsing is less powerful than constituent parsing using latent variables. The argument is a proof that, under reasonable assumptions, a transition-based dependency parser can be converted to a latent-variable context-free grammar producing equivalent structures.
26th October 2016 Barbara Plank , University of Groningen - What to do about non-canonical data in Natural Language Processing.
- Real world data differs radically from the benchmark corpora we use in natural language processing (NLP). As soon as we apply our technology to the real world, performance drops. The reason for this problem is obvious: NLP models are trained on samples from a limited set of canonical varieties that are considered standard, most prominently English newswire. However, there are many dimensions, e.g., socio- demographics, language, genre, sentence type, etc. on which texts can differ from the standard. The solution is not obvious: we cannot control for all factors, and it is not clear how to best go beyond the current practice of training on homogeneous data from a single domain and language.
In this talk, I review the notion of canonicity, and how it shapes our community's approach to language. I argue for the use of fortuitous data. Fortuitous data is data out there that just waits to be harvested. It might be in plain sight, but is neglected (available but not used), or it is in raw form and first needs to be refined (almost ready). It is the unintended yield of a process, or side benefit. Examples include hyperlinks to improve sequence taggers, or annotator disagreement that contains actual signal informative for a variety of NLP tasks. More distant sources include the side benefit of behavior. For example, keystroke dynamics have been extensively used in psycholinguistics and writing research. But do keystroke logs contain actual signal that can be used to learn better NLP models? In this talk I will present recent (on-going) work on keystroke dynamics to improve shallow syntactic parsing. I will also present recent work on using bi-LSTMs for POS tagging, which combines the POS tagging loss function with an auxiliary loss function that accounts for rare words and achieves state-of-the-art performance across 22 languages.
20th October 2016 Leon Derczynski , University of Sheffield - Building a Diverse Named Entity Recognition Resource.
- This talk presents a new benchmark in corpus construction methodology. One of the main obstacles, hampering method development and comparative evaluation of named entity recognition in social media, is the lack of a sizeable, diverse, high quality annotated corpus, analogous to the CoNLL'2003 news dataset. For instance, the biggest Ritter tweet corpus is only 45 000 tokens - a mere 15% the size of CoNLL'2003. Another major shortcoming is the lack of temporal, geographic, and author diversity. This paper introduces the Broad Twitter Corpus (BTC), which is not only significantly bigger, but sampled across different regions, temporal periods, and types of Twitter users. The gold-standard named entity annotations are made by a combination of NLP experts and crowd workers, which enables us to harness crowd recall while maintaining high quality. We also measure the entity drift observed in our dataset (i.e. how entity representation varies over time), and compare to newswire. The corpus is released openly, including source text and intermediate annotations.
13th October 2016 Isabelle Augenstein , University College London - Weakly Supervised Machine Reading.
- The state of the art in natural language processing for high-level end user tasks has advanced to a point where are seeing more and more usable commercial applications. These include question answering and dialogue systems such as Google Now or Amazon Echo. One of the things that is crucial for building such applications is to automatically understand text, which is also known as machine reading. In this talk, I will highlight methods for different components of machine reading, namely representation learning, structured prediction and automatically generating training data. I will then present ongoing research of applying these techniques to the tasks of sentiment analysis, semantic error correction and question answering.
6th October 2016 Sumithra Velupillai, King's College London and KTH Sweden - Extracting temporal information from clinical narratives: existing models, approaches - and challenges for the mental health domain
- Accurately extracting temporal information from clinical documentation is crucial for understanding e.g. disease progression and treatment effects. In addition to time-stamped and other structured information in electronic health records, temporal information is conveyed in narrative form. Although techniques for extracting events such as symptoms ("anxiety") and treatments ("Xanax"), time expressions ("May 1st") and time relations ("anxiety before Xanax") from clinical notes have been developed in the Natural Language Processing community with promising results in the past few years, most studies have been performed on heterogeneous clinical specialties and use-cases. Mental health documentation poses several unique challenges, one of which will be addressed in my project on extracting symptom and treatment onset for psychosis patients, to better understand duration of untreated psychosis. In this talk, I will describe my previous work on automated extraction of temporal expressions from clinical text using the clearTK package, a framework for machine learning and NLP with UIMA. I will also describe other state-of-the-art approaches for temporal reasoning in clinical text, and discuss challenges involved in applying and adapting these for extracting onset information from mental health records.
29th September 2016 Savelie Cornegruta , King's College London.
- Timeline extraction using distant supervision and joint inference.
In timeline extraction the goal is to order the events in which a target entity is involved in a timeline. Due to the lack of explicitly annotated data, previous work is rule-based and uses temporal linking systems trained on previously annotated data. Instead, we propose a distantly supervised approach by heuristically aligning timelines with documents. The noisy training data created allows us to learn models that anchor events to temporal expressions and entities; during testing, the predictions of these models are combined to produce the timeline. Furthermore, we show how to improve performance using joint inference.
- Modelling Radiological Language with Bidirectional Long Short-Term Memory Networks
Motivated by the need to automate medical information extraction from free-text radiological reports, we present a bi-directional long short-term memory (BiLSTM) neural network architecture for modelling radiological language. The model has been used to address two tasks, medical named-entity recognition and negation detection. We further investigate whether learning several types of word embeddings improved the performance on BiLSTM on those tasks. Using a dataset of chest x-ray reports, we show that the BiLSTM model outperforms a baseline rule-based system on the NER task while for the negation detection it approaches the performance of a hybrid system that leverages the hand-crafted rules of the NegEx algorithm and the grammatical relations obtained from the Stanford Dependency Parser.
16th September 2016 Philip Schulz, University of Amsterdam - Word Alignment with NULL workds
- Most existing word alignment models assume that source words that do not have a lexical translation in the target language were generated from a hypothetical target NULL word. This NULL word is assumed to exist in any target sentence. From a modeling perspective this is unsatisfactory since our linguistic knowledge tells us that untranslatable source word (e.g. certain prepositions) are required by the source context in which they are found. Moreover, the NULL word does have a position in the target sentence and thus troubles distortion-based alignment models by influencing their distortion distributions in unexpected ways.
We present a Bayesian word alignment model that does not postulate NULL words. Instead, source words that don't have lexical translations are generated from the source context. In the final alignment step, such source words are left unaligned. This leads to more informed distributions over unaligned words because these distributions are now conditioned on source contexts. Our model is also general enough to incorporate different distortion models. Finally, we have developed a fast auxiliary variable Gibbs sampler that makes our model competitive with existing models in terms of training time.
After having presented our alignment model I will shortly discuss plans to extend it to a probabilistic phrase extraction model for machine translation.
8th September 2016 Mikel Forcada, Universitat d'Alacant (Spain) - Towards an effort-driven combination of translation technologies in computer-aided translation
- The talk puts forward a general framework for the measurement and estimation of professional translation effort in computer-aided translation. It then outlines the application of this framework to optimize and seamlessly combine available translation technologies in a principled manner to reduce professional translation effort.
NLP Reading Group
The target audience is all the members of the NLP group and other possible interested participants.
The meeting will take place weekly for one hour usually on Tuesdays from 11-12pm.
The meetings of the group will be informal and no necessary preparation will be required with the exception of the moderator reading the current paper and the rest having at least a brief overview of it.
Tuesday 27 June 2017
Generation and Comprehension of Unambiguous Object Descriptions
Junhua Mao, Jonathan Huang, Alexander Toshev, Oana Camburu, Alan Yuille, Kevin Murphy
Tuesday 20 June 2017
Understanding the BPE algorithm
Tuesday 13 June 2017
Sequence-to-Sequence Models Can Directly Transcribe Foreign Speech
Ron J. Weiss, Jan Chorowski, Navdeep Jaitly, Yonghui Wu, Zhifeng Chen
Tuesday 6 June 2017
Covonlutional Sequence to Sequence Learning
Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann N. Dauphin
Tuesday 30 May 2017
Program Induction by Rationale Generation:Learning to Solve and Explain Algebraic Word Problems
Wang Ling, Dani Yogatama, Chris Dyer, Phil Blunsom
Tuesday 9 May 2017
Chatterjee et al.: Online Automatic Post-editing for MT in a Multi-Domain Translation Environment
Tuesday 6 May 2017
Convolutional Sequence to Sequence Learning
Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann N. Dauphin
Tuesday 2 May 2017
Coarse-to-Fine Question Answering for Long Documents
Tuesday 25 April 2017
Re-evaluating Automatic Metrics for Image Captioning
Mert Kilickaya, Aykut Erdem, Nazli Ikizler-Cinbis, Erkut Erdem
Tuesday 18 April 2017
Neural Tree Indexers, EACL2017
Tuesday 11 April 2017
Tuesday 4 April 2017
Shakir Mohammed's deep learning overview
Tuesday 28 March 2017
Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond
Tuesday 21 March 2017
Unsupervised AMR-Dependency Parse Alignment
Tuesday 14 March 2017
Kim et al. (2016): Examples are not Enough, Learn to Criticize! Criticism for Interpretability, NIPS 2016
Tuesday 7 March 2017
Latent Variable Dialogue Models and their Diversity
Kris Cao and Stephen Clark
Tuesday 28 February 2017
Zhang et al. EACL2017
Tuesday 21 February 2017
Structured Attention Networks
Tuesday 14 February 2017
CORE: Context-Aware Open Relation Extraction with Factorization Machines
by Fabio Petroni, Luciano Del Corro and Rainer Gemulla
Tuesday 7 February 2017
Adversarial Training Methods for Semi-Supervised Text Classification
Takeru Miyato, Andrew, M.Dai, Ian Goodfellow
Tuesday 31 January 2017
Learning to Prune: Exploring the Frontier of Fast and Accurate Parsing
Tim Vieira and Jason Eisner
Tuesday 24 January 2017
Matching Networks for One Shot Learning
Oriol Vinyals, Charles Blundell, Tim Lillicrap, Koray Kavukcuoglu, Daan Wierstra
Tuesday 17 January 2017
Learning Structured Predictors from Bandit Feedback for Interactive NLP. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL). Berlin, Germany
Artem Sokolov, Julia Kreutzer, Christopher Lo, Stefan Riezler
Tuesday 13 December 2016
Optimization and Sampling for NLP from a Unified Viewpoint
Marc Dymetman, Guillaume Bouchard, Simon Carter
Tuesday 6 December 2016
Matrix Completion has No Spurious Local Minimum
Rong Ge, Jason D. Lee, Tengyu Ma
Tuesday 29 November 2016
Compositional Semantic Parsing on Semi-Structured Tables
Panupong Pasupat and Percy Liang
Tuesday 22 November 2016
Minimum Risk Training for Neural Machine Translation
Shiqi Shen, Yong Cheng, Zhougjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu
Tuesday 15 November 2016
Generation from Abstract Meaning Representation using Tree Transducers
Jeffrey Flanigan, Chris Dyer, Noah A. Smith and Jaime Carbonell
Tuesday 1 November 2016
Visual Representations for Topic Understanding and Their Effects on Manually Generated Labels Transactions of the Association for Computational Linguistics, 2016.
Alison Smith, Tak Yeon Lee, Forough Poursabzi-Sangdeh, Leah Findlater, Jordan Boyd-Graber, and Niklas Elmqvist
Tuesday 25 October 2016
Learning to Search Better than your Teacher
Chang et al. ICML 2015
Tuesday 11 October 2016
A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task
Danqi Chen, Jason Bolton, Christopher D. Manning
Tuesday 4 October 2016
Ultradense Word Embeddings by Orthogonal Transformation
Sascha Rothe, Sebastian Ebert, Hinrich Schütze
Tuesday 7 June 2016
Not All Character N-grams Are Created Equal: A Study in Authorship Attribution.
Upendra Sapkota, Steven Bethard, Manuel Montes-y-Gómez & Thamar Solorio (2015)
Tuesday 31 May 2016
Relation extraction with matrix factorization and universal schemas.
Riedel, S., Yao, L., McCallum, A., & Marlin, B. M. (2013)
Tuesday 10 May 2016
Training Deterministic Parsers with Non-Deterministic Oracles, TACL
Goldberg, Y. and Nivre, J. (2013)
Tuesday 3 May 2016
A New Corpus and Imitation Learning Framework for Context-Dependent Semantic Parsing
Vlachos, A. and Clark, S.
Tuesday 22 April 2016
Sequence Level Training with recurrent Neural Networks
Marc'Aurelio Ranzato, Sumit Chopra, Michael Auli, Wojciech Zaremba
Tuesday 22 March 2016
"Distributed Representation of Sentences and Documents"
Quoc Le and Tomas Mikolov
Tuesday 8 March 2016
AutoExtend: Extending Word Embeddings to Embeddings for Synsets and Lexemes
Sascha Rothe; Hinrich Schütze. ACL2015 (best student paper)
Tuesday 23 February 2016
From Word Embeddings To Document Distances
Kusner et al.
Tuesday 16 February 2016
"Target-Dependent Twitter Sentiment Classification with Rich Automatic Features"
Tuesday 9 February 2016
"Evaluation methods for unsupervised word embeddings"
Tuesday 25 January 2016
Multi-Perspective Sentence Similarity Modeling with Convolutional Neural Networks
Hua He, Kevin Gimpel, and Jimmy Lin. EMNLP2015
Tuesday 19 January 2016
Multilingual Image Description with Neural Sequence Models
Tuesday 12 January 2016
"Improving Distributional Similarity with Lessons Learned from Word Embeddings"
Tuesday 8 December 2015
Using Discourse Structure Improves Machine Translation Evaluation.
F Guzmán, S Joty, L Màrquez, P Nakov
And here are the author's slides
Tuesday 1 December 2015
Practical Bayesian Optimization of Machine Learning Algorithms Advances in Neural Information Processing Systems, 2012
Snoek, J.; Larochelle, H. & Adams, R. P.
Related presentations/lecture slides:
My reading group presentation slides
Tuesday 24 November 2015
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks ACL 2015
LSTMs? Kai Sheng Tai, Richard Socher, Christopher D. Manning
Additional resource about LSTM: "Anyone Can Learn To Code an LSTM-RNN in Python"
Tuesday 17 November 2015
More details on auto encoders for unsupervised pre-training:
Tuesday 10 November 2015
Multi-Metric Optimization Using Ensemble Tuning. NAACL2013. Video
Baskaran Sankaran, Anoop Sarkar and Kevin Duh
Tuesday 3 November 2015
NN tutorials by Quoc Le
Andrej Karpathy's notes
Different objective functions, multiclass problems
Discussion about different activation functions
Tuesday 27 October 2015
Three blog posts introducing RNNs for language modelling in equations and code
might help to read this NLP primer
a thorough explanation of back propagation
Tuesday 20 October 2015
Teaching Machines to Read and Comprehend. NIPS 2015.
Karl Moritz Hermann, Tomáš Kociský, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, Phil Blunsom
Slides (presented at LXMLS)
NAACL 2013 Tutorial "Deep Learning without Magic"
EMNLP 2014 Tutorial "Embedding Methods for NLP"
Entailment with Neural Attention (better description of attention models than in the NIPS paper in my opinion)
Tuesday 13 October 2015
A large annotated corpus for learning natural language inference. Proceedings of EMNLP 2015.
Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning
Should compare this to work on (multilingual) textual similarity