#	Pagina
attuale pagina	/open-h2020/projects/200779/index.html

Opendata, web and dolomites

TransModal SIGNED

Translating from Multiple Modalities into Text

Total Cost €

EC-Contrib. €

Partnership

Views

Outcomes and
results

TransModal project word cloud

Explore the words cloud of the TransModal project. It provides you a very rough idea of what is the project "TransModal" about.

human translation literacy units pair source extensive instantly types accessible readers rife computer natural render textual searched google unsupervised recent engineering databases tools translate code formats translations standard sentiment direct framework read simplifying translating manner enhanced simplify computational familiar data languages modalities images deep corpora individuals otherwise generate language unified accessibility documents web operate documentation correspondence representations query intermediate models retrieve learning summarize linguistic internet wouldn computers mainstream collections fundamental descriptions induce alike matching fifty perform scalable content electronic learners thanks interactions consisting retrieval

Project "TransModal" data sheet

The following table provides information about the project.

Coordinator	THE UNIVERSITY OF EDINBURGH Organization address address: OLD COLLEGE, SOUTH BRIDGE city: EDINBURGH postcode: EH8 9YL website: www.ed.ac.uk contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.
Coordinator Country	United Kingdom [UK]
Project website	https://homepages.inf.ed.ac.uk/mlap/
Total cost	1˙900˙777 €
EC max contribution	1˙900˙777 € (100%)
Programme	1. H2020-EU.1.1. (EXCELLENT SCIENCE - European Research Council (ERC))
Code Call	ERC-2015-CoG
Funding Scheme	ERC-COG
Starting year	2016
Duration (year-month-day)	from 2016-09-01 to 2021-08-31

Partnership

Take a look of project's partnership.

#	participants	country	role	EC contrib. [€]
1	THE UNIVERSITY OF EDINBURGH THE UNIVERSITY OF EDINBURGH Organization address address: OLD COLLEGE, SOUTH BRIDGE city: EDINBURGH postcode: EH8 9YL website: www.ed.ac.uk contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	UK (EDINBURGH)	coordinator	1˙900˙777.00

Map

Project objective

Recent years have witnessed the development of a wide range of computational methods that process and generate natural language text. Many of these have become familiar to mainstream computer users such as tools that retrieve documents matching a query, perform sentiment analysis, and translate between languages. Systems like Google Translate can instantly translate between any pair of over fifty human languages allowing users to read web content that wouldn't have otherwise been available. The accessibility of the web could be further enhanced with applications that translate within the same language, between different modalities, or different data formats. There are currently no standard tools for simplifying language, e.g., for low-literacy readers or second language learners. The web is rife with non-linguistic data (e.g., databases, images, source code) that cannot be searched since most retrieval tools operate over textual data. In this project we maintain that in order to render electronic data more accessible to individuals and computers alike, new types of models need to be developed. Our proposal is to provide a unified framework for translating from comparable corpora, i.e., collections consisting of data in the same or different modalities that address the same topic without being direct translations of each other. We will develop general and scalable models that can solve different translation tasks and learn the necessary intermediate representations of the units involved in an unsupervised manner without extensive feature engineering. Thanks to recent advances in deep learning, we will induce representations for different modalities, their interactions, and correspondence to natural language. Beyond addressing a fundamental aspect of the translation problem, the proposed research will lead to novel internet-based applications that simplify and summarize text, produce documentation for source code, and meaningful descriptions for images.

Publications

List of publications.
year	authors and title	journal	last update
2017	Spandana Gella, Frank Keller, Mirella Lapata Disambiguating Visual Verbs published pages: 1-1, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2017.2786699	IEEE Transactions on Pattern Analysis and Machine Intelligence 27 December 2017	2020-02-07
2017	Xingxing Zhang and Mirella Lapata Sentence Simplification with Deep Reinforcement Learning published pages: 595--605, ISSN: , DOI:	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017	2020-02-07
2017	Jianpeng Cheng, Adam Lopez, and Mirella Lapata A Generative Parser with a Discriminative Recognition Algorithm. published pages: 118--124, ISSN: , DOI:	Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) July, 2017	2020-02-07
2016	Zhang, Xingxing and Lu, Liang and Lapata, Mirella} Top-down Tree Long Short-Term Memory Networks published pages: 310--320, ISSN: , DOI:	Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June, 2016	2020-02-07
2017	Mallinson, Jonathan and Sennrich, Rico and Lapata, Mirella Paraphrasing Revisited with Neural Machine Translation published pages: 881--893, ISSN: , DOI:	Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017	2020-02-07
2018	CARINA SILBERER, JASPER UIJLINGS, MIRELLA LAPATA Understanding visual scenes published pages: 441-465, ISSN: 1351-3249, DOI: 10.1017/s1351324918000104	Natural Language Engineering 24/03	2020-02-07
2017	Cheng, Jianpeng and Dong, Li and Lapata, Mirella Long Short-Term Memory-Networks for Machine Reading published pages: 551--561, ISSN: , DOI:	Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing November, 2016	2020-02-07
2017	Siva Reddy; Oscar TÃ¤ckstrÃ¶m; Slav Petrov; Mark Steedman; Mirella Lapata Universal Semantic Parsing published pages: 89--101, ISSN: , DOI:	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017	2020-02-07
2018	Yang Liu and Mirella Lapata Learning Structured Text Representations. published pages: 63-75, ISSN: 2307-387X, DOI:	Transactions of the Association for Computational Linguistics Vol 6 (2018)	2020-02-07
2017	Dong, Li and Huang, Shaohan and Wei, Furu and Lapata, Mirella and Zhou, Ming and Xu, Ke Learning to Generate Product Reviews from Attributes published pages: 623--632, ISSN: , DOI:	Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017	2020-02-07
2016	Gella, Spandana and Lapata, Mirella and Keller, Frank Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings published pages: 182--192, ISSN: , DOI:	Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June, 2016	2020-02-07
2016	Dong, Li and Lapata, Mirella Language to Logical Form with Neural Attention published pages: 33--43, ISSN: , DOI:	Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016	2020-02-07
2018	Lea Frermann, Shay Cohen, Mirella Lapata Whodunnit? Crime Drama as a Case for Natural Language Understanding published pages: 1-15, ISSN: 2307-387X, DOI:	Transactions of the Association for Computational Linguistics vol 6 (2018)	2020-02-07
2018	Stefanos Angelidis and Mirella Lapata Multiple Instance Learning Networks for Fine-Grained Sentiment Analysis published pages: 17-31, ISSN: 2307-387X, DOI:	Transactions of the Association for Computational Linguistics vol 6 (2018)	2020-02-07
2017	Zhang, Xingxing and Cheng, Jianpeng and Lapata, Mirella Dependency Parsing as Head Selection published pages: 665--676, ISSN: , DOI:	Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017	2020-02-07
2017	Cheng, Jianpeng and Reddy, Siva and Saraswat, Vijay and Lapata, Mirella Learning Structured Natural Language Representations for Semantic Parsing published pages: 44-55, ISSN: , DOI:	Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) July, 2017	2020-02-07
2016	Roth, Michael and Lapata, Mirella Neural Semantic Role Labeling with Dependency Path Embeddings published pages: 1192--1202, ISSN: , DOI:	Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016	2020-02-07
2016	Cheng, Jianpeng and Lapata, Mirella Neural Summarization by Extracting Sentences and Words published pages: 484--494, ISSN: , DOI:	Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016	2020-02-07
2017	Dong, Li and Mallinson, Jonathan and Reddy, Siva and Lapata, Mirella Learning to Paraphrase for Question Answering published pages: 875--886, ISSN: , DOI:	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017	2020-02-07
2016	Lea Frermann, Mirella Lapata A Bayesian Model of Diachronic Meaning Change published pages: 31-45, ISSN: 2307-387X, DOI:	Transactions of the Association for Computational Linguistics vol 4 (2016)	2020-02-07
2017	Liu, Yang and Lapata, Mirella Learning Contextually Informed Representations for Linear-Time Discourse Parsing} published pages: 1289--1298, ISSN: , DOI:	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017	2020-02-07
2016	Siva Reddy, Oscar TÃ¤ckstrÃ¶m, Michael Collins, Tom Kwiatkowski, Dipanjan Das, Mark Steedman, Mirella Lapata Transforming Dependency Structures to Logical Forms for Semantic Parsing published pages: 127-140, ISSN: 2307-387X, DOI:	Transactions of the Association for Computational Linguistics vol 4 (2016)	2020-02-07
2017	Carina Silberer, Vittorio Ferrari, Mirella Lapata Visually Grounded Meaning Representations published pages: 2284-2297, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2016.2635138	IEEE Transactions on Pattern Analysis and Machine Intelligence 39/11	2020-02-07
2017	Gella, Spandana and Sennrich, Rico and Keller, Frank and Lapata, Mirella Image Pivoting for Learning Multilingual Multimodal Representations published pages: 2829--2835, ISSN: , DOI:	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017	2020-02-07
2018	Jiangming Liu, Shay B. Cohen, Mirella Lapata Discourse Representation Structure Parsing published pages: 429â€“439, ISSN: , DOI:	Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)	2020-02-07
2018	Shashi Narayan, Ronald Cardenas, Nikos Papasarantopoulos, Shay B. Cohen, Mirella Lapata, Jiangsheng Yu, Yi Chang Document Modeling with External Attention for Sentence Extraction published pages: 2020â€“2030, ISSN: , DOI:	Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)	2020-02-07
2018	Laura Perez-Beltrachini, Mirella Lapata Bootstrapping Generators from Noisy Data published pages: 1516-1527, ISSN: , DOI: 10.18653/v1/n18-1137	Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)	2020-02-07
2017	Siva Reddy, Oscar TÃ¤ckstrÃ¶m, Slav Petrov, Mark Steedman, Mirella Lapata Universal Semantic Parsing published pages: 89-101, ISSN: , DOI: 10.18653/v1/d17-1009	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing	2020-02-07
2017	Jianpeng Cheng, Siva Reddy, Vijay Saraswat, Mirella Lapata Learning Structured Natural Language Representations for Semantic Parsing published pages: 44-55, ISSN: , DOI: 10.18653/v1/P17-1005	Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)	2020-02-07
2017	Li Dong, Jonathan Mallinson, Siva Reddy, Mirella Lapata Learning to Paraphrase for Question Answering published pages: 875-886, ISSN: , DOI: 10.18653/v1/d17-1091	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing	2020-02-07
2016	Jianpeng Cheng, Li Dong, Mirella Lapata Long Short-Term Memory-Networks for Machine Reading published pages: 551-561, ISSN: , DOI: 10.18653/v1/D16-1053	Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing	2020-02-07
2018	Narayan, Shashi and Cohen, Shay B. and Lapata, Mirella Donâ€™t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization published pages: 1797--1807, ISSN: , DOI:	Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing https://www.aclweb.org/antholog	2020-02-07
2018	Jonathan Mallinson, Rico Sennrich, and Mirela Lapata Sentence Compression for Arbitrary Languages via Multilingual Pivoting published pages: \"2453--2464\"\", ISSN: , DOI:	roceedings of the 2018 Conference on Empirical Methods in Natural Language Processing	2020-02-07
2019	Ratish Puduppully, Li Dong, and Mirella Lapata Data-to-Text Generation with Content Selection and Planning published pages: , ISSN: , DOI:	Proceedings of the 33rd International Joint Conference on Artificial Intelligence	2020-02-07
2017	Jianpeng Cheng, Adam Lopez, Mirella Lapata A Generative Parser with a Discriminative Recognition Algorithm published pages: 118-124, ISSN: , DOI: 10.18653/v1/P17-2019	Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)	2020-02-07
2018	Dong, Li; Quirk, Chris; Lapata, Mirella Confidence Modeling for Neural Semantic Parsing published pages: 743â€“753, ISSN: , DOI:	Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)	2020-02-07
2018	Philip John Gorinski, Mirella Lapata Whatâ€™s This Movie About? A Joint Neural Network Architecture for Movie Content Analysis published pages: 1770-1781, ISSN: , DOI: 10.18653/v1/n18-1160	Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)	2020-02-07
2018	Xingxing Zhang and Mirella Lapata and Furu Wei, and Ming Zhou Neural Latent Extractive Document Summarization. published pages: 779--784., ISSN: , DOI:	Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing	2020-02-07
2017	Spandana Gella, Rico Sennrich, Frank Keller, Mirella Lapata Image Pivoting for Learning Multilingual Multimodal Representations published pages: 2839-2845, ISSN: , DOI: 10.18653/v1/D17-1303	Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing	2020-02-07
2018	Dong, Li; Lapata, Mirella Coarse-to-Fine Decoding for Neural Semantic Parsing published pages: 731â€“742, ISSN: , DOI:	Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)	2020-02-07
2018	Narayan, Shashi; Cohen, Shay B.; Lapata, Mirella Don\'t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization published pages: , ISSN: , DOI: 10.5281/zenodo.2399762	Narayan , S , Cohen , S & Lapata , M 2018 , Don\'t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization . in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Brussels, Belgium , pp. 1797-1807 , 2018 Conference on Empirical Methods in Natural Language Processing , Brussels , Belgium , 31/10/18 . 7	2020-02-07
2018	Cheng, Jianpeng; Lapata, Mirella Weakly-supervised Neural Semantic Parsing with a Generative Ranker published pages: 356â€“367, ISSN: , DOI:	Proceedings of the 22nd Conference on Computational Natural Language Learning	2020-02-07
2019	Jianpeng Cheng, Siva Reddy, Vijay Saraswat, Mirella Lapata Learning an Executable Neural Semantic Parser published pages: 59-94, ISSN: 0891-2017, DOI: 10.1162/coli_a_00342	Computational Linguistics 45/1	2020-02-07
2018	Shashi Narayan, Shay B. Cohen, Mirella Lapata Ranking Sentences for Extractive Summarization with Reinforcement Learning published pages: 1747-1759, ISSN: , DOI: 10.18653/v1/n18-1158	Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)	2020-02-07
2018	Yang Liu and Matt Gardner, and Mirella Lapata Structured Alignment Networks for Matching Sentences published pages: 1554--1564, ISSN: , DOI:	Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing	2020-02-07
2018	Stefanos Angelidis and Mirella Lapata Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised published pages: 3675--3686, ISSN: , DOI:	Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing	2020-02-07

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "TRANSMODAL" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "TRANSMODAL" are provided by the European Opendata Portal: CORDIS opendata.