Opendata, web and dolomites

TransModal SIGNED

Translating from Multiple Modalities into Text

Total Cost €

0

EC-Contrib. €

0

Partnership

0

Views

0

Project "TransModal" data sheet

The following table provides information about the project.

Coordinator
THE UNIVERSITY OF EDINBURGH 

Organization address
address: OLD COLLEGE, SOUTH BRIDGE
city: EDINBURGH
postcode: EH8 9YL
website: www.ed.ac.uk

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country United Kingdom [UK]
 Project website https://homepages.inf.ed.ac.uk/mlap/
 Total cost 1˙900˙777 €
 EC max contribution 1˙900˙777 € (100%)
 Programme 1. H2020-EU.1.1. (EXCELLENT SCIENCE - European Research Council (ERC))
 Code Call ERC-2015-CoG
 Funding Scheme ERC-COG
 Starting year 2016
 Duration (year-month-day) from 2016-09-01   to  2021-08-31

 Partnership

Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    THE UNIVERSITY OF EDINBURGH UK (EDINBURGH) coordinator 1˙900˙777.00

Map

 Project objective

Recent years have witnessed the development of a wide range of computational methods that process and generate natural language text. Many of these have become familiar to mainstream computer users such as tools that retrieve documents matching a query, perform sentiment analysis, and translate between languages. Systems like Google Translate can instantly translate between any pair of over fifty human languages allowing users to read web content that wouldn't have otherwise been available. The accessibility of the web could be further enhanced with applications that translate within the same language, between different modalities, or different data formats. There are currently no standard tools for simplifying language, e.g., for low-literacy readers or second language learners. The web is rife with non-linguistic data (e.g., databases, images, source code) that cannot be searched since most retrieval tools operate over textual data. In this project we maintain that in order to render electronic data more accessible to individuals and computers alike, new types of models need to be developed. Our proposal is to provide a unified framework for translating from comparable corpora, i.e., collections consisting of data in the same or different modalities that address the same topic without being direct translations of each other. We will develop general and scalable models that can solve different translation tasks and learn the necessary intermediate representations of the units involved in an unsupervised manner without extensive feature engineering. Thanks to recent advances in deep learning, we will induce representations for different modalities, their interactions, and correspondence to natural language. Beyond addressing a fundamental aspect of the translation problem, the proposed research will lead to novel internet-based applications that simplify and summarize text, produce documentation for source code, and meaningful descriptions for images.

 Publications

year authors and title journal last update
List of publications.
2017 Spandana Gella, Frank Keller, Mirella Lapata
Disambiguating Visual Verbs
published pages: 1-1, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2017.2786699
IEEE Transactions on Pattern Analysis and Machine Intelligence 27 December 2017 2020-02-07
2017 Xingxing Zhang and Mirella Lapata
Sentence Simplification with Deep Reinforcement Learning
published pages: 595--605, ISSN: , DOI:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 2020-02-07
2017 Jianpeng Cheng, Adam Lopez, and Mirella Lapata
A Generative Parser with a Discriminative Recognition Algorithm.
published pages: 118--124, ISSN: , DOI:
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) July, 2017 2020-02-07
2016 Zhang, Xingxing and Lu, Liang and Lapata, Mirella}
Top-down Tree Long Short-Term Memory Networks
published pages: 310--320, ISSN: , DOI:
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June, 2016 2020-02-07
2017 Mallinson, Jonathan and Sennrich, Rico and Lapata, Mirella
Paraphrasing Revisited with Neural Machine Translation
published pages: 881--893, ISSN: , DOI:
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017 2020-02-07
2018 CARINA SILBERER, JASPER UIJLINGS, MIRELLA LAPATA
Understanding visual scenes
published pages: 441-465, ISSN: 1351-3249, DOI: 10.1017/s1351324918000104
Natural Language Engineering 24/03 2020-02-07
2017 Cheng, Jianpeng and Dong, Li and Lapata, Mirella
Long Short-Term Memory-Networks for Machine Reading
published pages: 551--561, ISSN: , DOI:
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing November, 2016 2020-02-07
2017 Siva Reddy; Oscar Täckström; Slav Petrov; Mark Steedman; Mirella Lapata
Universal Semantic Parsing
published pages: 89--101, ISSN: , DOI:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 2020-02-07
2018 Yang Liu and Mirella Lapata
Learning Structured Text Representations.
published pages: 63-75, ISSN: 2307-387X, DOI:
Transactions of the Association for Computational Linguistics Vol 6 (2018) 2020-02-07
2017 Dong, Li and Huang, Shaohan and Wei, Furu and Lapata, Mirella and Zhou, Ming and Xu, Ke
Learning to Generate Product Reviews from Attributes
published pages: 623--632, ISSN: , DOI:
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017 2020-02-07
2016 Gella, Spandana and Lapata, Mirella and Keller, Frank
Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings
published pages: 182--192, ISSN: , DOI:
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June, 2016 2020-02-07
2016 Dong, Li and Lapata, Mirella
Language to Logical Form with Neural Attention
published pages: 33--43, ISSN: , DOI:
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016 2020-02-07
2018 Lea Frermann, Shay Cohen, Mirella Lapata
Whodunnit? Crime Drama as a Case for Natural Language Understanding
published pages: 1-15, ISSN: 2307-387X, DOI:
Transactions of the Association for Computational Linguistics vol 6 (2018) 2020-02-07
2018 Stefanos Angelidis and Mirella Lapata
Multiple Instance Learning Networks for Fine-Grained Sentiment Analysis
published pages: 17-31, ISSN: 2307-387X, DOI:
Transactions of the Association for Computational Linguistics vol 6 (2018) 2020-02-07
2017 Zhang, Xingxing and Cheng, Jianpeng and Lapata, Mirella
Dependency Parsing as Head Selection
published pages: 665--676, ISSN: , DOI:
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers April, 2017 2020-02-07
2017 Cheng, Jianpeng and Reddy, Siva and Saraswat, Vijay and Lapata, Mirella
Learning Structured Natural Language Representations for Semantic Parsing
published pages: 44-55, ISSN: , DOI:
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) July, 2017 2020-02-07
2016 Roth, Michael and Lapata, Mirella
Neural Semantic Role Labeling with Dependency Path Embeddings
published pages: 1192--1202, ISSN: , DOI:
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016 2020-02-07
2016 Cheng, Jianpeng and Lapata, Mirella
Neural Summarization by Extracting Sentences and Words
published pages: 484--494, ISSN: , DOI:
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) August, 2016 2020-02-07
2017 Dong, Li and Mallinson, Jonathan and Reddy, Siva and Lapata, Mirella
Learning to Paraphrase for Question Answering
published pages: 875--886, ISSN: , DOI:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 2020-02-07
2016 Lea Frermann, Mirella Lapata
A Bayesian Model of Diachronic Meaning Change
published pages: 31-45, ISSN: 2307-387X, DOI:
Transactions of the Association for Computational Linguistics vol 4 (2016) 2020-02-07
2017 Liu, Yang and Lapata, Mirella
Learning Contextually Informed Representations for Linear-Time Discourse Parsing}
published pages: 1289--1298, ISSN: , DOI:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 2020-02-07
2016 Siva Reddy, Oscar Täckström, Michael Collins, Tom Kwiatkowski, Dipanjan Das, Mark Steedman, Mirella Lapata
Transforming Dependency Structures to Logical Forms for Semantic Parsing
published pages: 127-140, ISSN: 2307-387X, DOI:
Transactions of the Association for Computational Linguistics vol 4 (2016) 2020-02-07
2017 Carina Silberer, Vittorio Ferrari, Mirella Lapata
Visually Grounded Meaning Representations
published pages: 2284-2297, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2016.2635138
IEEE Transactions on Pattern Analysis and Machine Intelligence 39/11 2020-02-07
2017 Gella, Spandana and Sennrich, Rico and Keller, Frank and Lapata, Mirella
Image Pivoting for Learning Multilingual Multimodal Representations
published pages: 2829--2835, ISSN: , DOI:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing September 2017 2020-02-07
2018 Jiangming Liu, Shay B. Cohen, Mirella Lapata
Discourse Representation Structure Parsing
published pages: 429–439, ISSN: , DOI:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2020-02-07
2018 Shashi Narayan, Ronald Cardenas, Nikos Papasarantopoulos, Shay B. Cohen, Mirella Lapata, Jiangsheng Yu, Yi Chang
Document Modeling with External Attention for Sentence Extraction
published pages: 2020–2030, ISSN: , DOI:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2020-02-07
2018 Laura Perez-Beltrachini, Mirella Lapata
Bootstrapping Generators from Noisy Data
published pages: 1516-1527, ISSN: , DOI: 10.18653/v1/n18-1137
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) 2020-02-07
2017 Siva Reddy, Oscar Täckström, Slav Petrov, Mark Steedman, Mirella Lapata
Universal Semantic Parsing
published pages: 89-101, ISSN: , DOI: 10.18653/v1/d17-1009
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing 2020-02-07
2017 Jianpeng Cheng, Siva Reddy, Vijay Saraswat, Mirella Lapata
Learning Structured Natural Language Representations for Semantic Parsing
published pages: 44-55, ISSN: , DOI: 10.18653/v1/P17-1005
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2020-02-07
2017 Li Dong, Jonathan Mallinson, Siva Reddy, Mirella Lapata
Learning to Paraphrase for Question Answering
published pages: 875-886, ISSN: , DOI: 10.18653/v1/d17-1091
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing 2020-02-07
2016 Jianpeng Cheng, Li Dong, Mirella Lapata
Long Short-Term Memory-Networks for Machine Reading
published pages: 551-561, ISSN: , DOI: 10.18653/v1/D16-1053
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing 2020-02-07
2018 Narayan, Shashi and Cohen, Shay B. and Lapata, Mirella
Don’t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization
published pages: 1797--1807, ISSN: , DOI:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing https://www.aclweb.org/antholog 2020-02-07
2018 Jonathan Mallinson, Rico Sennrich, and Mirela Lapata
Sentence Compression for Arbitrary Languages via Multilingual Pivoting
published pages: \"2453--2464\"\", ISSN: , DOI:
roceedings of the 2018 Conference on Empirical Methods in Natural Language Processing 2020-02-07
2019 Ratish Puduppully, Li Dong, and Mirella Lapata
Data-to-Text Generation with Content Selection and Planning
published pages: , ISSN: , DOI:
Proceedings of the 33rd International Joint Conference on Artificial Intelligence 2020-02-07
2017 Jianpeng Cheng, Adam Lopez, Mirella Lapata
A Generative Parser with a Discriminative Recognition Algorithm
published pages: 118-124, ISSN: , DOI: 10.18653/v1/P17-2019
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) 2020-02-07
2018 Dong, Li; Quirk, Chris; Lapata, Mirella
Confidence Modeling for Neural Semantic Parsing
published pages: 743–753, ISSN: , DOI:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2020-02-07
2018 Philip John Gorinski, Mirella Lapata
What’s This Movie About? A Joint Neural Network Architecture for Movie Content Analysis
published pages: 1770-1781, ISSN: , DOI: 10.18653/v1/n18-1160
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) 2020-02-07
2018 Xingxing Zhang and Mirella Lapata and Furu Wei, and Ming Zhou
Neural Latent Extractive Document Summarization.
published pages: 779--784., ISSN: , DOI:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing 2020-02-07
2017 Spandana Gella, Rico Sennrich, Frank Keller, Mirella Lapata
Image Pivoting for Learning Multilingual Multimodal Representations
published pages: 2839-2845, ISSN: , DOI: 10.18653/v1/D17-1303
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing 2020-02-07
2018 Dong, Li; Lapata, Mirella
Coarse-to-Fine Decoding for Neural Semantic Parsing
published pages: 731–742, ISSN: , DOI:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2020-02-07
2018 Narayan, Shashi; Cohen, Shay B.; Lapata, Mirella
Don\'t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization
published pages: , ISSN: , DOI: 10.5281/zenodo.2399762
Narayan , S , Cohen , S & Lapata , M 2018 , Don\'t Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization . in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Brussels, Belgium , pp. 1797-1807 , 2018 Conference on Empirical Methods in Natural Language Processing , Brussels , Belgium , 31/10/18 . 7 2020-02-07
2018 Cheng, Jianpeng; Lapata, Mirella
Weakly-supervised Neural Semantic Parsing with a Generative Ranker
published pages: 356–367, ISSN: , DOI:
Proceedings of the 22nd Conference on Computational Natural Language Learning 2020-02-07
2019 Jianpeng Cheng, Siva Reddy, Vijay Saraswat, Mirella Lapata
Learning an Executable Neural Semantic Parser
published pages: 59-94, ISSN: 0891-2017, DOI: 10.1162/coli_a_00342
Computational Linguistics 45/1 2020-02-07
2018 Shashi Narayan, Shay B. Cohen, Mirella Lapata
Ranking Sentences for Extractive Summarization with Reinforcement Learning
published pages: 1747-1759, ISSN: , DOI: 10.18653/v1/n18-1158
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) 2020-02-07
2018 Yang Liu and Matt Gardner, and Mirella Lapata
Structured Alignment Networks for Matching Sentences
published pages: 1554--1564, ISSN: , DOI:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing 2020-02-07
2018 Stefanos Angelidis and Mirella Lapata
Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised
published pages: 3675--3686, ISSN: , DOI:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing 2020-02-07

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "TRANSMODAL" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "TRANSMODAL" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.1.1.)

QUBE (2019)

Quantum technology with carbon nanotUBEs

Read More  

PROTECHT (2020)

Providing RObust high TECHnology Tags based on linear carbon nanostructures

Read More  

BrainNanoFlow (2018)

Nanoscale dynamics in the extracellular space of the brain in vivo

Read More