Opendata, web and dolomites

DeepSPIN SIGNED

Deep Learning for Structured Prediction in Natural Language Processing

Total Cost €

0

EC-Contrib. €

0

Partnership

0

Views

0

 DeepSPIN project word cloud

Explore the words cloud of the DeepSPIN project. It provides you a very rough idea of what is the project "DeepSPIN" about.

machine    quality    first    probabilistic    networks    learning    requiring    words    ways    solving    decoders    seamless    maximize    sparse    operate    predicting    estimation    speech    optimal    expressive    structured    structural    mistranslated    planning    start    communication    perspective    named    serious    crowd    structurally    cross    interdependent    endow    network    human    recognition    humans    interfaces    ignore    combinatorial    leads    dropped    data    question    bots    inducing    relying    mechanisms    greedy    neural    structure    attacks    breakthroughs    automatically    mistakes    customer    interpretable    simplistic    reasoning    broadly    exploited    bridge    technologies    letting    search    apps    disciplinary    messenger    natural    testbeds    prediction    missing    sourcing    answering    dependency    language    multilingual    translation    industry    guide    variables    synergies    techniques    scalable    complement    innovations    reduce    supervision    mechanism    disruptive    machines    involve    labeled    entities    serve    company    revolutionizing    complexity    incorporating    inside    error    modeling    prone    assistants    optimization    fundamental    digital    nlp    world    inference    service    deep    technological    weak    parsing    latent    output   

Project "DeepSPIN" data sheet

The following table provides information about the project.

Coordinator
INSTITUTO DE TELECOMUNICACOES 

Organization address
address: CAMPUS UNIVERSITARIO DE SANTIAGO UNIVERSIDADE DE AVEIRO
city: GLORIA E VERA CRUZ
postcode: 3810 193
website: www.it.pt

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country Portugal [PT]
 Project website https://deep-spin.github.io
 Total cost 1˙436˙000 €
 EC max contribution 1˙436˙000 € (100%)
 Programme 1. H2020-EU.1.1. (EXCELLENT SCIENCE - European Research Council (ERC))
 Code Call ERC-2017-STG
 Funding Scheme ERC-STG
 Starting year 2018
 Duration (year-month-day) from 2018-02-01   to  2023-01-31

 Partnership

Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    INSTITUTO DE TELECOMUNICACOES PT (GLORIA E VERA CRUZ) coordinator 1˙336˙000.00
2    UNBABEL, LDA PT (SAMORA CORREIA) participant 100˙000.00

Map

 Project objective

Deep learning is revolutionizing the field of Natural Language Processing (NLP), with breakthroughs in machine translation, speech recognition, and question answering. New language interfaces (digital assistants, messenger apps, customer service bots) are emerging as the next technologies for seamless, multilingual communication among humans and machines.

From a machine learning perspective, many problems in NLP can be characterized as structured prediction: they involve predicting structurally rich and interdependent output variables. In spite of this, current neural NLP systems ignore the structural complexity of human language, relying on simplistic and error-prone greedy search procedures. This leads to serious mistakes in machine translation, such as words being dropped or named entities mistranslated. More broadly, neural networks are missing the key structural mechanisms for solving complex real-world tasks requiring deep reasoning.

This project attacks these fundamental problems by bringing together deep learning and structured prediction, with a highly disruptive and cross-disciplinary approach. First, I will endow neural networks with a 'planning mechanism' to guide structural search, letting decoders learn the optimal order by which they should operate. This makes a bridge with reinforcement learning and combinatorial optimization. Second, I will develop new ways of automatically inducing latent structure inside the network, making it more expressive, scalable and interpretable. Synergies with probabilistic inference and sparse modeling techniques will be exploited. To complement these two innovations, I will investigate new ways of incorporating weak supervision to reduce the need for labeled data.

Three highly challenging applications will serve as testbeds: machine translation, quality estimation, and dependency parsing. To maximize technological impact, a collaboration is planned with a start-up company in the crowd-sourcing translation industry.

 Publications

year authors and title journal last update
List of publications.
2019 António Góis and André F. T. Martins
Translator2Vec: Understanding and Representing Human Post-Editors
published pages: , ISSN: , DOI:
Proceedings of Machine Translation Summit XVII Volume 1: Research Track (MT Summit 2019) 2019-08-29
2019 Gonçalo M. Correia, André F. T. Martins
A Simple and Effective Approach to Automatic Post-Editing with Transfer Learning
published pages: , ISSN: , DOI:
Annual Meeting of the Association for Computational Linguistics (ACL\'19) 2019-08-29
2019 António V. Lopes, M. Amin Farajian, Gonçalo M. Correia, Jonay Trénous, André F. T. Martins
Unbabel\'s Submission to the WMT2019 APE Shared Task: BERT-Based Encoder-Decoder for Automatic Post-Editing
published pages: , ISSN: , DOI:
Conference on Machine Translation (WMT 2019) 2019-08-29
2019 Maruf, Sameen; Martins, André F. T.; Haffari, Gholamreza
Selective Attention for Context-aware Neural Machine Translation
published pages: , ISSN: , DOI:
Proceedings of the North-American Chapter of the Association for Computational Linguistics 1 2019-08-29
2019 Afonso Mendes, Shashi Narayan, Sebastião Miranda, Zita Marinho, André F. T. Martins, Shay B. Cohen
Jointly extracting and compressing documents with summary state representations
published pages: , ISSN: , DOI:
Conference of the North American Chapter of the Association for Computational Linguistics (NAACL\'19) 2019-08-29
2019 Blondel, Mathieu; Martins, André F. T.; Niculae, Vlad
Learning Classifiers with Fenchel-Young Losses: Generalized Entropies, Margins, and Algorithms
published pages: , ISSN: , DOI:
Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS) 2019 2019-08-29
2019 Fabio Kepler, Jonay Trénous, Marcos Treviso, Miguel Vera, António Góis, M. Amin Farajian, António V. Lopes, André F. T. Martins
Unbabel\'s Participation in the WMT19 Translation Quality Estimation Shared Task
published pages: , ISSN: , DOI:
Conference on Machine Translation (WMT 2019) 2019-08-29
2019 Ben Peters, Vlad Niculae, André F. T. Martins
Sparse Sequence-to-Sequence Models
published pages: , ISSN: , DOI:
Annual Meeting of the Association for Computational Linguistics (ACL\'19) 2019-08-29
2019 Erick Fonseca, Lisa Yankovskaya, André F. T. Martins, Mark Fishel, Christian Federmann
Findings of the WMT 2019 Shared Tasks on Quality Estimation
published pages: , ISSN: , DOI:
Conference on Machine Translation (WMT 2019) 2019-08-29
2019 Pedro Henrique Martins, Zita Marinho, André F. T. Martins
Joint Learning of Named Entity Recognition and Entity Linking
published pages: , ISSN: , DOI:
Annual Meeting of the Association for Computational Linguistics (ACL\'19), Student Research Workshop 2019-08-29
2019 Tsvetomila Mihaylova, André F. T. Martins
Scheduled Sampling for Transformers
published pages: , ISSN: , DOI:
Annual Meeting of the Association for Computational Linguistics (ACL\'19), Student Research Workshop 2019-08-29
2019 Fábio Kepler, Jonay Trénous, Marcos Treviso, Miguel Vera, André F. T. Martins
Openkiwi: An open source framework for quality estimation
published pages: , ISSN: , DOI:
Annual Meeting of the Association for Computational Linguistics (ACL\'19), System Demonstrations 2019-08-29
2018 Vlad Niculae, Andre Martins, Mathieu Blondel, Claire Cardie
SparseMAP: Differentiable Sparse Structured Inference
published pages: 3796-3805, ISSN: , DOI:
Proceedings of the 35th International Conference on Machine Learning 80 2019-06-11
2018 Chaitanya Malaviya, Pedro Ferreira, André Martins
Sparse and Constrained Attention for Neural Machine Translation
published pages: , ISSN: , DOI:
Proceedings of the Annual Chapter of the Association for Computation Linguistics 2019-06-11
2018 Ben Peters, Vlad Niculae, André F. T. Martins
Interpretable Structure Induction via Sparse Attention
published pages: , ISSN: , DOI:
EMNLP Workshop for Analyzing and Interpreting Neural Networks for NLP 2019-04-14
2018 Sameen Maruf, Andre F. T. Martins, Gholamreza Haffari
Contextual Neural Model for Translating Bilingual Multi-Speaker Conversations
published pages: , ISSN: , DOI:
Conference for Machine Translation (WMT) 2019-04-14
2018 Vlad Niculae, André F. T. Martins and Claire Cardie
Towards Dynamic Computation Graphs via Sparse Latent Structure
published pages: , ISSN: , DOI:
Conference on Empirical Methods in Natural Language Processing 2019-04-14

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "DEEPSPIN" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "DEEPSPIN" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.1.1.)

ENUF (2019)

Evaluation of Novel Ultra-Fast selective III-V Epitaxy

Read More  

Aware (2019)

Aiding Antibiotic Development with Deep Analysis of Resistance Evolution

Read More  

Diverge (2019)

Generation of ultra-deep libraries of transcriptional activators for gene therapy

Read More