Opendata, web and dolomites

ARIA-VALUSPA

Artificial Retrieval of Information Assistants - Virtual Agents with Linguistic Understanding, Social skills, and Personalised Aspects

Total Cost €

0

EC-Contrib. €

0

Partnership

0

Views

0

Project "ARIA-VALUSPA" data sheet

The following table provides information about the project.

Coordinator
THE UNIVERSITY OF NOTTINGHAM 

Organization address
address: University Park
city: NOTTINGHAM
postcode: NG7 2RD
website: www.nottingham.ac.uk

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country United Kingdom [UK]
 Project website http://aria-agent.eu/
 Total cost 2˙949˙318 €
 EC max contribution 2˙949˙317 € (100%)
 Programme 1. H2020-EU.2.1.1.4. (Content technologies and information management: ICT for digital content, cultural and creative industries)
 Code Call H2020-ICT-2014-1
 Funding Scheme RIA
 Starting year 2015
 Duration (year-month-day) from 2015-01-01   to  2017-12-31

 Partnership

Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    THE UNIVERSITY OF NOTTINGHAM UK (NOTTINGHAM) coordinator 528˙895.00
2    UNIVERSITAET AUGSBURG DE (AUGSBURG) participant 472˙482.00
3    CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS FR (PARIS) participant 472˙042.00
4    IMPERIAL COLLEGE OF SCIENCE TECHNOLOGY AND MEDICINE UK (LONDON) participant 440˙715.00
5    UNIVERSITEIT TWENTE NL (ENSCHEDE) participant 414˙045.00
6    CEREPROC LTD UK (EDINBURGH) participant 322˙651.00
7    LA CANTOCHE PRODUCTION SA FR (PARIS) participant 298˙486.00

Map

 Project objective

The ARIA-VALUSPA project will create a ground-breaking new framework that will allow easy creation of Artificial Retrieval of Information Assistants (ARIAs) that are capable of holding multi-modal social interactions in challenging and unexpected situations. The system can generate search queries and return the information requested by interacting with humans through virtual characters. These virtual humans will be able to sustain an interaction with a user for some time, and react appropriately to the user's verbal and non-verbal behaviour when presenting the requested information and refining search results. Using audio and video signals as input, both verbal and non-verbal components of human communication are captured. Together with a rich and realistic emotive personality model, a sophisticated dialogue management system decides how to respond to a user's input, be it a spoken sentence, a head nod, or a smile. The ARIA uses special speech synthesisers to create emotionally coloured speech and a fully expressive 3D face to create the chosen response. Back-channelling, indicating that the ARIA understood what the user meant, or returning a smile are but a few of the many ways in which it can employ emotionally coloured social signals to improve communication. As part of the project, the consortium will develop two specific implementations of ARIAs for two different industrial applications. A ‘speaking book’ application will create an ARIA with a rich personality capturing the essence of a novel, whom users can ask novel-related questions. An ‘artificial travel agent’ web-based ARIA will be developed to help users find their perfect holiday – something that is difficult to do with existing web interfaces such as those created by booking.com or tripadvisor.

 Deliverables

List of deliverables.
Public access to interactive ARIA-VALUSPA platform under a research license Websites, patent fillings, videos etc. 2019-05-30 17:04:34
First integrated system with simple support for web and mobile device user interfaces Demonstrators, pilots, prototypes 2019-03-11 11:19:51
Implementation of adaptive task-based dialogue system Demonstrators, pilots, prototypes 2019-03-11 11:19:02
Final report on standardisation and workshops activities Documents, reports 2019-03-11 11:19:47
Implementation of multi-lingual user- and environment-adaptive speech analysis Demonstrators, pilots, prototypes 2019-03-11 11:19:16
Implementation of adaptive audiovisual communicative behaviour generation Demonstrators, pilots, prototypes 2019-03-11 11:19:54
Release of the multilingual, adaptive dialogue toolbox Demonstrators, pilots, prototypes 2019-03-11 11:19:05
Fine-tuned, multi-lingual realisation of Book-ARIA using M3 system Demonstrators, pilots, prototypes 2019-03-11 11:19:49
Public access to interactive system data Websites, patent fillings, videos etc. 2019-03-11 11:19:46
Second integrated system with improved real-time capabilities in distributed environments Demonstrators, pilots, prototypes 2019-03-11 11:19:50
Final adaptive audiovisual communicative behaviour generation Demonstrators, pilots, prototypes 2019-03-11 11:19:52
Multi-lingual realisation of Book-ARIA using M2 system Demonstrators, pilots, prototypes 2019-03-11 11:19:27
Implementation of long-term adaptation for speech analysis Demonstrators, pilots, prototypes 2019-03-11 11:19:17
Final integrated system with documented support for web standard technologies Demonstrators, pilots, prototypes 2019-03-11 11:19:26
Uni-lingual realisation of Book-ARIA using M1 system Demonstrators, pilots, prototypes 2019-03-11 11:19:35
Public access to labelled Wizard-of-Oz data Websites, patent fillings, videos etc. 2019-03-11 11:19:43
Evaluation report Documents, reports 2019-03-11 11:19:51
Implementation of multi-lingual task-based dialogue system for the chosen scenario Demonstrators, pilots, prototypes 2019-03-08 17:24:14
Implementation of overall dynamic audiovisual communicative behaviour generation Demonstrators, pilots, prototypes 2019-03-08 17:24:14
Implementation of cross-domain, context-sensitive speech analysis Demonstrators, pilots, prototypes 2019-03-08 17:24:14
Project website, first version Websites, patent fillings, videos etc. 2019-03-08 17:24:14
Ethical Policies Documents, reports 2019-03-08 17:24:14
Data Management Plan Documents, reports 2019-03-08 17:24:14

Take a look to the deliverables list in detail:  detailed list of ARIA-VALUSPA deliverables.

 Publications

year authors and title journal last update
List of publications.
2016 B. Martinez and M.F. Valstar
Advances, Challenges, and Opportunities in Automatic Facial Expression Recognition
published pages: , ISSN: , DOI:
Advances in Face Detection and Facial Image Analysis 2019-05-30
2016 Escalera, S., Torres Torres, M., Martinez, B., Baró, X. and Escalante, H.J., Guyon I., Tzimiropoulos, G., Corneau, C., Oliu, M., Bagheri, M.A., Valstar, M.F.
ChaLearn Looking at People and Faces of the World: Face Analysis Workshop and Challenge 2016
published pages: , ISSN: , DOI:
CVPR 2019-05-30
2016 Chloé Clavel, Zoraida Callejas
From opinion mining to human-agent interaction
published pages: , ISSN: 1949-3045, DOI:
IEEE TAC 2019-05-30
2015 Caroline Langlet, Chloe Clavel
Improving social relationships in face-to-face human-agent interactions: when the agent wants to know user’s likes and dislikes
published pages: , ISSN: , DOI:
ACL 2019-05-30
2016 Zixing Zhang, Fabien Ringeval, Bin Dong, Eduardo Coutinho, Erik Marchi, Björn Schuller
Enhanced semi-supervised learning for multimodal emotion recognition
published pages: , ISSN: , DOI:
ICASSP 2019-05-30
2016 Yue Zhang, Felix Weninger, Zhao Ren, Björn Schuller
Sincerity, deception in speech: Two sides of the same coin? A transfer- and multi-task learning perspective
published pages: , ISSN: , DOI:
ICMI 2019-05-30
2015 Hesam Sagha, Eduardo Coutinho, Björn Schuller
Exploring the importance of individual differences to the automatic estimation of emotions induced by music
published pages: , ISSN: , DOI:
MM 2019-05-30
2015 Björn Schuller, Amr El-Desoky Mousa, Vryniotis Vasileios
Sentiment analysis, opinion mining: on optimal parameters and performances
published pages: , ISSN: 1942-4787, DOI:
Wiley Interdisciplinary Reviews: Data Mining, Knowledge Discovery 2019-05-30
2015 Johannes Wagner, Andreas Seiderer, Florian Lingenfelser, Elisabeth André
Combining Hierarchical Classification with Frequency Weighting for the Recognition of Eating Conditions
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2016 Valstar, M.F., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R. and Pantic, M
AVEC 2016 – Depression, Mood, and Emotion Recognition Workshop and Challenge
published pages: , ISSN: , DOI:
ACM Multimedia 2016 2019-05-30
2016 Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, Björn Schuller
Dynamic active learning based on agreement, applied to emotion recognition in spoken interactions
published pages: , ISSN: , DOI:
ICMI 2019-05-30
2016 George Trigeorgis, Mihalis A. Nicolaou, Stefanos Zafeiriou, Björn Schuller
Deep canonical time warping
published pages: , ISSN: , DOI:
CVPR 2019-05-30
2015 Fabien Ringeval, Erik Marchi, Marc Mehu, Klaus Scherer, Björn Schuller
Face reading from speech –- predicting facial action units from audio cues
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2016 M. Aylett, B. Potard, G. Pullin, S. Hennig, D. Braude, M. Antunes Ferreira
Don\'t Say Yes, Say Yes: Interacting with Synthetic Speech Using Tonetable
published pages: , ISSN: , DOI:
CHI EA \'16 2019-05-30
2016 A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar
Computational Models of Emotion, Personality, and Social Relationships for Interactions in Games
published pages: , ISSN: , DOI:
AAMAS 2019-05-30
2015 Fabien Ringeval, Björn Schuller, Michel Valstar, Roddy Cowie, Maja Pantic
AVEC 2015 – The 5th International Audio/Visual Emotion Challenge and Workshop
published pages: , ISSN: , DOI:
MM 2019-05-30
2016 Amr El-Desoky Mousa, Björn Schuller
Deep bidirectional long short-term memory recurrent neural networks for grapheme-to-phoneme conversion utilizing complex many-to many alignments
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2016 Zixing Zhang, Fabien Ringeval, Jing Han, Jun Deng, Erik Marchi, Björn Schuller
Facing realism in spontaneous emotion recognition from speech: feature enhancement by autoencoder with LSTM neural networks
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2015 Ringeval, F., Schuller, B., Valstar, M., Jaiswal, S., Marchi, E., Lalanne, D., Cowie, R. and Pantic, M
AV+ EC 2015--The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data
published pages: , ISSN: , DOI:
AVEC 2019-05-30
2016 Angelo Cafaro, Nadine Glas, Catherine Pelachaud
The Effects of Interrupting Behavior on Interpersonal Attitude and Engagement in Dyadic Interactions
published pages: , ISSN: , DOI:
AAMAS 2019-05-30
2015 Marc Schröder, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark ter Maat, Gary McKeown, Sathish Pammi, Maja Pantic, Catherine Pelachaud, Björn Schuller, Etienne de Sevin, Michel Valstar, Martin Wöllmer
Building autonomous sensitive artificial listeners (extended abstract)
published pages: , ISSN: , DOI:
ACII 2019-05-30
2016 George Trigeorgis, Fabien Ringeval, Raymond Brückner, Erik Marchi, Mihalis Nicolaou, Björn Schuller, Stefanos Zafeiriou
Adieu features? End-to-end apeech emotion recognition using a deep convolutional recurrent network
published pages: , ISSN: , DOI:
ICASSP 2019-05-30
2015 Kun Qian, Zixing Zhang, Fabien Ringeval, Björn Schuller
Bird sounds classification by large scale acoustic features, extreme learning machine
published pages: , ISSN: , DOI:
GlobalSIP 2019-05-30
2015 Eduardo Coutinho, George Trigeorgis, Stefanos Zafeiriou, Björn Schuller
Automatically estimating emotion music using long-short term memory recurrent neural networks
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2015 Fabien Ringeval, Björn Schuller, Michel Valstar, Shashank Jaiswal, Erik Marchi, Denis Lalanne, Roddy Cowie, Maja Pantic
AV+EC 2015 –- The first affect recognition Challenge bridging across audio, video, and physiological Data
published pages: , ISSN: , DOI:
MM 2019-05-30
2015 Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, Björn Schuller
Agreement-based dynamic active learning with least, medium certainty query strategies
published pages: , ISSN: , DOI:
Advances in Active Learning : Bridging Theory, Practice Workshop 2019-05-30
2015 George Trigeorgis, Eduardo Coutinho, Fabien Ringeval, Erik Marchi, Stefanos Zafeiriou, Björn Schuller
The ICL-TUM-PASSAU approach for the MediaEval 2015 “Affective Impact of Movies” task
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2015 Lucas Azais, Adrien Payan, Tianjiao Sun, Guillaume Vidal, Tina Zhang, Eduardo Coutinho, Florian Eyben, Björn Schuller
Does my speech rock? Automatic assessment of public speaking skills
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2016 A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar
Playing with Social and Emotional Game Companions
published pages: , ISSN: , DOI:
IVA 2019-05-30
2015 T. Almaev, B. Martinez and M.F. Valstar
Learning to transfer: transferring latent task structures and its application to person-specific facial action unit detection
published pages: , ISSN: , DOI:
ICCV 2019-05-30
2015 Yue Zhang, Eduardo Coutinho, Zixing Zhang, Michael Adam, Björn Schuller
On rater reliability, correlation based dynamic active learning
published pages: , ISSN: , DOI:
ACII 2019-05-30
2015 Björn Schuller
Speech analysis in the big data era
published pages: , ISSN: , DOI:
TSD 2019-05-30
2016 S. Jaiswal, M.F. Valstar
Deep Learning the Dynamic Appearance and Shape of Facial Action Units
published pages: , ISSN: , DOI:
IEEE WACV 2019-05-30
2016 W. Zhu, A. Chowanda, M.F. Valstar
Topic switch models for dialogue management in virtual humans
published pages: , ISSN: , DOI:
IVA 2019-05-30
2016 Caroline Langlet, Chloe Clavel
Adapting sentiment analysis to face-to-face human-agent interactions: from detection to evaluation issues
published pages: , ISSN: , DOI:
ACII 2019-05-30
2016 Caroline Langlet, Chloe Clavel
Grounding the detection of the user’s likes ´ and dislikes on the topic structure of human-agent interactions
published pages: , ISSN: 0950-7051, DOI:
KBS 2019-05-30
2016 B. Potard, M. Aylett, D. Braude, P. Motlicek
An Open Source Kaldi Based Parametric Speech Synthesiser based on DNN
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2016 Tobias Baur, Dominik Schiller, Elisabeth André
Modeling User’s Social Attitude in a Conversational System
published pages: , ISSN: , DOI:
Emotions and Personality in Personalized Services 2019-05-30
2016 Yue Zhang, Yuxiang Zhou, Jie Shen, Björn Schuller
Semi-autonomous data enrichment based on cross-task labelling of missing targets for holistic speech analysis
published pages: , ISSN: , DOI:
ICASSP 2019-05-30
2016 George Trigeorgis, Konstantinos Bousmalis, Stefanos Zafeiriou, Björn Schuller
A deep matrix factorization method for learning attribute representations
published pages: , ISSN: 0162-8828, DOI:
PAMI 2019-05-30
2015 X. Wang, M.F. Valstar, B. Martinez, M.H. Khan, T.P. Pridmore
TRIC-track: Tracking by Regression with Incrementally Learned Cascades
published pages: , ISSN: , DOI:
ICCV 2019-05-30
2016 E. Sánchez-Lozano, B. Martinez, G. Tzimiropoulos, M.F. Valstar
Cascaded continuous regression for real-time incremental face tracking
published pages: , ISSN: , DOI:
ECCV 2019-05-30
2016 B. Potard, M. Aylett, D. Braude.
Cross Modal Evaluation of High Quality Emotional Speech Synthesis with the Virtual Human Toolkit
published pages: , ISSN: , DOI:
IVA 2019-05-30
2016 E. Sánchez-Lozano, B. Martinez, M.F. Valstar
Cascaded Regression with Sparsified Feature Covariance Matrix for Facial Landmark Detection
published pages: , ISSN: 0167-8655, DOI:
Pattern Recognition Letters 2019-05-30
2016 Clavel, C., Cafaro, A., Campano, S., & Pelachaud, C.
Fostering user engagement in face-to-face human-agent interactions: a survey
published pages: , ISSN: , DOI:
Toward Robotic Socially Believable Behaving Systems-Volume II 2019-05-30
2015 Eduardo Coutinho, Björn Schuller
Automatic estimation of biosignals from the human voice
published pages: , ISSN: 2329-9290, DOI:
Science, Special Supplement on Advances in Computational Psychophysiology 2019-05-30
2015 Tobias Baur, Gregor Mehlmann, Ionut Damian, Florian Lingenfelser, Johannes Wagner, Birgit Lugrin, Elisabeth André, Patrick Gebhard
Context-Aware Automated Analysis and Annotation of Social Human-Agent Interactions
published pages: , ISSN: 2160-6455, DOI:
ACM Transactions on Interactive Intelligent Systems (TiiS) 5.2 2019-05-30
2015 M. Wester, M. Aylett, M. Tomalin, R. Dall
Artificial Personality and Disfluency
published pages: , ISSN: , DOI:
Interspeech 2019-05-30
2015 Kornelia Gentsch, Eduardo Coutinho, Florian Eyben, Björn Schuller, Klaus R. Scherer
Classifying emotion-antecedent appraisal in brain activity using machine learning methods
published pages: , ISSN: , DOI:
2019-05-30
2015 Erik Marchi, Fabio Vesperini, Felix Weninger, Florian Eyben, Stefano Squartini, Björn Schuller
Non-linear prediction with LSTM recurrent neural networks for acoustic novelty detection
published pages: , ISSN: , DOI:
OJCNN 2019-05-30
2016 Björn Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
The INTERSPEECH 2016 Computational Paralinguistics Challenge: Deception & Sincerity
published pages: , ISSN: , DOI:
ICMI 2019-05-30
2015 S. Jaiswal, B. Martinez, M.F. Valstar
Learning to combine local models for Facial Action Unit detection
published pages: , ISSN: , DOI:
FERA 2019-05-30
2015 B. Martinez and M.F. Valstar
L21-based regression and prediction accumulation across views for robust facial landmark detection
published pages: , ISSN: 0262-8856, DOI:
Image and Vision Computing 2019-05-30

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "ARIA-VALUSPA" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "ARIA-VALUSPA" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.2.1.1.4.)

SEWA (2015)

Automatic Sentiment Estimation in the Wild

Read More  

POPULATE (2015)

POPULate AsymmeTric mobile gamEs

Read More  

MoreGrasp (2015)

Restoration of upper limb function in individuals with high spinal cord injury by multimodal neuroprostheses for interaction in daily activities

Read More