Opendata, web and dolomites
ARIA-VALUSPA
Artificial Retrieval of Information Assistants - Virtual Agents with Linguistic Understanding, Social skills, and Personalised Aspects
Total Cost €
0EC-Contrib. €
0Partnership
0Views
0ARIA-VALUSPA project word cloud
Explore the words cloud of the ARIA-VALUSPA project. It provides you a very rough idea of what is the project "ARIA-VALUSPA" about.
dialogue
queries
questions
emotionally
expressive
modal
artificial
verbal
3d
coloured
appropriately
signals
humans
speech
interacting
smile
refining
components
book
sophisticated
personality
human
communication
ground
whom
input
meant
speaking
indicating
channelling
interactions
decides
returning
aria
time
created
search
assistants
special
essence
return
com
holding
employ
booking
sentence
social
back
retrieval
web
breaking
valuspa
requested
realistic
unexpected
virtual
capturing
sustain
holiday
emotive
captured
ask
something
react
create
model
industrial
synthesisers
presenting
travel
nod
agent
difficult
head
interfaces
implementations
framework
characters
tripadvisor
chosen
perfect
audio
uses
interaction
arias
generate
situations
creation
ways
video
few
Project "ARIA-VALUSPA" data sheet
The following table provides information about the project.
| Coordinator |
THE UNIVERSITY OF NOTTINGHAM
Organization address contact info |
| Coordinator Country | United Kingdom [UK] |
| Project website | http://aria-agent.eu/ |
| Total cost | 2˙949˙318 € |
| EC max contribution | 2˙949˙317 € (100%) |
| Programme |
1. H2020-EU.2.1.1.4. (Content technologies and information management: ICT for digital content, cultural and creative industries) |
| Code Call | H2020-ICT-2014-1 |
| Funding Scheme | RIA |
| Starting year | 2015 |
| Duration (year-month-day) | from 2015-01-01 to 2017-12-31 |
Partnership
Take a look of project's partnership.
| # | ||||
|---|---|---|---|---|
| 1 | THE UNIVERSITY OF NOTTINGHAM | UK (NOTTINGHAM) | coordinator | 528˙895.00 |
| 2 | UNIVERSITAET AUGSBURG | DE (AUGSBURG) | participant | 472˙482.00 |
| 3 | CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS | FR (PARIS) | participant | 472˙042.00 |
| 4 | IMPERIAL COLLEGE OF SCIENCE TECHNOLOGY AND MEDICINE | UK (LONDON) | participant | 440˙715.00 |
| 5 | UNIVERSITEIT TWENTE | NL (ENSCHEDE) | participant | 414˙045.00 |
| 6 | CEREPROC LTD | UK (EDINBURGH) | participant | 322˙651.00 |
| 7 | LA CANTOCHE PRODUCTION SA | FR (PARIS) | participant | 298˙486.00 |
Map
Project objective
The ARIA-VALUSPA project will create a ground-breaking new framework that will allow easy creation of Artificial Retrieval of Information Assistants (ARIAs) that are capable of holding multi-modal social interactions in challenging and unexpected situations. The system can generate search queries and return the information requested by interacting with humans through virtual characters. These virtual humans will be able to sustain an interaction with a user for some time, and react appropriately to the user's verbal and non-verbal behaviour when presenting the requested information and refining search results. Using audio and video signals as input, both verbal and non-verbal components of human communication are captured. Together with a rich and realistic emotive personality model, a sophisticated dialogue management system decides how to respond to a user's input, be it a spoken sentence, a head nod, or a smile. The ARIA uses special speech synthesisers to create emotionally coloured speech and a fully expressive 3D face to create the chosen response. Back-channelling, indicating that the ARIA understood what the user meant, or returning a smile are but a few of the many ways in which it can employ emotionally coloured social signals to improve communication. As part of the project, the consortium will develop two specific implementations of ARIAs for two different industrial applications. A ‘speaking book’ application will create an ARIA with a rich personality capturing the essence of a novel, whom users can ask novel-related questions. An ‘artificial travel agent’ web-based ARIA will be developed to help users find their perfect holiday – something that is difficult to do with existing web interfaces such as those created by booking.com or tripadvisor.
Deliverables
| Public access to interactive ARIA-VALUSPA platform under a research license | Websites, patent fillings, videos etc. | 2019-05-30 17:04:34 |
| First integrated system with simple support for web and mobile device user interfaces | Demonstrators, pilots, prototypes | 2019-03-11 11:19:51 |
| Implementation of adaptive task-based dialogue system | Demonstrators, pilots, prototypes | 2019-03-11 11:19:02 |
| Final report on standardisation and workshops activities | Documents, reports | 2019-03-11 11:19:47 |
| Implementation of multi-lingual user- and environment-adaptive speech analysis | Demonstrators, pilots, prototypes | 2019-03-11 11:19:16 |
| Implementation of adaptive audiovisual communicative behaviour generation | Demonstrators, pilots, prototypes | 2019-03-11 11:19:54 |
| Release of the multilingual, adaptive dialogue toolbox | Demonstrators, pilots, prototypes | 2019-03-11 11:19:05 |
| Fine-tuned, multi-lingual realisation of Book-ARIA using M3 system | Demonstrators, pilots, prototypes | 2019-03-11 11:19:49 |
| Public access to interactive system data | Websites, patent fillings, videos etc. | 2019-03-11 11:19:46 |
| Second integrated system with improved real-time capabilities in distributed environments | Demonstrators, pilots, prototypes | 2019-03-11 11:19:50 |
| Final adaptive audiovisual communicative behaviour generation | Demonstrators, pilots, prototypes | 2019-03-11 11:19:52 |
| Multi-lingual realisation of Book-ARIA using M2 system | Demonstrators, pilots, prototypes | 2019-03-11 11:19:27 |
| Implementation of long-term adaptation for speech analysis | Demonstrators, pilots, prototypes | 2019-03-11 11:19:17 |
| Final integrated system with documented support for web standard technologies | Demonstrators, pilots, prototypes | 2019-03-11 11:19:26 |
| Uni-lingual realisation of Book-ARIA using M1 system | Demonstrators, pilots, prototypes | 2019-03-11 11:19:35 |
| Public access to labelled Wizard-of-Oz data | Websites, patent fillings, videos etc. | 2019-03-11 11:19:43 |
| Evaluation report | Documents, reports | 2019-03-11 11:19:51 |
| Implementation of multi-lingual task-based dialogue system for the chosen scenario | Demonstrators, pilots, prototypes | 2019-03-08 17:24:14 |
| Implementation of overall dynamic audiovisual communicative behaviour generation | Demonstrators, pilots, prototypes | 2019-03-08 17:24:14 |
| Implementation of cross-domain, context-sensitive speech analysis | Demonstrators, pilots, prototypes | 2019-03-08 17:24:14 |
| Project website, first version | Websites, patent fillings, videos etc. | 2019-03-08 17:24:14 |
| Ethical Policies | Documents, reports | 2019-03-08 17:24:14 |
| Data Management Plan | Documents, reports | 2019-03-08 17:24:14 |
Take a look to the deliverables list in detail: detailed list of ARIA-VALUSPA deliverables.
Publications
| year | authors and title | journal | last update |
|---|---|---|---|
| 2016 |
B. Martinez and M.F. Valstar Advances, Challenges, and Opportunities in Automatic Facial Expression Recognition published pages: , ISSN: , DOI: |
Advances in Face Detection and Facial Image Analysis | 2019-05-30 |
| 2016 |
Escalera, S., Torres Torres, M., Martinez, B., Baró, X. and Escalante, H.J., Guyon I., Tzimiropoulos, G., Corneau, C., Oliu, M., Bagheri, M.A., Valstar, M.F. ChaLearn Looking at People and Faces of the World: Face Analysis Workshop and Challenge 2016 published pages: , ISSN: , DOI: |
CVPR | 2019-05-30 |
| 2016 |
Chloé Clavel, Zoraida Callejas From opinion mining to human-agent interaction published pages: , ISSN: 1949-3045, DOI: |
IEEE TAC | 2019-05-30 |
| 2015 |
Caroline Langlet, Chloe Clavel Improving social relationships in face-to-face human-agent interactions: when the agent wants to know user’s likes and dislikes published pages: , ISSN: , DOI: |
ACL | 2019-05-30 |
| 2016 |
Zixing Zhang, Fabien Ringeval, Bin Dong, Eduardo Coutinho, Erik Marchi, Björn Schuller Enhanced semi-supervised learning for multimodal emotion recognition published pages: , ISSN: , DOI: |
ICASSP | 2019-05-30 |
| 2016 |
Yue Zhang, Felix Weninger, Zhao Ren, Björn Schuller Sincerity, deception in speech: Two sides of the same coin? A transfer- and multi-task learning perspective published pages: , ISSN: , DOI: |
ICMI | 2019-05-30 |
| 2015 |
Hesam Sagha, Eduardo Coutinho, Björn Schuller Exploring the importance of individual differences to the automatic estimation of emotions induced by music published pages: , ISSN: , DOI: |
MM | 2019-05-30 |
| 2015 |
Björn Schuller, Amr El-Desoky Mousa, Vryniotis Vasileios Sentiment analysis, opinion mining: on optimal parameters and performances published pages: , ISSN: 1942-4787, DOI: |
Wiley Interdisciplinary Reviews: Data Mining, Knowledge Discovery | 2019-05-30 |
| 2015 |
Johannes Wagner, Andreas Seiderer, Florian Lingenfelser, Elisabeth André Combining Hierarchical Classification with Frequency Weighting for the Recognition of Eating Conditions published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2016 |
Valstar, M.F., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R. and Pantic, M AVEC 2016 – Depression, Mood, and Emotion Recognition Workshop and Challenge published pages: , ISSN: , DOI: |
ACM Multimedia 2016 | 2019-05-30 |
| 2016 |
Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, Björn Schuller Dynamic active learning based on agreement, applied to emotion recognition in spoken interactions published pages: , ISSN: , DOI: |
ICMI | 2019-05-30 |
| 2016 |
George Trigeorgis, Mihalis A. Nicolaou, Stefanos Zafeiriou, Björn Schuller Deep canonical time warping published pages: , ISSN: , DOI: |
CVPR | 2019-05-30 |
| 2015 |
Fabien Ringeval, Erik Marchi, Marc Mehu, Klaus Scherer, Björn Schuller Face reading from speech –- predicting facial action units from audio cues published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2016 |
M. Aylett, B. Potard, G. Pullin, S. Hennig, D. Braude, M. Antunes Ferreira Don\'t Say Yes, Say Yes: Interacting with Synthetic Speech Using Tonetable published pages: , ISSN: , DOI: |
CHI EA \'16 | 2019-05-30 |
| 2016 |
A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar Computational Models of Emotion, Personality, and Social Relationships for Interactions in Games published pages: , ISSN: , DOI: |
AAMAS | 2019-05-30 |
| 2015 |
Fabien Ringeval, Björn Schuller, Michel Valstar, Roddy Cowie, Maja Pantic AVEC 2015 – The 5th International Audio/Visual Emotion Challenge and Workshop published pages: , ISSN: , DOI: |
MM | 2019-05-30 |
| 2016 |
Amr El-Desoky Mousa, Björn Schuller Deep bidirectional long short-term memory recurrent neural networks for grapheme-to-phoneme conversion utilizing complex many-to many alignments published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2016 |
Zixing Zhang, Fabien Ringeval, Jing Han, Jun Deng, Erik Marchi, Björn Schuller Facing realism in spontaneous emotion recognition from speech: feature enhancement by autoencoder with LSTM neural networks published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2015 |
Ringeval, F., Schuller, B., Valstar, M., Jaiswal, S., Marchi, E., Lalanne, D., Cowie, R. and Pantic, M AV+ EC 2015--The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data published pages: , ISSN: , DOI: |
AVEC | 2019-05-30 |
| 2016 |
Angelo Cafaro, Nadine Glas, Catherine Pelachaud The Effects of Interrupting Behavior on Interpersonal Attitude and Engagement in Dyadic Interactions published pages: , ISSN: , DOI: |
AAMAS | 2019-05-30 |
| 2015 |
Marc Schröder, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark ter Maat, Gary McKeown, Sathish Pammi, Maja Pantic, Catherine Pelachaud, Björn Schuller, Etienne de Sevin, Michel Valstar, Martin Wöllmer Building autonomous sensitive artificial listeners (extended abstract) published pages: , ISSN: , DOI: |
ACII | 2019-05-30 |
| 2016 |
George Trigeorgis, Fabien Ringeval, Raymond Brückner, Erik Marchi, Mihalis Nicolaou, Björn Schuller, Stefanos Zafeiriou Adieu features? End-to-end apeech emotion recognition using a deep convolutional recurrent network published pages: , ISSN: , DOI: |
ICASSP | 2019-05-30 |
| 2015 |
Kun Qian, Zixing Zhang, Fabien Ringeval, Björn Schuller Bird sounds classification by large scale acoustic features, extreme learning machine published pages: , ISSN: , DOI: |
GlobalSIP | 2019-05-30 |
| 2015 |
Eduardo Coutinho, George Trigeorgis, Stefanos Zafeiriou, Björn Schuller Automatically estimating emotion music using long-short term memory recurrent neural networks published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2015 |
Fabien Ringeval, Björn Schuller, Michel Valstar, Shashank Jaiswal, Erik Marchi, Denis Lalanne, Roddy Cowie, Maja Pantic AV+EC 2015 –- The first affect recognition Challenge bridging across audio, video, and physiological Data published pages: , ISSN: , DOI: |
MM | 2019-05-30 |
| 2015 |
Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, Björn Schuller Agreement-based dynamic active learning with least, medium certainty query strategies published pages: , ISSN: , DOI: |
Advances in Active Learning : Bridging Theory, Practice Workshop | 2019-05-30 |
| 2015 |
George Trigeorgis, Eduardo Coutinho, Fabien Ringeval, Erik Marchi, Stefanos Zafeiriou, Björn Schuller The ICL-TUM-PASSAU approach for the MediaEval 2015 “Affective Impact of Movies†task published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2015 |
Lucas Azais, Adrien Payan, Tianjiao Sun, Guillaume Vidal, Tina Zhang, Eduardo Coutinho, Florian Eyben, Björn Schuller Does my speech rock? Automatic assessment of public speaking skills published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2016 |
A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar Playing with Social and Emotional Game Companions published pages: , ISSN: , DOI: |
IVA | 2019-05-30 |
| 2015 |
T. Almaev, B. Martinez and M.F. Valstar Learning to transfer: transferring latent task structures and its application to person-specific facial action unit detection published pages: , ISSN: , DOI: |
ICCV | 2019-05-30 |
| 2015 |
Yue Zhang, Eduardo Coutinho, Zixing Zhang, Michael Adam, Björn Schuller On rater reliability, correlation based dynamic active learning published pages: , ISSN: , DOI: |
ACII | 2019-05-30 |
| 2015 |
Björn Schuller Speech analysis in the big data era published pages: , ISSN: , DOI: |
TSD | 2019-05-30 |
| 2016 |
S. Jaiswal, M.F. Valstar Deep Learning the Dynamic Appearance and Shape of Facial Action Units published pages: , ISSN: , DOI: |
IEEE WACV | 2019-05-30 |
| 2016 |
W. Zhu, A. Chowanda, M.F. Valstar Topic switch models for dialogue management in virtual humans published pages: , ISSN: , DOI: |
IVA | 2019-05-30 |
| 2016 |
Caroline Langlet, Chloe Clavel Adapting sentiment analysis to face-to-face human-agent interactions: from detection to evaluation issues published pages: , ISSN: , DOI: |
ACII | 2019-05-30 |
| 2016 |
Caroline Langlet, Chloe Clavel Grounding the detection of the user’s likes ´ and dislikes on the topic structure of human-agent interactions published pages: , ISSN: 0950-7051, DOI: |
KBS | 2019-05-30 |
| 2016 |
B. Potard, M. Aylett, D. Braude, P. Motlicek An Open Source Kaldi Based Parametric Speech Synthesiser based on DNN published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2016 |
Tobias Baur, Dominik Schiller, Elisabeth André Modeling User’s Social Attitude in a Conversational System published pages: , ISSN: , DOI: |
Emotions and Personality in Personalized Services | 2019-05-30 |
| 2016 |
Yue Zhang, Yuxiang Zhou, Jie Shen, Björn Schuller Semi-autonomous data enrichment based on cross-task labelling of missing targets for holistic speech analysis published pages: , ISSN: , DOI: |
ICASSP | 2019-05-30 |
| 2016 |
George Trigeorgis, Konstantinos Bousmalis, Stefanos Zafeiriou, Björn Schuller A deep matrix factorization method for learning attribute representations published pages: , ISSN: 0162-8828, DOI: |
PAMI | 2019-05-30 |
| 2015 |
X. Wang, M.F. Valstar, B. Martinez, M.H. Khan, T.P. Pridmore TRIC-track: Tracking by Regression with Incrementally Learned Cascades published pages: , ISSN: , DOI: |
ICCV | 2019-05-30 |
| 2016 |
E. Sánchez-Lozano, B. Martinez, G. Tzimiropoulos, M.F. Valstar Cascaded continuous regression for real-time incremental face tracking published pages: , ISSN: , DOI: |
ECCV | 2019-05-30 |
| 2016 |
B. Potard, M. Aylett, D. Braude. Cross Modal Evaluation of High Quality Emotional Speech Synthesis with the Virtual Human Toolkit published pages: , ISSN: , DOI: |
IVA | 2019-05-30 |
| 2016 |
E. Sánchez-Lozano, B. Martinez, M.F. Valstar Cascaded Regression with Sparsified Feature Covariance Matrix for Facial Landmark Detection published pages: , ISSN: 0167-8655, DOI: |
Pattern Recognition Letters | 2019-05-30 |
| 2016 |
Clavel, C., Cafaro, A., Campano, S., & Pelachaud, C. Fostering user engagement in face-to-face human-agent interactions: a survey published pages: , ISSN: , DOI: |
Toward Robotic Socially Believable Behaving Systems-Volume II | 2019-05-30 |
| 2015 |
Eduardo Coutinho, Björn Schuller Automatic estimation of biosignals from the human voice published pages: , ISSN: 2329-9290, DOI: |
Science, Special Supplement on Advances in Computational Psychophysiology | 2019-05-30 |
| 2015 |
Tobias Baur, Gregor Mehlmann, Ionut Damian, Florian Lingenfelser, Johannes Wagner, Birgit Lugrin, Elisabeth André, Patrick Gebhard Context-Aware Automated Analysis and Annotation of Social Human-Agent Interactions published pages: , ISSN: 2160-6455, DOI: |
ACM Transactions on Interactive Intelligent Systems (TiiS) 5.2 | 2019-05-30 |
| 2015 |
M. Wester, M. Aylett, M. Tomalin, R. Dall Artificial Personality and Disfluency published pages: , ISSN: , DOI: |
Interspeech | 2019-05-30 |
| 2015 |
Kornelia Gentsch, Eduardo Coutinho, Florian Eyben, Björn Schuller, Klaus R. Scherer Classifying emotion-antecedent appraisal in brain activity using machine learning methods published pages: , ISSN: , DOI: |
2019-05-30 | |
| 2015 |
Erik Marchi, Fabio Vesperini, Felix Weninger, Florian Eyben, Stefano Squartini, Björn Schuller Non-linear prediction with LSTM recurrent neural networks for acoustic novelty detection published pages: , ISSN: , DOI: |
OJCNN | 2019-05-30 |
| 2016 |
Björn Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini The INTERSPEECH 2016 Computational Paralinguistics Challenge: Deception & Sincerity published pages: , ISSN: , DOI: |
ICMI | 2019-05-30 |
| 2015 |
S. Jaiswal, B. Martinez, M.F. Valstar Learning to combine local models for Facial Action Unit detection published pages: , ISSN: , DOI: |
FERA | 2019-05-30 |
| 2015 |
B. Martinez and M.F. Valstar L21-based regression and prediction accumulation across views for robust facial landmark detection published pages: , ISSN: 0262-8856, DOI: |
Image and Vision Computing | 2019-05-30 |
Are you the coordinator (or a participant) of this project? Plaese send me more information about the "ARIA-VALUSPA" project.
For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.
Send me an email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.
Thanks. And then put a link of this page into your project's website.
The information about "ARIA-VALUSPA" are provided by the European Opendata Portal: CORDIS opendata.