Opendata, web and dolomites


Holistic Deep Modelling for User Recognition and Affective Social Behaviour Sensing

Total Cost €


EC-Contrib. €






 HOL-DEEP-SENSE project word cloud

Explore the words cloud of the HOL-DEEP-SENSE project. It provides you a very rough idea of what is the project "HOL-DEEP-SENSE" about.

visual    combined    central    human    architecture    ontological    unseen    context    auditory    affective    fusion    envision    net    interact    learning    social    true    iot    computing    standard    datasets    socially    domain    networks    skills    edge    infer    verifying    comprising    holistic    detection    technologies    unified    hitherto    builds    trained    augmenting    simon    assistants    hol    deep    signal    gains    wellbeing    perform    electronics    acumen    pattern    generation    assimilate    sought    sensors    construct    connected    phenomena    physiological    sensing    relatedness    communication    associative    herald    virtual    ai    computers    interaction    intelligent    sense    environments    humans    machines    perception    recognition    emotionally    competencies    topology    salience    channels    spontaneous    natural    machine    transformation    transfer    robots    cues    modal    universal    health    contrast    inspired    indispensable    subdivided    sensitivity    adapt    neural   

Project "HOL-DEEP-SENSE" data sheet

The following table provides information about the project.


Organization address
postcode: 86159

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country Germany [DE]
 Total cost 199˙828 €
 EC max contribution 199˙828 € (100%)
 Programme 1. H2020-EU.1.3.2. (Nurturing excellence by means of cross-border and cross-sector mobility)
 Code Call H2020-MSCA-IF-2017
 Funding Scheme MSCA-IF-GF
 Starting year 2018
 Duration (year-month-day) from 2018-10-01   to  2022-03-31


Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    UNIVERSITAET AUGSBURG DE (AUGSBURG) coordinator 199˙828.00


 Project objective

'The 'Holistic Deep Modelling for User Recognition and Affective Social Behaviour Sensing' (HOL-DEEP-SENSE) project aims at augmenting affective machines such as virtual assistants and social robots with human-like acumen based on holistic perception and understanding abilities.

Social competencies comprising context awareness, salience detection and affective sensitivity present a central aspect of human communication, and thus are indispensable for enabling natural and spontaneous human-machine interaction. Therefore, with the aim to advance affective computing and social signal processing, we envision a 'Social Intelligent Multi-modal Ontological Net' (SIMON) that builds on technologies at the leading edge of deep learning for pattern recognition. In particular, our approach is driven by multi-modal information fusion using end-to-end deep neural networks trained on large datasets, allowing SIMON to exploit combined auditory, visual and physiological analysis. In contrast to standard machine learning systems, SIMON makes use of task relatedness to adapt its topology within a novel construct of subdivided neural networks. Through deep affective feature transformation, SIMON is able to perform associative domain adaptation via transfer and multi-task learning, and thus can infer user characteristics and social cues in a holistic context.

This new unified sensing architecture will enable affective computers to assimilate ontological human phenomena, leading to a step change in machine perception. This will offer a wide range of applications for health and wellbeing in future IoT-inspired environments, connected to dedicated sensors and consumer electronics.

By verifying the gains through holistic sensing, the project will show the true potential of the much sought-after emotionally and socially intelligent AI, and herald a new generation of machines with hitherto unseen skills to interact with humans via universal communication channels.'

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "HOL-DEEP-SENSE" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email ( and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "HOL-DEEP-SENSE" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.1.3.2.)

BrownianReactivation (2019)

Neural stochasticity and criticality in memory replay

Read More  

CarboPorph (2020)

Novel Cyclocarbon-Porphyrin Systems: Synthesis and Properties

Read More  

pyrroQuin (2020)

Synthesis and Biological Evaluation of Pyrroquinoline Pseudo-Natural Products

Read More