Opendata, web and dolomites


Holistic Deep Modelling for User Recognition and Affective Social Behaviour Sensing

Total Cost €


EC-Contrib. €






 HOL-DEEP-SENSE project word cloud

Explore the words cloud of the HOL-DEEP-SENSE project. It provides you a very rough idea of what is the project "HOL-DEEP-SENSE" about.

context    unified    electronics    central    environments    modal    spontaneous    iot    builds    ontological    emotionally    interact    auditory    sense    technologies    sought    transfer    learning    interaction    neural    networks    machine    associative    sensors    comprising    machines    socially    envision    natural    acumen    architecture    health    phenomena    ai    competencies    sensing    wellbeing    assimilate    human    subdivided    simon    relatedness    domain    hol    channels    intelligent    humans    gains    affective    pattern    fusion    robots    assistants    net    adapt    topology    signal    visual    physiological    computers    perception    transformation    augmenting    connected    datasets    inspired    virtual    construct    herald    verifying    combined    recognition    unseen    standard    communication    generation    infer    salience    detection    true    perform    computing    trained    cues    skills    sensitivity    contrast    universal    social    indispensable    deep    edge    holistic    hitherto   

Project "HOL-DEEP-SENSE" data sheet

The following table provides information about the project.


Organization address
postcode: 86159

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country Germany [DE]
 Total cost 199˙828 €
 EC max contribution 199˙828 € (100%)
 Programme 1. H2020-EU.1.3.2. (Nurturing excellence by means of cross-border and cross-sector mobility)
 Code Call H2020-MSCA-IF-2017
 Funding Scheme MSCA-IF-GF
 Starting year 2018
 Duration (year-month-day) from 2018-10-01   to  2022-03-31


Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    UNIVERSITAET AUGSBURG DE (AUGSBURG) coordinator 199˙828.00


 Project objective

'The 'Holistic Deep Modelling for User Recognition and Affective Social Behaviour Sensing' (HOL-DEEP-SENSE) project aims at augmenting affective machines such as virtual assistants and social robots with human-like acumen based on holistic perception and understanding abilities.

Social competencies comprising context awareness, salience detection and affective sensitivity present a central aspect of human communication, and thus are indispensable for enabling natural and spontaneous human-machine interaction. Therefore, with the aim to advance affective computing and social signal processing, we envision a 'Social Intelligent Multi-modal Ontological Net' (SIMON) that builds on technologies at the leading edge of deep learning for pattern recognition. In particular, our approach is driven by multi-modal information fusion using end-to-end deep neural networks trained on large datasets, allowing SIMON to exploit combined auditory, visual and physiological analysis. In contrast to standard machine learning systems, SIMON makes use of task relatedness to adapt its topology within a novel construct of subdivided neural networks. Through deep affective feature transformation, SIMON is able to perform associative domain adaptation via transfer and multi-task learning, and thus can infer user characteristics and social cues in a holistic context.

This new unified sensing architecture will enable affective computers to assimilate ontological human phenomena, leading to a step change in machine perception. This will offer a wide range of applications for health and wellbeing in future IoT-inspired environments, connected to dedicated sensors and consumer electronics.

By verifying the gains through holistic sensing, the project will show the true potential of the much sought-after emotionally and socially intelligent AI, and herald a new generation of machines with hitherto unseen skills to interact with humans via universal communication channels.'

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "HOL-DEEP-SENSE" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email ( and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "HOL-DEEP-SENSE" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.1.3.2.)

NaWaTL (2020)

Narrative, Writing, and the Teotihuacan Language: Exploring Language History Through Phylogenetics, Epigraphy and Iconography

Read More  

SIMIS (2020)

Strongly Interacting Mass Imbalanced Superfluid with ultracold fermions

Read More  

iRhomADAM (2020)

Uncovering the role of the iRhom2-ADAM17 interaction in inflammatory signalling

Read More