Opendata, web and dolomites


Holistic Deep Modelling for User Recognition and Affective Social Behaviour Sensing

Total Cost €


EC-Contrib. €






 HOL-DEEP-SENSE project word cloud

Explore the words cloud of the HOL-DEEP-SENSE project. It provides you a very rough idea of what is the project "HOL-DEEP-SENSE" about.

perception    unified    virtual    technologies    affective    wellbeing    environments    central    social    context    generation    signal    machine    contrast    hitherto    herald    spontaneous    ai    fusion    machines    edge    adapt    detection    inspired    deep    relatedness    transformation    learning    holistic    hol    sensing    auditory    cues    datasets    net    connected    phenomena    acumen    assistants    natural    skills    salience    intelligent    unseen    socially    health    augmenting    true    subdivided    modal    simon    channels    assimilate    topology    architecture    emotionally    sought    envision    associative    verifying    interaction    domain    trained    builds    sense    recognition    ontological    computing    standard    electronics    physiological    gains    sensitivity    communication    universal    sensors    indispensable    iot    visual    interact    neural    humans    robots    computers    combined    pattern    comprising    construct    networks    competencies    human    infer    transfer    perform   

Project "HOL-DEEP-SENSE" data sheet

The following table provides information about the project.


Organization address
postcode: 86159

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country Germany [DE]
 Total cost 199˙828 €
 EC max contribution 199˙828 € (100%)
 Programme 1. H2020-EU.1.3.2. (Nurturing excellence by means of cross-border and cross-sector mobility)
 Code Call H2020-MSCA-IF-2017
 Funding Scheme MSCA-IF-GF
 Starting year 2018
 Duration (year-month-day) from 2018-10-01   to  2022-03-31


Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    UNIVERSITAET AUGSBURG DE (AUGSBURG) coordinator 199˙828.00


 Project objective

'The 'Holistic Deep Modelling for User Recognition and Affective Social Behaviour Sensing' (HOL-DEEP-SENSE) project aims at augmenting affective machines such as virtual assistants and social robots with human-like acumen based on holistic perception and understanding abilities.

Social competencies comprising context awareness, salience detection and affective sensitivity present a central aspect of human communication, and thus are indispensable for enabling natural and spontaneous human-machine interaction. Therefore, with the aim to advance affective computing and social signal processing, we envision a 'Social Intelligent Multi-modal Ontological Net' (SIMON) that builds on technologies at the leading edge of deep learning for pattern recognition. In particular, our approach is driven by multi-modal information fusion using end-to-end deep neural networks trained on large datasets, allowing SIMON to exploit combined auditory, visual and physiological analysis. In contrast to standard machine learning systems, SIMON makes use of task relatedness to adapt its topology within a novel construct of subdivided neural networks. Through deep affective feature transformation, SIMON is able to perform associative domain adaptation via transfer and multi-task learning, and thus can infer user characteristics and social cues in a holistic context.

This new unified sensing architecture will enable affective computers to assimilate ontological human phenomena, leading to a step change in machine perception. This will offer a wide range of applications for health and wellbeing in future IoT-inspired environments, connected to dedicated sensors and consumer electronics.

By verifying the gains through holistic sensing, the project will show the true potential of the much sought-after emotionally and socially intelligent AI, and herald a new generation of machines with hitherto unseen skills to interact with humans via universal communication channels.'

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "HOL-DEEP-SENSE" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email ( and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "HOL-DEEP-SENSE" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.1.3.2.)

MBL-Fermions (2020)

Probing many-body localization dynamics using ultracold fermions in an optical lattice

Read More  

SmartSAST (2020)

Non-covalent photoresponsive tags for photoacoustic imaging: Giving voice to living matter

Read More  

MEMS0P (2019)

“Microelectromechanical System wake-up receiver for Zero-Power sensor nodes”

Read More