Opendata, web and dolomites

MuMMER SIGNED

MultiModal Mall Entertainment Robot

Total Cost €

0

EC-Contrib. €

0

Partnership

0

Views

0

Project "MuMMER" data sheet

The following table provides information about the project.

Coordinator
UNIVERSITY OF GLASGOW 

Organization address
address: UNIVERSITY AVENUE
city: GLASGOW
postcode: G12 8QQ
website: www.gla.ac.uk

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country United Kingdom [UK]
 Project website http://mummer-project.eu/
 Total cost 5˙345˙137 €
 EC max contribution 4˙297˙835 € (80%)
 Programme 1. H2020-EU.2.1.1. (INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT))
 Code Call H2020-ICT-2015
 Funding Scheme RIA
 Starting year 2016
 Duration (year-month-day) from 2016-03-01   to  2020-02-29

 Partnership

Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    UNIVERSITY OF GLASGOW UK (GLASGOW) coordinator 815˙178.00
2    SOFTBANK ROBOTICS EUROPE FR (PARIS) participant 958˙750.00
3    HERIOT-WATT UNIVERSITY UK (EDINBURGH) participant 904˙287.00
4    CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS FR (PARIS) participant 851˙771.00
5    Teknologian tutkimuskeskus VTT Oy FI (Espoo) participant 600˙347.00
6    KIINTEISTO OY IDEAPARK AB FI (LEMPÄÄLÄ) participant 167˙500.00
7    FONDATION DE L'INSTITUT DE RECHERCHE IDIAP CH (MARTIGNY) participant 0.00

Map

 Project objective

'In MuMMER ('MultiModal Mall Entertainment Robot'), we propose to address the important and growing market of consumer entertainment robotics by advancing the technologies needed to support this area of robotics, and also by explicitly addressing issues of consumer acceptance, thus creating new European business and employment opportunities in consumer robotics. Specifically, we will develop a humanoid robot (based on Aldebaran's Pepper platform) able to engage and interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers, to develop truly engaging robot behaviours, including telling jokes or playing games, as well as providing guidance, information, and collecting customer feedback. Crucially, our robot will exhibit behaviour that is socially appropriate, combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, social-signal processing, high-level action selection, and human-aware robot navigation.

Throughout the project, the robot will be deployed in a large public shopping mall in Finland: initially for short visits to aid in collaborative scenario development, co-design, and system evaluation, and later for a long-term field study in the 4th year of the project. Through our co-design approach, we will both study and foster acceptance of consumer robots and thus positively influence the consumer markets of service robots. '

 Deliverables

List of deliverables.
Project website and social media dissemination Websites, patent fillings, videos etc. 2019-05-22 22:13:57
Social state processing components (initial) Other 2019-05-22 22:13:58
Co-design of use scenarios and user requirements Documents, reports 2019-05-22 22:13:57
Socially engaging interaction management component (initial) Other 2019-05-22 22:13:57
Development of technical infrastructure Other 2019-05-22 22:13:58
Audio-visual algorithms for person tracking and characterization (baseline) Other 2019-05-22 22:13:58
Initial data management plan Open Research Data Pilot 2019-05-22 22:13:58
Initial components of Human-aware motion planner Other 2019-05-22 22:13:58
Social state processing components (upgrade) Other 2019-05-22 22:13:56
Audio-visual algorithms for person tracking and characterization (upgrade) Other 2019-05-22 22:13:57
Socially engaging interaction management component (upgrade) Other 2019-05-22 22:13:57
Initial WP5 software ready for integration on real robot Other 2019-05-22 22:13:56
Initial integrated robot system Demonstrators, pilots, prototypes 2019-05-22 22:13:56

Take a look to the deliverables list in detail:  detailed list of MuMMER deliverables.

 Publications

year authors and title journal last update
List of publications.
2016 Mary Ellen Foster
Public-space human-robot interaction in the MuMMER project
published pages: , ISSN: , DOI:
The 3rd Workshop on Public Space Human-Robot Interaction (PubRob 2016), at RO-MAN 2016, New York, NY, August 2016 2019-06-18
2016 Mary Ellen Foster, Rachid Alami, Olli Gestranius, Oliver Lemon, Marketta Niemelä, Jean-Marc Odobez, Amit Kumar Pandey
The MuMMER project: Engaging human-robot interaction in real-world public spaces
published pages: 753-763, ISSN: , DOI: 10.1007/978-3-319-47437-3_74
8th International Conference on Social Robotics, ICSR 2016, Kansas City, MO, USA, November 2016 2019-06-18
2016 Harmish Khambhaita, Jorge Rios-Martinez, and Rachid Alami
Head-Body Motion Coordination for Human Aware Robot Navigation
published pages: , ISSN: , DOI:
9th International Workshop on Human Friendly Robotics, 29. & 30. September 2016, Genoa, Italy 2019-06-18
2017 Mary Ellen Foster, Ronald P. A. Petrick
Separating Representation, Reasoning, and Implementation for Interaction Management: Lessons from Automated Planning
published pages: 93-107, ISSN: , DOI: 10.1007/978-981-10-2585-3_7
Dialogues with Social Robots: Enablements, Analyses, and Evaluation 2019-06-18
2016 Jules Waldhart and Mamoun Gharbi and Rachid Alami
A Novel Software Combining Task and Motion Planning for Human-Robot Interaction
published pages: , ISSN: , DOI:
AI-HRI 2016, AAAI Fall Symposium Series November 17-19, Arlington, VA, USA 2019-06-18
2017 Y. Yu, K. Funes, and J.-M. Odobez
Robust and Accurate 3D Head Pose Estimation through 3DMM and Online Head Model Reconstruction
published pages: , ISSN: , DOI:
12th IEEE Conference on Automatic Face and Gesture Recognition 2019-06-18
2016 Petrick, Ronald P. A.; Foster, Mary Ellen
Using General-Purpose Planning for Action Selection in Human-Robot Interaction
published pages: , ISSN: , DOI:
AAAI Fall Symposium on Artificial Intelligence for Human-Robot Interaction (AI-HRI 2016) 1 2019-06-18
2016 Yanchao Yu, Arash Eshghi, and Oliver Lemon
Training an adaptive dialogue policy for interactive learning of visually grounded word meaning
published pages: 339-349, ISSN: , DOI:
Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue 2019-06-18
2018 Devin, S. and Vrignaud, C. and Belhassein, K. and Clodic, A. and Carreras, O. and Alami, R.
Evaluating the Pertinence of Robot Decisions in a Human-Robot Joint Action Context: The PeRDITA Questionnaire
published pages: , ISSN: , DOI:
Proceedings of the 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) 2019-05-27
2018 Yu, Yu and Liu, Gang and Odobez, Jean-Marc
Deep Multitask Gaze Estimation with a Constrained Landmark-Gaze Model
published pages: , ISSN: , DOI:
European Conference on Computer Vision Workshop 2019-05-27
2018 Yu Yu, Kenneth Alberto Funes Mora, Jean-Marc Odobez
HeadFusion: 360 Head Pose Tracking Combining 3D Morphable Model and 3D Reconstruction
published pages: 2653-2667, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2018.2841403
IEEE Transactions on Pattern Analysis and Machine Intelligence 40/11 2019-05-27
2018 Bart Craenen and Amol Deshmukh and Mary Ellen Foster and Alessandro Vinciarelli
Shaping Gestures to Shape Personalities: The Relationship Between Gesture Parameters, Attributed Personality Traits and Godspeed Scores
published pages: , ISSN: , DOI:
Proceedings of the 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) 2019-05-29
2018 Nam Le, Jean-Marc Odobez
Robust and Discriminative Speaker Embedding via Intra-Class Distance Variance Regularization
published pages: 2257-2261, ISSN: , DOI: 10.21437/Interspeech.2018-1685
Interspeech 2018 2019-05-29
2018 Bart Craenen and Amol Deshmukh and Mary Ellen Foster and Alessandro Vinciarelli
Do We Really Like Robots that Match our Personality? The Case of Big-Five Traits, Godspeed Scores and Robotic Gestures
published pages: , ISSN: , DOI:
Proceedings of IEEE RO-MAN 2018 2019-05-29
2018 Bart Craenen and Amol Deshmukh and Mary Ellen Foster and Alessandro Vinciarelli
Shaping Gestures to Shape Personality: Big-Five Traits, Godspeed Scores and the Similarity-Attraction Effect
published pages: , ISSN: , DOI:
Proceedings of the 17th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2018) 2019-05-29
2018 Ioannis Papaioannou, Christian Dondrup, Oliver Lemon
Human-Robot Interaction Requires More Than Slot Filling - Multi-Threaded Dialogue for Collaborative Tasks and Social Conversation
published pages: 61-64, ISSN: , DOI: 10.21437/ai-mhri.2018-15
FAIM/ISCA Workshop on Artificial Intelligence for Multimodal Human Robot Interaction 2019-05-29
2018 Fraser, Jamie and Papaioannou, Ioannis and Lemon, Oliver
Spoken Conversational AI in Video Games-Emotional Dialogue Management Increases User Engagement
published pages: , ISSN: , DOI: 10.1145/3267851.3267896
Proceedings of International Conference on Intelligent VirtualAgents (IVA \'18), 2019-05-29
2018 Heikkila, Paivi and Lammi, Hanna and Belhassein, Kathleen
Where Can I Find a Pharmacy? - Human-Driven Design of a Service Robot\'s Guidance Behaviour
published pages: , ISSN: , DOI:
Proceedings of the Fourth Workshop on Public-Space Human-Robot Interaction (PubRob 2018) 2019-05-29
2017 Khambhaita, Harmish and Alami, Rachid
Viewing Robot Navigation in Human Environment as a Cooperative Activity
published pages: , ISSN: , DOI:
International Symposium on Robotics Research (ISSR 2017) 2019-05-29
2018 Andrea Vanzo, Jose L. Part, Yanchao Yu, Daniele Nardi, and Oliver Lemon
Incrementally Learning Semantic Attributes through Dialogue Interaction
published pages: 865-873, ISSN: , DOI:
Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS \'18) 2019-05-29
2018 Yuanzhouhan Cao and Olivier Canevet and Jean-Marc Odobez
Leveraging Convolutional Pose Machines for Fast and Accurate Head Pose Estimation
published pages: , ISSN: , DOI:
IEEE/RSJ International Conference on Intelligent Robots and Systems 2019-05-29
2018 Severin Lemaignan and Yoan Sallami and Christopher Wallbridge and Aurelie Clodic and Tony Belpaeme and Rachid Alami
Underworlds: Cascading situation assessment for robots
published pages: , ISSN: , DOI:
Proceedings of IROS 2018 2019-05-29
2018 Martinez-Gonzalez, Angel and Villamizar, Michael and Canevet, Olivier and Odobez, Jean-Marc
Investigating Depth Domain Adaptation for Efficient Human Pose Estimation
published pages: , ISSN: , DOI:
2018 European Conference on Computer Vision - Workshops, {ECCVW} 2018 2019-05-29
2017 R. Siegfried and J.-M. Odobez
Supervised Gaze Bias Correction for Gaze Coding in Interactions
published pages: , ISSN: , DOI:
Proceedings of the Communication by Gaze Interaction symposium (COGAIN) 2019-05-29
2018 Jules Waldhart and Aurelie Clodic and Rachid Alami
Planning Human and Robot Placements for Shared Visual Perspective, the SVP Planner
published pages: , ISSN: , DOI:
Proceedings of IROS workshop Robotic Co-workers 4.0 2019-05-29
2018 Amit Kumar Pandey, Rodolphe Gelin
A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind
published pages: 40-48, ISSN: 1070-9932, DOI: 10.1109/MRA.2018.2833157
IEEE Robotics & Automation Magazine 25/3 2019-05-29
2018 Dondrup, Christian and Baillie, Lynne and Broz, Frank and Lohan, Katrin
How can we transition from lab to the real world with our HCI and HRI setups?
published pages: , ISSN: , DOI:
Proceedings of the Fourth Workshop on Public-Space Human-Robot Interaction (PubRob 2018) 2019-05-29
2017 Belhassein, Kathleen and Clodic, Aurelie and Cochet, Helene and Niemela, Marketta and Heikkila, Paivi and Lammi, Hanna and Tammela, Antti
Human-Human Guidance Study
published pages: , ISSN: , DOI:
2019-05-29
2017 Papaioannou, Ioannis and Curry, Amanda Cercas and Part, Jose L and Shalyminov, Igor and Xu, Xinnuo and Yu, Yanchao and Du{v{s}}ek, Ondrej and Rieser, Verena and Lemon, Oliver
Alana: Social dialogue using an ensemble model and a ranker trained on user feedback
published pages: , ISSN: , DOI:
2019-05-29
2018 Liu, Gang and Yu, Yu and Funes Mora, Kenneth Alberto and Odobez, Jean-Marc
A Differential Approach for Gaze Estimation with Calibration
published pages: , ISSN: , DOI:
29TH BRITISH MACHINE VISION CONFERENCE (BMVC) 2019-05-29
2017 Marketta Niemelä, Päivi Heikkilä, Hanna Lammi, Virpi Oksman
Shopping Mall Robots -- Opportunities and Constraints from the Retailer and Manager Perspective
published pages: 485-494, ISSN: , DOI: 10.1007/978-3-319-70022-9_48
Social Robotics 2019-05-29
2018 Weipeng He, Petr Motlicek, Jean-Marc Odobez
Joint Localization and Classification of Multiple Sound Sources Using a Multi-task Neural Network
published pages: 312-316, ISSN: , DOI: 10.21437/Interspeech.2018-1269
Interspeech 2018 2019-05-29
2017 Katrin Solveig Lohan, Hagen Lehmann, Christian Dondrup, Frank Broz, Hatice Kose
Enriching the Human-Robot Interaction Loop with Natural, Semantic, and Symbolic Gestures
published pages: 1-21, ISSN: , DOI: 10.1007/978-94-007-7194-9_136-1
Humanoid Robotics: A Reference 2019-05-29
2018 Martinez-Gonzalez, Angel and Villamizar, Michael and Canevet, Olivier and Odobez, Jean-Marc
Real-time Convolutional Networks for Depth-based Human Pose Estimation
published pages: , ISSN: , DOI:
2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018 2019-05-29
2018 Mary Ellen Foster
Natural Language Generation for Public-Space Social Robots
published pages: , ISSN: , DOI:
Proceedings of the 4th Workshop on Public Space Human-Robot Interaction (PubRob 2018) 2019-05-29
2018 Amol Deshmukh and Bart Craenen and Mary Ellen Foster and Alessandro Vinciarelli
The More I Understand it, the Less I Like it: The Relationship Between Understandability and Godspeed Scores for Robotic Gestures
published pages: , ISSN: , DOI:
Proceedings of the 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) 2019-05-29

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "MUMMER" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "MUMMER" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.2.1.1.)

NGI0-Discovery (2018)

NGI Zero Discovery

Read More  

WASP (2019)

Wearable Applications enabled by electronic Systems on Paper

Read More  

SmartCLIDE (2020)

Smart Cloud Integrated Development Environment supporting the full-stack implementation, composition and deployment of data-centered services and applications in the cloud

Read More