Opendata, web and dolomites

Sound of Vision

Natural sense of vision through acoustics and haptics

Total Cost €


EC-Contrib. €






 Sound of Vision project word cloud

Explore the words cloud of the Sound of Vision project. It provides you a very rough idea of what is the project "Sound of Vision" about.

located    competences    intuitive    conveyed    functional    specialists    validations    perception    sensors    validate    subsequent    original    neuroplasticity    bci    specialized    assisting    courses    social    created    haptics    person    model    goes    representation    computer    generating    first    space    substitution    conveying    actually    localization    last    haptic    combined    feedback    brain    audio    outdoor    invasive    affordable    surrounding    visual    3d    surroundings    video    uses    repetitive    algorithms    psychophysics    experimental    lifestyle    wearable    protocols    neurologists    blind    final    prototype    commercialize    friends    visually    people    interface    auditory    impaired    otherwise    commercial    environment    time    training    delivered    sources    objects    assistive    tags    followed    updated    sonification    indoor    sold    families    free    impressive    transformed    impairments    accessible    series    complementary    consists    sensory    keywords    predefined    assist    sound    improvements    vision    restoration    hardware    software   

Project "Sound of Vision" data sheet

The following table provides information about the project.


Organization address
postcode: 101

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country Iceland [IS]
 Project website
 Total cost 3˙960˙709 €
 EC max contribution 3˙960˙709 € (100%)
 Programme 1. H2020-EU.3.1.4. (Active ageing and self-management of health)
 Code Call H2020-PHC-2014-single-stage
 Funding Scheme RIA
 Starting year 2015
 Duration (year-month-day) from 2015-01-01   to  2017-12-31


Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    HASKOLI ISLANDS IS (REYKJAVIK) coordinator 1˙336˙898.00
5    POLITECHNIKA LODZKA PL (LODZ) participant 352˙906.00
6    INFO WORLD SRL RO (BUCURESTI SECTOR 2) participant 269˙118.00
8    SZECHENYI ISTVAN UNIVERSITY HU (GYOR) participant 149˙625.00


 Project objective

Sound of Vision (Vision restoration through sound and haptics) will design, implement and validate an original non-invasive hardware and software system to assist visually impaired people by creating and conveying an auditory representation of the surrounding environment. This representation will be created, updated and delivered to a blind person continuously and in real time. This system will help visually impaired people in any kind of environment (indoor/outdoor), without the need for predefined tags/sensors located in the surroundings.

The process of assisting visually impaired people proposed by Sound of Vision consists of a series of repetitive steps. The first step uses hardware and software for generating a 3D representation of the surrounding environment. In the second step, objects are identified within the 3D model and the information is then transformed into 3D sound and haptics sources. In the last step, all the 3D sound and haptics sources are combined and conveyed to the user, using specialized wearable hardware and algorithms.

A functional prototype will be developed, followed by experimental validations and subsequent improvements, according to the feedback provided by visually impaired people, training specialists and neurologists. The product thus obtained will be sold as a hardware and software system, as well as some training courses that will help blind people use the system.

The consortium has the necessary complementary competences to design and develop the proposed system, to test the prototype, establish training protocols and also to commercialize the system as an intuitive and accessible final product.

Sound of Vision is a concept that goes beyond the state of the art of the visual sensory substitution systems, having the potential to become an affordable commercial product that will actually help blind people. This system can have an impressive social impact, improving the lifestyle of blind people, and also of their families and friends, on which they would otherwise depend.

Free keywords (updated): Visual impairments; brain-computer interface (BCI); Neuroplasticity; Psychophysics; audio/video processing; wearable assistive devices; sonification; sound localization; haptic space perception.


List of deliverables.
Scientific papers IV Documents, reports 2019-03-08 17:52:28
Project website (updated) Websites, patent fillings, videos etc. 2019-03-08 17:52:32
Doctoral reports Documents, reports 2018-12-11 10:53:01
Usage questionnaires Other 2018-12-11 10:52:45
Scientific review (survey) articles Documents, reports 2018-12-11 10:53:07
Scientific papers III Documents, reports 2018-12-11 10:52:57
Scientific papers II Documents, reports 2018-12-11 10:52:37
Scientific papers I Documents, reports 2018-12-11 10:52:37
Project web site Websites, patent fillings, videos etc. 2018-12-11 10:52:51
Final version of the project website Websites, patent fillings, videos etc. 2018-12-11 10:52:50
Project website (updated II) Websites, patent fillings, videos etc. 2018-12-11 10:52:44
Project website (updated III) Websites, patent fillings, videos etc. 2018-12-11 10:52:59

Take a look to the deliverables list in detail:  detailed list of Sound of Vision deliverables.


year authors and title journal last update
List of publications.
2017 Iulia-Cristina Stănică, Maria-Iuliana Dascălu, Alin Moldoveanu, Florica Moldoveanu
An Innovative Solution Based on Virtual Reality to Treat Phobia
published pages: 1-13, ISSN: 2165-9508, DOI: 10.5171/2017.155350
International Journal of Interactive worlds 2019-05-29
2016 I.-C. Stanica, A. Moldoveanu, C.-N. Bodea, M.-I. Dascalu, S. Hostiuc
A survey of virtual reality applications as psychotherapeutic tools to treat phobias
published pages: , ISSN: , DOI:
2016 Sorin Hostiuc, Alin Moldoveanu, Maria-Iuliana Dascălu, Runar Unnthorsson, Ómar I. Jóhannesson, Ioan Marcus
Translational research—the need of a new bioethics approach
published pages: , ISSN: 1479-5876, DOI: 10.1186/s12967-016-0773-4
Journal of Translational Medicine 14/1 2019-05-29
2015 Oana Bălan, Alin Moldoveanu, Florica Moldoveanu, Alexandru Butean
Developing a navigational 3D audio game with hierarchical levels of difficulty for the visually impaired players
published pages: 49-54, ISSN: 2344-1690, DOI:
Romanian Conference on Human-Computer Interaction 2019-05-29
2017 H. Nagy, Á. Csapó and G. Wersényi
Audio-based mobile applications for Android using multisensory feedback in assistive technology
published pages: , ISSN: , DOI:
2016 Oana-Maria FERCHE, Alin MOLDOVEANU, Florica MOLDOVEANU, Alexandra VOINEA and Victor ASAVEI
Challenges and Issues for Successfully Applying Virtual Reality in Medical Rehabilitation
published pages: , ISSN: , DOI: 10.12753/2066-026X-15-073
2017 Wersényi, György; Répás, József
Comparison of HRTFs from a Dummy-Head Equipped with Hair, Cap, and Glasses in a Virtual Audio Listening Task over Equalized Headphones
published pages: , ISSN: , DOI:
Proceedings of the 142nd Convention of the Audio Engineering Society 9766 2019-05-29
2016 Simone Spagnol, Erica Tavazzi, Federico Avanzini
Distance rendering and perception of nearby virtual sound sources with a near-field filter model
published pages: , ISSN: 0001-4966, DOI:
Journal of the Acoustical Society of America (JASA) 2019-05-29
2017 M. Owczarek, P. Skulimowski and P. Strumiłło
A mobile system for interactive sonification of 3D scenes from “U-disparity” representation
published pages: , ISSN: , DOI:
2016 I.-C. Stanica, M.-I. Dascalu, A. Moldoveanu and F. Moldoveanu
Le Traitement Des Phobies Par La Réalité Virtuelle
published pages: , ISSN: , DOI:
2016 P. Skulimowski, M. Owczarek, M. Bujacz and P. Strumillo
Interactive sonification of the U-disparity maps of 3D scenes
published pages: , ISSN: , DOI:
2017 Nagy, Hunor; Wersényi, György
Evaluation of Training to Improve Auditory Memory Capabilities on a Mobile Device Based on a Serious Game Application
published pages: , ISSN: , DOI:
2016 C.-D. Nichifor, A. Moldoveanu, C.-N. Bodea, M.-I. Dascalu, A.-M. Neagu
Cognitive training games to improve learning skills
published pages: , ISSN: , DOI:
2018 Charalampos Saitis, Mohammad Zavid Parvez, Kyriaki Kalimeri
Cognitive Load Assessment from EEG and Peripheral Biosignals for the Design of Visually Impaired Mobility Aids
published pages: 1-9, ISSN: 1530-8669, DOI: 10.1155/2018/8971206
Wireless Communications and Mobile Computing 2018 2019-05-29
2016 Ómar Jóhannesson, Oana Balan, Runar Unnthorsson, Alin Moldoveanu, Árni Kristjánsson
The Sound of Vision Project: On the Feasibility of an Audio-Haptic Representation of the Environment, for the Visually Impaired
published pages: 20, ISSN: 2076-3425, DOI: 10.3390/brainsci6030020
Brain Sciences 6/3 2019-05-29
2015 Simone Spagnol, Erica Tavazzi, Federico Avanzini
Relative Auditory Distance Discrimination with Virtual Nearby Sound Sources
published pages: , ISSN: 2413-6689, DOI:
Proc. of the 18th Int. Conference on Digital Audio Effects (DAFx-15) 2019-05-29
2017 O. Bălan, A. Moldoveanu, F. Moldoveanu, H. Nagy, G. Wersényi and R. Unnthorsson
Improving the Audio Game--Playing Performances of People with Visual Impairments Through Multimodal Training
published pages: , ISSN: 0145-482X, DOI:
Journal of Visual Impairment & Blindness 2019-05-29
2016 Árni Kristjánsson, Alin Moldoveanu, Ómar I. Jóhannesson, Oana Balan, Simone Spagnol, Vigdís Vala Valgeirsdóttir, Rúnar Unnthorsson
Designing sensory-substitution devices: Principles, pitfalls and potential1
published pages: 769-787, ISSN: 0922-6028, DOI: 10.3233/RNN-160647
Restorative Neurology and Neuroscience 34/5 2019-05-29
65535 Andrei Ciobanu, Anca Morar, Florica Moldoveanu, Alin Moldoveanu
Real-time segmentation of depth map frames on mobile devices
published pages: -, ISSN: 1454-8658, DOI:
Journal of Control Engineering and Applied Informatics 2019-05-29
2017 COSMA, Călin; BĂLAN, Oana; MOLDOVEANU, Alin; MORAR, Anca; MOLDOVEANU, Florica; TASLITCHI, Cristian
Treating acrophobia with the help of virtual reality
published pages: , ISSN: , DOI:
2017 Balan, Oana; Moldoveanu, Alin; Moldoveanu, Florica; Nagy, Hunor; Wersenyi, Gyorgy; Unnporsson, Runar
Improving the Audio Game-Playing Performances of People with Visual Impairments through Multimodal Training
published pages: , ISSN: 0145-482X, DOI:
Journal of Visual Impairment & Blindness 2019-05-29
2015 Oana Bălan, Alin Moldoveanu, Florica Moldoveanu
3D Audio and Haptic Interfaces for Training the Spatial Acoustic Resolution in Virtual Auditory Environments
published pages: 3-4, ISSN: , DOI:
International Conference on Auditory Display 2015 Student Think Tank 2019-05-29
2017 Csapo, Adam; Spagnol, Simone; Herrera Martinez, Marcelo; Bujacz, Michal; Janeczek, Maciej; Ivanica, Gabriel; Wersényi, György; Moldoveanu, Alin; Unnthorsson, Runar
Usability and Effectiveness of Auditory Sensory Substitution Models for the Visually Impaired
published pages: , ISSN: , DOI:
2015 P. Strumillo, M. Bujacz, P. Baranski, P. Skulimowski, P. Korbel, M. Owczarek, K. Tomalczyk, A. Moldoveanu, R. Unnthorsson
Different Approaches to Aiding Blind Persons in Mobility and Navigation in the “Naviton” and “Sound of Vision” Projects
published pages: 435-468, ISSN: , DOI: 10.1007/978-3-319-54446-5_15
2016 S. Spagnol, S. Galesso and F. Avanzini
Estimation of spectral HRTF features for 3D audio rendering with non-linear anthropometric models
published pages: , ISSN: , DOI:
2016 Charalampos Saitis, Kyriaki Kalimeri
Identifying Urban Mobility Challenges for the Visually Impaired with Mobile Monitoring of Multimodal Biosignals
published pages: 616-627, ISSN: , DOI: 10.1007/978-3-319-40238-3_59
2016 Simone Spagnol, Charalampos Saitis, Michal Bujacz, Omar I. Johannesson, Kyriaki Kalimeri, Alin Moldoveanu, Arni Kristjansson, Runar Unnthorsson
Model-based obstacle sonification for the navigation of visually impaired persons
published pages: , ISSN: , DOI:
2017 Anca Morar, Florica Moldoveanu, Lucian Petrescu, Alin Moldoveanu
Real Time Indoor 3D Pipeline for an Advanced Sensory Substitution Device
published pages: 685-695, ISSN: , DOI: 10.1007/978-3-319-68548-9_62
2015 Simone Spagnol, Federico Avanzini
Frequency Estimation of the First Pinna Notch in Head-Related Transfer Functions with a Linear Anthropometric Model
published pages: , ISSN: 2413-6689, DOI:
Proceedings of the 18th International Conference on Digital Audio Effects 2019-05-29
2015 Baranski P., Strumillo P.
Field trials of a teleassistance system for the visually impaired
published pages: 173-179, ISSN: 2158-2246, DOI:
2015 8th International Conference on Human System Interaction (HSI) 2019-05-29
2017 V. E. Dinu, D. Papuc, A. Gheorghiu, M.-I. Dascalu, A. Moldoveanu and F. Moldoveanu
Biometric Data in Learning Analytics: a Survey on Existing Applications
published pages: , ISSN: , DOI: 10.12753/2066-026X-17-151
2016 V. E. Dinu, A. Moldoveanu, I. Negoi, T. I. Codarnai, M.-I. Dascalu and C. Taslitchi
A practical survey on health monitoring devices and their impact on quality of life
published pages: , ISSN: , DOI:
2016 Hunor Nagy, György Wersényi
Evaluation of Response Times on a Touch Screen Using Stereo Panned Speech Command Auditory Feedback
published pages: 279-286, ISSN: , DOI: 10.1007/978-3-319-43958-7_33
2016 S. Spagnol, C. Saitis, K. Kalimeri, O. Johannesson and R. Unnthorsson
Obstacle sonification as a navigation aid for the visually impaired
published pages: , ISSN: , DOI:
2015 Bogdan Troancă, Alexandru Butean, Alin Moldoveanu, Oana Bălan
Introducing Basic Geometric Shapes to Visually Impaired People Using a Mobile App
published pages: 91-94, ISSN: , DOI:
12th National Conference on Human-Computer Interaction, Bucharest, 2015 2019-05-29
2015 P. Skulimowski and P. Strumillo
Verification of Visual Odometry Algorithms with an OpenGL BasedSoftware Tool
published pages: , ISSN: , DOI:
Journal of Electronic Imaging 12.03.2015 2019-05-29
2015 Oana Bălan, Alin Moldoveanu, Florica Moldoveanu
Multimodal Perceptual Training for Improving Spatial Auditory Performance in Blind and Sighted Listeners
published pages: , ISSN: 2300-262X, DOI: 10.1515/aoa-2015-0049
Archives of Acoustics 40/4 2019-05-29
2015 Piotr Skulimowski, Pawel Strumillo
Verification of visual odometry algorithms with an OpenGL-based software tool
published pages: 33003, ISSN: 1017-9909, DOI: 10.1117/1.JEI.24.3.033003
Journal of Electronic Imaging 24/3 2019-05-29
2015 Przemyslaw Baranski, Pawel Strumillo
Emphatic Trials of a Teleassistance System for the Visually Impaired
published pages: 1640-1651, ISSN: 2156-7018, DOI: 10.1166/jmihi.2015.1621
Journal of Medical Imaging and Health Informatics 5/8 2019-05-29

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "SOUND OF VISION" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email ( and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "SOUND OF VISION" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.3.1.4.)

WellCO (2017)

Wellbeing and Health Virtual Coach

Read More  

RELIEF (2016)


Read More  

J-Age II (2015)

Coordination Action for implementation and alignment activities of the Joint Programming Initiative (JPI) 'More Years – Better Lives – the Challenges and Opportunities of Demographic Change'

Read More