Opendata, web and dolomites

Sound of Vision

Natural sense of vision through acoustics and haptics

Total Cost €

0

EC-Contrib. €

0

Partnership

0

Views

0

 Sound of Vision project word cloud

Explore the words cloud of the Sound of Vision project. It provides you a very rough idea of what is the project "Sound of Vision" about.

indoor    surrounding    assist    validations    objects    time    wearable    perception    improvements    vision    bci    sonification    impairments    intuitive    brain    visual    affordable    model    audio    software    3d    families    friends    video    free    transformed    located    tags    subsequent    sensors    commercial    sound    blind    space    environment    person    assistive    localization    representation    people    created    invasive    psychophysics    prototype    functional    conveying    interface    hardware    restoration    first    followed    actually    complementary    delivered    specialists    surroundings    impressive    neuroplasticity    haptics    algorithms    specialized    social    conveyed    keywords    training    original    sold    predefined    series    feedback    haptic    accessible    neurologists    repetitive    validate    outdoor    generating    impaired    assisting    consists    sources    commercialize    auditory    substitution    competences    final    visually    computer    experimental    goes    otherwise    last    courses    sensory    updated    combined    lifestyle    protocols    uses   

Project "Sound of Vision" data sheet

The following table provides information about the project.

Coordinator
HASKOLI ISLANDS 

Organization address
address: SAEMUNDARGOTU 2
city: REYKJAVIK
postcode: 101
website: www.hi.is

contact info
title: n.a.
name: n.a.
surname: n.a.
function: n.a.
email: n.a.
telephone: n.a.
fax: n.a.

 Coordinator Country Iceland [IS]
 Project website http://www.soundofvision.net
 Total cost 3˙960˙709 €
 EC max contribution 3˙960˙709 € (100%)
 Programme 1. H2020-EU.3.1.4. (Active ageing and self-management of health)
 Code Call H2020-PHC-2014-single-stage
 Funding Scheme RIA
 Starting year 2015
 Duration (year-month-day) from 2015-01-01   to  2017-12-31

 Partnership

Take a look of project's partnership.

# participants  country  role  EC contrib. [€] 
1    HASKOLI ISLANDS IS (REYKJAVIK) coordinator 1˙336˙898.00
2    UNIVERSITATEA POLITEHNICA DIN BUCURESTI RO (BUCHAREST) participant 705˙400.00
3    UNIVERSITATEA TEHNICA GHEORGHE ASACHI DIN IASI RO (IASI) participant 424˙709.00
4    ISTITUTO PER L'INTERSCAMBIO SCIENTIFICO IT (TORINO) participant 383˙518.00
5    POLITECHNIKA LODZKA PL (LODZ) participant 352˙906.00
6    INFO WORLD SRL RO (BUCURESTI SECTOR 2) participant 269˙118.00
7    BJONUSTU-OG BEKKINGARMIOSTOO FYRIRBLINDA SJONSKERTA OG DAUFBLINDA EINSTAKLINGA IS (REYKJAVIK) participant 197˙832.00
8    SZECHENYI ISTVAN UNIVERSITY HU (GYOR) participant 149˙625.00
9    FUNDACJA INSTYTUT ROZWOJU REGIONALNEGO PL (KRAKOW) participant 140˙700.00

Map

 Project objective

Sound of Vision (Vision restoration through sound and haptics) will design, implement and validate an original non-invasive hardware and software system to assist visually impaired people by creating and conveying an auditory representation of the surrounding environment. This representation will be created, updated and delivered to a blind person continuously and in real time. This system will help visually impaired people in any kind of environment (indoor/outdoor), without the need for predefined tags/sensors located in the surroundings.

The process of assisting visually impaired people proposed by Sound of Vision consists of a series of repetitive steps. The first step uses hardware and software for generating a 3D representation of the surrounding environment. In the second step, objects are identified within the 3D model and the information is then transformed into 3D sound and haptics sources. In the last step, all the 3D sound and haptics sources are combined and conveyed to the user, using specialized wearable hardware and algorithms.

A functional prototype will be developed, followed by experimental validations and subsequent improvements, according to the feedback provided by visually impaired people, training specialists and neurologists. The product thus obtained will be sold as a hardware and software system, as well as some training courses that will help blind people use the system.

The consortium has the necessary complementary competences to design and develop the proposed system, to test the prototype, establish training protocols and also to commercialize the system as an intuitive and accessible final product.

Sound of Vision is a concept that goes beyond the state of the art of the visual sensory substitution systems, having the potential to become an affordable commercial product that will actually help blind people. This system can have an impressive social impact, improving the lifestyle of blind people, and also of their families and friends, on which they would otherwise depend.

Free keywords (updated): Visual impairments; brain-computer interface (BCI); Neuroplasticity; Psychophysics; audio/video processing; wearable assistive devices; sonification; sound localization; haptic space perception.

 Deliverables

List of deliverables.
Scientific papers IV Documents, reports 2019-03-08 17:52:28
Project website (updated) Websites, patent fillings, videos etc. 2019-03-08 17:52:32
Doctoral reports Documents, reports 2018-12-11 10:53:01
Usage questionnaires Other 2018-12-11 10:52:45
Scientific review (survey) articles Documents, reports 2018-12-11 10:53:07
Scientific papers III Documents, reports 2018-12-11 10:52:57
Scientific papers II Documents, reports 2018-12-11 10:52:37
Scientific papers I Documents, reports 2018-12-11 10:52:37
Project web site Websites, patent fillings, videos etc. 2018-12-11 10:52:51
Final version of the project website Websites, patent fillings, videos etc. 2018-12-11 10:52:50
Project website (updated II) Websites, patent fillings, videos etc. 2018-12-11 10:52:44
Project website (updated III) Websites, patent fillings, videos etc. 2018-12-11 10:52:59

Take a look to the deliverables list in detail:  detailed list of Sound of Vision deliverables.

 Publications

year authors and title journal last update
List of publications.
2017 Iulia-Cristina Stănică, Maria-Iuliana Dascălu, Alin Moldoveanu, Florica Moldoveanu
An Innovative Solution Based on Virtual Reality to Treat Phobia
published pages: 1-13, ISSN: 2165-9508, DOI: 10.5171/2017.155350
International Journal of Interactive worlds 2019-05-29
2016 I.-C. Stanica, A. Moldoveanu, C.-N. Bodea, M.-I. Dascalu, S. Hostiuc
A survey of virtual reality applications as psychotherapeutic tools to treat phobias
published pages: , ISSN: , DOI:
2019-05-29
2016 Sorin Hostiuc, Alin Moldoveanu, Maria-Iuliana Dascălu, Runar Unnthorsson, Ómar I. Jóhannesson, Ioan Marcus
Translational research—the need of a new bioethics approach
published pages: , ISSN: 1479-5876, DOI: 10.1186/s12967-016-0773-4
Journal of Translational Medicine 14/1 2019-05-29
2015 Oana Bălan, Alin Moldoveanu, Florica Moldoveanu, Alexandru Butean
Developing a navigational 3D audio game with hierarchical levels of difficulty for the visually impaired players
published pages: 49-54, ISSN: 2344-1690, DOI:
Romanian Conference on Human-Computer Interaction 2019-05-29
2017 H. Nagy, Á. Csapó and G. Wersényi
Audio-based mobile applications for Android using multisensory feedback in assistive technology
published pages: , ISSN: , DOI:
2019-05-29
2016 Oana-Maria FERCHE, Alin MOLDOVEANU, Florica MOLDOVEANU, Alexandra VOINEA and Victor ASAVEI
Challenges and Issues for Successfully Applying Virtual Reality in Medical Rehabilitation
published pages: , ISSN: , DOI: 10.12753/2066-026X-15-073
2019-05-29
2017 Wersényi, György; Répás, József
Comparison of HRTFs from a Dummy-Head Equipped with Hair, Cap, and Glasses in a Virtual Audio Listening Task over Equalized Headphones
published pages: , ISSN: , DOI:
Proceedings of the 142nd Convention of the Audio Engineering Society 9766 2019-05-29
2016 Simone Spagnol, Erica Tavazzi, Federico Avanzini
Distance rendering and perception of nearby virtual sound sources with a near-field filter model
published pages: , ISSN: 0001-4966, DOI:
Journal of the Acoustical Society of America (JASA) 2019-05-29
2017 M. Owczarek, P. Skulimowski and P. Strumiłło
A mobile system for interactive sonification of 3D scenes from “U-disparity” representation
published pages: , ISSN: , DOI:
2019-05-29
2016 I.-C. Stanica, M.-I. Dascalu, A. Moldoveanu and F. Moldoveanu
Le Traitement Des Phobies Par La Réalité Virtuelle
published pages: , ISSN: , DOI:
2019-05-29
2016 P. Skulimowski, M. Owczarek, M. Bujacz and P. Strumillo
Interactive sonification of the U-disparity maps of 3D scenes
published pages: , ISSN: , DOI:
2019-05-29
2017 Nagy, Hunor; Wersényi, György
Evaluation of Training to Improve Auditory Memory Capabilities on a Mobile Device Based on a Serious Game Application
published pages: , ISSN: , DOI:
2019-05-29
2016 C.-D. Nichifor, A. Moldoveanu, C.-N. Bodea, M.-I. Dascalu, A.-M. Neagu
Cognitive training games to improve learning skills
published pages: , ISSN: , DOI:
2019-05-29
2018 Charalampos Saitis, Mohammad Zavid Parvez, Kyriaki Kalimeri
Cognitive Load Assessment from EEG and Peripheral Biosignals for the Design of Visually Impaired Mobility Aids
published pages: 1-9, ISSN: 1530-8669, DOI: 10.1155/2018/8971206
Wireless Communications and Mobile Computing 2018 2019-05-29
2016 Ómar Jóhannesson, Oana Balan, Runar Unnthorsson, Alin Moldoveanu, Árni Kristjánsson
The Sound of Vision Project: On the Feasibility of an Audio-Haptic Representation of the Environment, for the Visually Impaired
published pages: 20, ISSN: 2076-3425, DOI: 10.3390/brainsci6030020
Brain Sciences 6/3 2019-05-29
2015 Simone Spagnol, Erica Tavazzi, Federico Avanzini
Relative Auditory Distance Discrimination with Virtual Nearby Sound Sources
published pages: , ISSN: 2413-6689, DOI:
Proc. of the 18th Int. Conference on Digital Audio Effects (DAFx-15) 2019-05-29
2017 O. Bălan, A. Moldoveanu, F. Moldoveanu, H. Nagy, G. Wersényi and R. Unnthorsson
Improving the Audio Game--Playing Performances of People with Visual Impairments Through Multimodal Training
published pages: , ISSN: 0145-482X, DOI:
Journal of Visual Impairment & Blindness 2019-05-29
2016 Árni Kristjánsson, Alin Moldoveanu, Ómar I. Jóhannesson, Oana Balan, Simone Spagnol, Vigdís Vala Valgeirsdóttir, Rúnar Unnthorsson
Designing sensory-substitution devices: Principles, pitfalls and potential1
published pages: 769-787, ISSN: 0922-6028, DOI: 10.3233/RNN-160647
Restorative Neurology and Neuroscience 34/5 2019-05-29
65535 Andrei Ciobanu, Anca Morar, Florica Moldoveanu, Alin Moldoveanu
Real-time segmentation of depth map frames on mobile devices
published pages: -, ISSN: 1454-8658, DOI:
Journal of Control Engineering and Applied Informatics 2019-05-29
2017 COSMA, Călin; BĂLAN, Oana; MOLDOVEANU, Alin; MORAR, Anca; MOLDOVEANU, Florica; TASLITCHI, Cristian
Treating acrophobia with the help of virtual reality
published pages: , ISSN: , DOI:
2019-05-29
2017 Balan, Oana; Moldoveanu, Alin; Moldoveanu, Florica; Nagy, Hunor; Wersenyi, Gyorgy; Unnporsson, Runar
Improving the Audio Game-Playing Performances of People with Visual Impairments through Multimodal Training
published pages: , ISSN: 0145-482X, DOI:
Journal of Visual Impairment & Blindness 2019-05-29
2015 Oana Bălan, Alin Moldoveanu, Florica Moldoveanu
3D Audio and Haptic Interfaces for Training the Spatial Acoustic Resolution in Virtual Auditory Environments
published pages: 3-4, ISSN: , DOI:
International Conference on Auditory Display 2015 Student Think Tank 2019-05-29
2017 Csapo, Adam; Spagnol, Simone; Herrera Martinez, Marcelo; Bujacz, Michal; Janeczek, Maciej; Ivanica, Gabriel; Wersényi, György; Moldoveanu, Alin; Unnthorsson, Runar
Usability and Effectiveness of Auditory Sensory Substitution Models for the Visually Impaired
published pages: , ISSN: , DOI:
2019-05-29
2015 P. Strumillo, M. Bujacz, P. Baranski, P. Skulimowski, P. Korbel, M. Owczarek, K. Tomalczyk, A. Moldoveanu, R. Unnthorsson
Different Approaches to Aiding Blind Persons in Mobility and Navigation in the “Naviton” and “Sound of Vision” Projects
published pages: 435-468, ISSN: , DOI: 10.1007/978-3-319-54446-5_15
2019-05-29
2016 S. Spagnol, S. Galesso and F. Avanzini
Estimation of spectral HRTF features for 3D audio rendering with non-linear anthropometric models
published pages: , ISSN: , DOI:
2019-05-29
2016 Charalampos Saitis, Kyriaki Kalimeri
Identifying Urban Mobility Challenges for the Visually Impaired with Mobile Monitoring of Multimodal Biosignals
published pages: 616-627, ISSN: , DOI: 10.1007/978-3-319-40238-3_59
2019-05-29
2016 Simone Spagnol, Charalampos Saitis, Michal Bujacz, Omar I. Johannesson, Kyriaki Kalimeri, Alin Moldoveanu, Arni Kristjansson, Runar Unnthorsson
Model-based obstacle sonification for the navigation of visually impaired persons
published pages: , ISSN: , DOI:
2019-05-29
2017 Anca Morar, Florica Moldoveanu, Lucian Petrescu, Alin Moldoveanu
Real Time Indoor 3D Pipeline for an Advanced Sensory Substitution Device
published pages: 685-695, ISSN: , DOI: 10.1007/978-3-319-68548-9_62
2019-05-29
2015 Simone Spagnol, Federico Avanzini
Frequency Estimation of the First Pinna Notch in Head-Related Transfer Functions with a Linear Anthropometric Model
published pages: , ISSN: 2413-6689, DOI:
Proceedings of the 18th International Conference on Digital Audio Effects 2019-05-29
2015 Baranski P., Strumillo P.
Field trials of a teleassistance system for the visually impaired
published pages: 173-179, ISSN: 2158-2246, DOI:
2015 8th International Conference on Human System Interaction (HSI) 2019-05-29
2017 V. E. Dinu, D. Papuc, A. Gheorghiu, M.-I. Dascalu, A. Moldoveanu and F. Moldoveanu
Biometric Data in Learning Analytics: a Survey on Existing Applications
published pages: , ISSN: , DOI: 10.12753/2066-026X-17-151
2019-05-29
2016 V. E. Dinu, A. Moldoveanu, I. Negoi, T. I. Codarnai, M.-I. Dascalu and C. Taslitchi
A practical survey on health monitoring devices and their impact on quality of life
published pages: , ISSN: , DOI:
2019-05-29
2016 Hunor Nagy, György Wersényi
Evaluation of Response Times on a Touch Screen Using Stereo Panned Speech Command Auditory Feedback
published pages: 279-286, ISSN: , DOI: 10.1007/978-3-319-43958-7_33
2019-05-29
2016 S. Spagnol, C. Saitis, K. Kalimeri, O. Johannesson and R. Unnthorsson
Obstacle sonification as a navigation aid for the visually impaired
published pages: , ISSN: , DOI:
2019-05-29
2015 Bogdan Troancă, Alexandru Butean, Alin Moldoveanu, Oana Bălan
Introducing Basic Geometric Shapes to Visually Impaired People Using a Mobile App
published pages: 91-94, ISSN: , DOI:
12th National Conference on Human-Computer Interaction, Bucharest, 2015 2019-05-29
2015 P. Skulimowski and P. Strumillo
Verification of Visual Odometry Algorithms with an OpenGL BasedSoftware Tool
published pages: , ISSN: , DOI:
Journal of Electronic Imaging 12.03.2015 2019-05-29
2015 Oana Bălan, Alin Moldoveanu, Florica Moldoveanu
Multimodal Perceptual Training for Improving Spatial Auditory Performance in Blind and Sighted Listeners
published pages: , ISSN: 2300-262X, DOI: 10.1515/aoa-2015-0049
Archives of Acoustics 40/4 2019-05-29
2015 Piotr Skulimowski, Pawel Strumillo
Verification of visual odometry algorithms with an OpenGL-based software tool
published pages: 33003, ISSN: 1017-9909, DOI: 10.1117/1.JEI.24.3.033003
Journal of Electronic Imaging 24/3 2019-05-29
2015 Przemyslaw Baranski, Pawel Strumillo
Emphatic Trials of a Teleassistance System for the Visually Impaired
published pages: 1640-1651, ISSN: 2156-7018, DOI: 10.1166/jmihi.2015.1621
Journal of Medical Imaging and Health Informatics 5/8 2019-05-29

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "SOUND OF VISION" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an  email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "SOUND OF VISION" are provided by the European Opendata Portal: CORDIS opendata.

More projects from the same programme (H2020-EU.3.1.4.)

WellCO (2017)

Wellbeing and Health Virtual Coach

Read More  

RELIEF (2016)

RECOVERING LIFE WELLBEING THROUGH PAIN SELF-MANAGEMENT TECHNIQUES INVOLVING ICTs

Read More  

IC-Health (2016)

Improving digital health literacy in Europe

Read More