Dicta-Sign
Sign Language Recognition, Generation and Modelling n with application in Deaf Communication
| Coordinatore | ATHENA RESEARCH AND INNOVATION CENTER IN INFORMATION COMMUNICATION & KNOWLEDGE TECHNOLOGIES
Organization address
address: Artemidos and Epidavrou 6 contact info |
| Nazionalità Coordinatore | Greece [EL] |
| Totale costo | 3˙923˙566 € |
| EC contributo | 3˙010˙879 € |
| Programma | FP7-ICT
Specific Programme "Cooperation": Information and communication technologies |
| Code Call | FP7-ICT-2007-3 |
| Funding Scheme | CP |
| Anno di inizio | 2009 |
| Periodo (anno-mese-giorno) | 2009-02-01 - 2012-01-31 |
Partecipanti
| # | ||||
|---|---|---|---|---|
| 1 |
ATHENA RESEARCH AND INNOVATION CENTER IN INFORMATION COMMUNICATION & KNOWLEDGE TECHNOLOGIES
Organization address
address: Artemidos and Epidavrou 6 contact info |
EL (Maroussi - Athens) | coordinator | 0.00 |
| 2 |
CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE
Organization address
address: 3, RUE MICHEL-ANGE contact info |
FR (PARIS CEDEX 16) | participant | 0.00 |
| 3 |
NATIONAL TECHNICAL UNIVERSITY OF ATHENS
Organization address
address: Heroon Polytechneiou contact info |
EL (ATHENS) | participant | 0.00 |
| 4 |
UNIVERSITAET HAMBURG
Organization address
address: EDMUND-SIEMERS-ALLEE contact info |
DE (HAMBURG) | participant | 0.00 |
| 5 |
UNIVERSITE PAUL SABATIER TOULOUSE III
Organization address
address: ROUTE DE NARBONNE contact info |
FR (TOULOUSE CEDEX 9) | participant | 0.00 |
| 6 |
UNIVERSITY OF EAST ANGLIA
Organization address
address: University Plain contact info |
UK (NORWICH) | participant | 0.00 |
| 7 |
UNIVERSITY OF SURREY
Organization address
address: Stag Hill contact info |
UK (GUILDFORD) | participant | 0.00 |
| 8 |
WebSourd
Organization address
address: route d Espagne contact info |
FR (Toulouse) | participant | 0.00 |
Mappa
Word cloud
Esplora la "nuvola delle parole (Word Cloud) per avere un'idea di massima del progetto.
Obiettivo del progetto (Objective)
Dicta-Sign addresses the need for communication between deaf individuals and communication via natural language by deaf users with various HCI environments. It will research and develop recognition and synthesis engines for sign languages (SLs) at a level of detail necessary for recognising and generating authentic signing. Research outcomes will be integrated in three laboratory prototypes (a Search-by-Example tool, a SL-to-SL translator and a sign-Wiki) leading to a practical project demonstrator.nDicta-Sign will be based on research novelties in sign recognition and generation exploiting significant linguistic knowledge and coded SL resources. Interoperation of several scientific domains is required in order to combine linguistic knowledge with computer vision for image/video analysis for continuous sign recognition, and with computer graphics for realistic avatar animation. Coding of SL linguistic knowledge requires exploitation of annotated parallel video corpora for four SLs (BSL, DGS, GSL and LSF), linked to common grammar and lexicon modules created to feed both recognition and synthesis engines.nThese resources will also be applied, by exploiting multilingual syntactic and lexical interrelations, to domain-specific SL-to-SL machine translation. Sign input will be extended by integrating continuous sign recognition with multi-modal fusion and signer adaptation. Sign recognition technology will also help with annotation procedures and tools developed within the project as a necessary support for adequate corpus construction and data access. Procedural sign synthesis will be extended by further development of current state-of-the-art representations of manual signing elements in order to achieve close-to-natural signing, including non-manual features of eye gaze, mouthing patterns and body postures. Prototypes and the demonstrator will validate the interaction between sign recognition, linguistic modelling, and sign synthesis.