Project description DEENESFRITPL Enriching social interaction in shared hybrid spaces Extended reality (XR) is an emerging technology with promising potential in many areas, but several limitations must be overcome to enrich the interactive experience for users. The EU-funded SHARESPACE project aims to establish a novel prototype for a socially interactive avatar and/or agent based on human sensorimotor communication. It will capture natural body movements, facial expressions and hand gestures to compile an array of sensorimotor primitives: these will aid the design of AI-based architecture of a fully mobile human rendering with customisable characteristics. SHARESPACE will validate the prototype in three real-life situations of shared hybrid spaces involving human and artificial agents in the fields of health, sport and art. Show the project objective Hide the project objective Objective SHARESHARESPACE will demonstrate a radically new technology for promoting ethical and social interaction in eXtended Reality (XR) Shared Hybrid Spaces (SHS), anchored in human sensorimotor communication. Our core concept is to identify and segment social sensorimotor primitives and reconstruct them in hybrid settings to build continuous, embodied, and rich human- avatar experiences. To achieve this, three interconnected science-towards-technology breakthroughs will be delivered: novel computational cognitive architectures, a unique self-calibrating body sensor network, and a fully mobile spatial Augmented Reality (AR) and virtual human rendering. We will create a library of social motion primitives and use them to design AI-based architectures of our artificial agents. SHARESPACE mobile capturing technologies combine loosely-coupled visual-inertial tracking of full body kinematic, hand pose and facial expression, incorporating novel neural encoding/decoding functionalities, together with local context-aware animations and highly realistic neural rendering. Our technology will be iteratively tested in 2 Proofs-of-principles involving human and artificial agents interacting in SHS, and 3 real-world use case scenarios in Health, Sport and Art. We will demonstrate a fully functional prototype of SHARESPACE tailored to the agents’ personalized characteristics (gender, culture, and social dispositions). SHARESPACE will support community-building and exploitation with concrete initiatives, including (i) public engagement around our research and innovation, (ii) promoting high-tech innovation and early transfer to our deep-tech companies, as premises for the consolidation of human-centric and sovereign European market areas such Industry AR and SHS, eHealth and tele-Health. Our long-term vision is to bring XR to a radically new level of presence and sociality by reconstructing sensorimotor primitives that enable ethical, trusted and inclusive modes of social interaction. Fields of science medical and health scienceshealth scienceshealth care serviceseHealthengineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorssmart sensorsnatural sciencescomputer and information sciencessoftwaresoftware applicationssimulation software Keywords Embodied shared spaces sensori-motor primitives synchronization amplification digital avatars ego-centric kinematics capturing inclusive and ethical hybrid space Programme(s) HORIZON.2.4 - Digital, Industry and Space Main Programme HORIZON.2.4.6 - Next Generation Internet Topic(s) HORIZON-CL4-2022-HUMAN-01-14 - eXtended Reality Technologies (RIA) Call for proposal HORIZON-CL4-2022-HUMAN-01 See other projects for this call Funding Scheme HORIZON-RIA - HORIZON Research and Innovation Actions Coordinator DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH Net EU contribution € 1 038 750,00 Address TRIPPSTADTER STRASSE 122 67663 Kaiserslautern Germany See on map Region Rheinland-Pfalz Rheinhessen-Pfalz Kaiserslautern, Kreisfreie Stadt Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 1 038 750,00 Participants (14) Sort alphabetically Sort by Net EU contribution Expand all Collapse all UNIVERSITE DE MONTPELLIER France Net EU contribution € 560 040,00 Address 163 RUE AUGUSTE BROUSSONNET 34090 Montpellier See on map Region Occitanie Languedoc-Roussillon Hérault Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 585 527,50 Third-party Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure. INSTITUT MINES-TELECOM France Net EU contribution € 25 487,50 Address 19 PLACE MARGUERITE PEREY 91120 Palaiseau See on map Region Ile-de-France Ile-de-France Essonne Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 25 487,50 CRDC NUOVE TECNOLOGIE PER LE ATTIVITA PRODUTTIVE SCARL Italy Net EU contribution € 555 875,00 Address VIA NUOVA AGNANO 11 80125 Napoli See on map Region Sud Campania Napoli Activity type Research Organisations Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 555 875,00 UNIVERSITAETSKLINIKUM HAMBURG-EPPENDORF Germany Net EU contribution € 659 112,50 Address Martinistrasse 52 20251 Hamburg See on map Region Hamburg Hamburg Hamburg Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 659 112,50 ALE INTERNATIONAL France Net EU contribution € 391 250,00 Address 32 AVENUE KLEBER 92700 Colombes See on map Region Ile-de-France Ile-de-France Hauts-de-Seine Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 391 250,00 UNIVERSITAT JAUME I DE CASTELLON Spain Net EU contribution € 269 097,50 Address AVENIDA VICENT SOS BAYNAT S/N 12006 Castellon De La Plana See on map Region Este Comunitat Valenciana Castellón/Castelló Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 269 097,50 GOLAEM SA France Net EU contribution € 370 191,00 Address 31 RUE DE LA FREBARDIERE, BATIMENT ISOCELE, RDC 35135 Chantepie See on map SME The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed. Yes Region Bretagne Bretagne Ille-et-Vilaine Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 370 191,25 SIA LIGHTSPACE TECHNOLOGIES Latvia Net EU contribution € 223 750,00 Address ZIEDLEJU IELA 1 LV 2167 MARUPE See on map SME The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed. Yes Region Latvija Latvija Pierīga Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 223 750,00 CYENS CENTRE OF EXCELLENCE Cyprus Net EU contribution € 358 750,00 Address 23 MAYOR LELLOU DEMETRIADE 1016 Nicosia See on map Region Κύπρος Κύπρος Κύπρος Activity type Research Organisations Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 358 750,00 RICOH INTERNATIONAL BV Netherlands Net EU contribution € 396 500,00 Address PROF WH KEESOMLAAN 1 1183 DJ Amstelveen See on map Region West-Nederland Noord-Holland Groot-Amsterdam Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 396 500,00 INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE France Net EU contribution € 331 212,50 Address DOMAINE DE VOLUCEAU ROCQUENCOURT 78153 Le Chesnay Cedex See on map Region Ile-de-France Ile-de-France Yvelines Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 390 800,00 Third-party Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure. UNIVERSITE RENNES II France Net EU contribution € 59 587,50 Address PLACE DU RECTEUR HENRI LE MOAL 35043 Rennes Cedex See on map Region Bretagne Bretagne Ille-et-Vilaine Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 59 587,50 ARS ELECTRONICA LINZ GMBH & CO KG Austria Net EU contribution € 563 350,00 Address ARS-ELECTRONICA-STRASSE 1 4040 Linz See on map Region Westösterreich Oberösterreich Linz-Wels Activity type Research Organisations Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 563 350,00 FUNDACIO HOSPITAL UNIVERSITARI VALL D'HEBRON - INSTITUT DE RECERCA Spain Net EU contribution € 144 620,00 Address PASSEIG VALL D HEBRON 119-129 EDIFICIO DE RECERCA 08035 Barcelona See on map Region Este Cataluña Barcelona Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 144 620,00 Partners (1) Sort alphabetically Sort by Net EU contribution Expand all Collapse all DE MONTFORT UNIVERSITY United Kingdom Net EU contribution € 0,00 Address THE GATEWAY LE1 9BH Leicester See on map Region East Midlands (England) Leicestershire, Rutland and Northamptonshire Leicester Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost No data
