Skip to main content
European Commission logo print header

COoperative Real-Time EXperiences with EXtended reality

Project description

Bridging the divide between video conferencing and mixed reality

Video conferencing and mixed reality are both forms of communication but based on very different technologies. Video conferencing does not provide an in-person feel to meetings and has several other drawbacks. In contrast, mixed reality has emerged as a technology that can provide a genuine feeling of presence, and better collaboration tools. The EU-funded CORTEX² project will bridge the divide between widespread video conferencing tools and innovative XR-based solutions to democratise the adoption of next-generation eXtended Reality tele-cooperation by industrial sectors and SMEs. The initiative will use and extend the widespread Rainbow teleconferencing solution from Alcatel Lucent Enterprise to allow for fully interactive XR-based cooperation. This will be demonstrated in three pilots: industrial production, business meetings, and remote training respectively.

Objective

The mission of CORTEX² is to bridge the divide between widespread video-conferencing tools and state-of-the art XR-based solutions, democratising the uptake of next-generation eXtended Reality tele-cooperation among a large number of industrial segments and SMEs. To this aim, our project will provide: (1) Full support for AR experience as extension of videoconferencing systems when using heterogeneous services end devices through a novel Mediation Gateway platform (2) Resource-efficient teleconferencing tools through innovative transmission methods and automatic summarization of shared long documents (3) User-friendly and powerful XR experiences with instant 3D reconstruction of environments and objects and simplified use of natural gestures in collaborative meetings (4) Fusion of vision and audio for multi-channel semantic interpretation and enhanced tools such as dialoguing virtual conversational agents and automatic meeting summarization (5) Full integration of IoT devices in XR experiences to optimize interaction with running systems and processes (6) Optimal extension possibilities and wide uptake opportunity through the delivery of the core system with open APIs and the the organisation of Open calls for extensions towards more technical modules and more use cases in various segments. In order to ensure large adoption and fast scaling of our extended remote cooperation solution, we will use the widespread teleconferencing solution Rainbow from Alcatel Lucent Enterprise as a backbone for our innovative extended reality based tele-cooperation concept, which counts today more than 3 million users worldwide. CORTEX will extend Rainbow to allow for fully interactive XR-based cooperation and will be demonstrated in three pilots: industrial production, business meetings and remote training. Wide uptake will be guaranteed by financement of third-party projects to allow for more technical extensions, wider use-cases and deeper evaluation and assessment.

Coordinator

DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH
Net EU contribution
€ 5 093 425,00
Address
TRIPPSTADTER STRASSE 122
67663 Kaiserslautern
Germany

See on map

Region
Rheinland-Pfalz Rheinhessen-Pfalz Kaiserslautern, Kreisfreie Stadt
Activity type
Research Organisations
Links
Total cost
€ 5 093 425,00

Participants (9)