ToHyVe

Challenges and objectives

Virtual and hybrid formats are not yet immersive enough to be truly compelling. The ToHyVe project aims to change that.

The project consortium brings together partners from the fields of immersive audio and video technologies, artificial intelligence, streaming, data security, virtual worlds, event platforms, exhibition design and usability to develop immersive solutions for a range of use cases. The goal is to increase the acceptance of hybrid events in this way and thus contribute to resource conservation, among other things. At the same time, the use of German and European software solutions should ensure that data protection and security can be guaranteed.

Application scenarios for the new toolbox include lectures, workshops and hybrid panels, where both the speakers and the audience can participate and interact live and online on an equal footing. Even greater challenges, however, are presented by hybrid networking meetings or interactive showroom tours, for which solutions are also to be developed.

Contribution by Fraunhofer HHI

HHI will develop new technologies for capturing and representing the real scene and participants and displaying them in the virtual scene and on-site, as well as for low-latency streaming of audio, video and 3D data. These technologies will be brought together in a hybrid event platform that will enable the most seamless interaction possible. Furthermore, extended reality technologies and cyberphysical systems will be used to collaborate with each other in hybrid, highly immersive 3D event formats and via joint work on digital twins. Finally, demonstrators will be developed to demonstrate and evaluate important use cases.

Project consortium

• Archimedes Exhibitions GmbH (ARC)
• Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
• Deutsche Telekom AG – T-Labs (DTAG)
• Fraunhofer Institut für Angewandte und Integrierte Sicherheit (AISEC)
• Fraunhofer Heinrich-Hertz-Institut (HHI)
• Fraunhofer Institut für Integrierte Schaltungen (IIS)
• iventic GmbH (IVE)
• mac messe- und ausstellungscenter Service GmbH (MAC)
• nanocosmos GmbH (NAC)
• TriCAT GmbH (TRI)