Virtual LiVe

A large number of requests show the massive increase in demand for immersive exchange formats due to COVID-19 and require a quick response.

Virtual LiVe – Virtualization of Live Events via Audiovisual Immersion strives to develop a pool of technological solutions where players from the industry can find a remedy for this problem.

The aim is to develop and evolve:

Platforms & Distribution
Identification, evaluation and implementation of technical and non-technical requirements and corresponding design of a platform for near-real-time and protected transmission of media content and interactions. Furthermore of marketing options (pay-per-use (tickets), subscription or advertising-supported models), and of necessary changes and adaptation along the distribution chain.

Interactive 3D Content
Identification, evaluation and implementation of workflows and tools for audiovisual interaction with realistic spatial perception through the combination of representation formats (i.e. 360°-Video, Light-fields, 3D-Audio), data reduction for immersive interactive content, efficient use of interaction possibilities and integration into communication platforms.

360°-Video & 3D-Audio
Identification, evaluation and implementation of requirements for high quality 360°-Video and 3D-Audio live-streaming for concerts that is compatible with various devices. Consideration of the requirements of cultural events, data protection and data security according to German/EU law, viewing direction and excerpt selection with object-based 3D audio and integration into communication platforms.

Due to the Corona crisis, face-to-face events such as concerts, trade fairs or workshops are no longer possible in the classical format with physical presence. This leads to cultural impoverishment and endangers business and cultural exchange in society. The cultural and creative industries are particularly dominated by SMEs and are the driving force behind such face-to-face events. They generate a turnover of more than EUR 170 billion in sales with 1.8 million employees and have been hit particularly hard as one of the most important sectors of the German economy.

At the same time, however, new immersive media formats (including 3D-Audio, 360°-Video, Light-fields, Volumetric Video) are opening up the possibility of digitizing classic event formats. This promises additional revenue streams and target audiences. Virtual LiVe therefore investigates how present-day solutions can be extended via high-quality virtual presence with immersive content to create new formats for virtual and hybrid cultural events as well as platforms for congresses and trade fairs.

Virtual LiVe will develop a tool box with individual elements from the technological expertise of the project partners. SMEs can put together a customized program from this tool box depending on the needs and requirements for their respective event needs and thus obtain a technology-based solution for the realization of their formats.

By combining competencies of the project partners, the entire production field of virtual events can be covered by a broad portfolio of immersive media formats (e.g. 3D-Audio, 360°-Video, Light-fields, Volumetric Video, interactive low-latency streaming and advanced stream analytics). The experience of the participating partner institutes in the respective core topics allows for a highly efficient and synergetic approach, enabling innovative and practical commercial applications and value creation opportunities for SMEs within a short processing time. Virtual LiVe offers the following benefits especially for SMEs:

• Modular and scalable, thus both customer and application-specific optimized cost / benefit ratio
• Complete solution including licensing and payment system from a single source, thus particularly attractive for SMEs
• Higher degree of immersion compared to competitive solutions thanks to broad technology portfolio

• Fraunhofer Heinrich Hertz Institute
• Fraunhofer Fokus
• Fraunhofer IIS

The Virtual LiVe project is hosted by 3IT- Innovation Center for Immersive Imaging Technologies.

Find all further info here.