![[Translate to English:] 2D & 3D OmniCam-360](/fileadmin/_processed_/3/8/csm_omnicam-360-shootings-2013-fraunhofer-hhi5_b477e9d4ef.jpg)
2D & 3D OmniCam-360
We are performing research and development of real-time video analysis algorithms since many years, mainly focusing on hand and head tracking and gesture analysis.
![](/fileadmin/_processed_/1/3/csm_multimodale_Sensorerfassung_6c0f5ff046.png)
Multimodal Sensing
High-quality sensor systems for acoustic (microphone arrays/beamforming), visual (multi-camera systems/3D depth estimation), and other data (GPS, LiDAR, etc.) for industrial applications, such as data acquisition in the context of BIM, spatial 3DOF/6DOF audio and video capture.
![](/fileadmin/_processed_/4/1/csm_audiovisuelle_simulation_97297afe5f.jpg)
Audiovisual Simulation
Data fusion for multimodal scene analysis and description, beamforming and partial sound source separation, efficient sound propagation calculation, automated generation of metadata, as well as augmentation of 360° videos with 3D content (6DOF).
![](/fileadmin/_processed_/9/b/csm_interaktive_wiedergabe_2a5df03659.jpg)
Interactive rendering of real and virtual audiovisual environments
Real-time utilization of immersive spaces (3D video, 3D audio) with various interaction tools for training applications and GIS/BIM applications, as well as networking for interaction between immersive spaces/XR applications and interactive visual and acoustic simulations and auralizations.