Fraunhofer Institute for Telecommunications,
Heinrich-Hertz-Institut, HHI
Vision and Imaging TechnologiesNewsTechnologies and SolutionsResearch GroupsProjectsPublicationsPeople and ContactStudent Opportunities

Dr. Oliver Schreer

Dr. Oliver Schreer is Associate Professor at Technical University Berlin and Head of Immersive Media & Communication group at Vision & Imaging Technologies department at Fraunhofer Heinrich Hertz Institute.

His R&D activities are related to the following keywords: 3D video analysis, virtual view synthesis, real-time 3D video processing, future immersive media services exploiting Augmented Reality and Virtual Reality technologies, 3D video communication, human motion and gesture analysis and touchless interaction with media and content.

For further details about his activities, please check the subsections below.

Books

Media Production, Delivery and Interaction for Platform Independent Systems:
Format-Agnostic Media.
by O. Schreer, J.-F. Macq, O.A. Niamut, J. Ruiz-Hidalgo, B. Shirley, G. Thallinger, G. Thomas (eds.), John Wiley & Sons, Chichester, UK, January 2014

Presents current trends and potential future developments by leading researchers in immersive media production, delivery, rendering and interaction. The underlying audio and video processing technology that is discussed in the book relates to areas such as 3D object extraction, audio event detection; 3D sound rendering and face detection, gesture analysis and tracking using video and depth information. The book will give an insight into current trends and developments of future media production, delivery and reproduction. Consideration of the complete production, processing and distribution chain will allow for a full picture to be presented to the reader. Production developments covered will include integrated workflows developed by researchers and industry practitioners as well as capture of ultra-high resolution panoramic video and 3D object based audio across a range of programme genres. Distribution developments will include script based format agnostic network delivery to a full range of devices from large scale public panoramic displays with wavefield synthesis and ambisonic audio reproduction to ’small screen’ mobile devices. Key developments at the consumer end of the chain apply to both passive and interactive viewing modes and will incorporate user interfaces such as gesture recognition and ‘second screen’ devices to allow manipulation of the audio visual content.

3D Videocommunication: Algorithms, concepts and real-time systems in human centred communication.

O. Schreer, P. Kauff, Th. Sikora (eds.)

ISBN: 0-470-02271-X, Hardcover, 364 pages, John Wiley & Sons, Chichester, UK,
July 2005

Since April 2011, a translation of this book to simple Chinese is available. Translated by Q. Dai, X. Cao, and G. Er, Department of Automation, Tsinghua University, Beijing, China: 3D Videocommunication, simple chinese edition, Tsinghua University Press, Beijing, China, April 2011.

The migration of immersive media towards telecommunication applications is advancing rapidly. Impressive progress in the field of media compression, media representation, and the larger and ever increasing bandwidth available to the customer, will foster the introduction of these services in the future. One of the key components for the envisioned applications is the development from two-dimensional towards three-dimensional audio-visual communications. With contributions from key experts in the field, 3D Videocommunication:

  • provides a complete overview of existing systems and technologies in 3D video communications and provides guidance on future trends and research;
  • considers all aspects of the 3D videocommunication processing chain including video coding, signal processing and computer graphics;
  • focuses on the current state-of-the-art and highlights the directions in which the technology is likely to move;
  • discusses in detail the relevance of 3D videocommunication for telepresence systems and immersive media; and
  • provides an exhaustive bibliography for further reading.

Researchers and students interested in the field of 3D audio-visual communications will find 3D Videocommunication a valuable resource, covering a broad overview of the current state-of-the-art. Practical engineers from industry will also find it a useful tool in envisioning and building innovative applications.

Stereoanalyse und Bildsynthese (engl. Stereo Analysis and View Synthesis),
by Schreer, O. 2005, XII, 278 pages, 165 illustrations.
Softcover, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo, ISBN 3-540-23439-X, March 2005

Content of the book
Sample chapter
Errata

Seit März 2005 ist ein deutschsprachiges Lehrbuch zur "Stereoanalyse und Bildsynthese" im Springer Verlag erhältlich. Weitere Informationen finden sie hier.

Dieses Buch behandelt das sehr junge Forschungsgebiet der Stereobildanalyse und Bildsynthese. Basierend auf einer ausführlichen Darstellung der projektiven Geometrie leitet der Autor das mathematische Modell einer einzelnen Kamera, die Stereogeometrie und die geometrischen Beziehungen zwischen mehreren Kameraansichten her. Er erläutert detailliert die Herausforderungen in der Stereoanalyse, gibt eine Übersicht über existierende Verfahren und Lösungskonzepte und beschreibt moderne Bildsyntheseverfahren. Zahlreiche praktische Beispiele ergänzen die detaillierten mathematischen Ausführungen und erleichtern so das Verständnis. Das Buch überzeugt durch den logischen Aufbau und durch die geschlossene Erläuterung der mathematischen Grundlagen in einer einheitlichen Form und Notation. Es eignet sich besonders für Studierende und Wissenschaftler der Elektrotechnik und Informatik, insbesondere der Kommunikationstechnik.

Geschrieben für:
Studierende an Universitäten und Technischen Hochschulen in Elektrotechnik, Nachrichtentechnik, Informatik, Kommunikationstechnik; wissenschaftlich Tätige in Forschung und Industrie (Industrielle Bildverarbeitung, Videokommunikation, Medienproduktion).

Hinweis: Kein Buch ist perfekt. Falls Sie Fehler finden, bin ich um jeden Hinweis dankbar. Bitte senden Sie eine email an Oliver Schreer.

Awards

Innovation Price for Information Technology in Media to Decai Chen, Peter Eisert, Ingo Feldmann, Arne Finn, Anna Hilsmann, Peter Kauff, Wieland Morgenstern, Ralf Schäfer, Oliver Schreer, Marcus Zepp for their team achievement of "3D Human Body Reconstruction (3D HBR), a Base Technology for Volumetric Scanning" received at 30.FKTG Fachtagung (German Society for Electronic Media), Mainz, Germany, June 2024.

Best Poster Award to Sylvain Renault, Ingo Feldmann, Lieven Raes, Jurgen Silence, Oliver Schreer for their paper "Dynamic Exposure Visualization of Air Quality Data with Augmented Reality" published at 10th Int. Conf. on Geographical Information Systems Theory, Applications and Management, Anger, France, May 2024.

Best Paper Award to Decai Chen, Markus Worchel, Ingo Feldmann, Oliver Schreer, Peter Eisert for their paper "Accurate human body reconstruction for volumetric video" published at Int. Conf. on 3D Immersion 2021, Brussels, Belgium, Dec. 2021.

Joseph von Fraunhofer Prize 2019, Ingo Feldmann, Dr. Oliver Schreer, Peter Kauff, "Realistic people in virtual worlds - A movie as a true experience"; Munic, Germany, May 8, 2019.

Advanced Imaging Society (AIS) Technology Award 2017, Ingo Feldmann, Dr. Oliver Schreer, Peter Kauff, Christian Weissig, Danny Tatzelt, Thomas Ebner, Sylvain Renault, "3D Human Body Reconstruction"; Los Angeles, CA, USA, January 16, 2018.

Nomination for the Berlin Brandenburg Innovation Price 2017 Oliver Schreer. Ingo Feldmann, Thomas Ebner, Sylvain Renault, Peter, Kauff, D. Brückner (UFA Lab), E. Feiler (UFA Lab), F. Mrongowius (UFA Lab), F. Govaere (UFA Lab), "Volumetrisches Video - Schlüsseltechnologien für den begehbaren Film (Volumetric video - key technology for the walkable movie)"; 10 selecetd nominations out of 134 submissions, Berlin, Germany, December 1, 2017.

Distinguished Paper Award of SID Symposium Digest of Technical Papers 2017 to Thomas Ebner, Ingo Feldmann, Sylvain Renault, and Oliver Schreer for their paper "Dynamic Real World Objects in Augmented and Virtual Reality Applications" published at SID Symposium Digest of Technical Papers, Los Angeles, USA, May 2017.

Lumiére Best Paper Award of the International 3D & Advanced Imaging Society 2014 to S. Ebel, W. Waizenegger, M. Reinhardt, O. Schreer and I. Feldmann for their paper “Visibility-driven Patch Group Generation,” published at IEEE International Conference on 3D Imaging (IC3D), Liege, Belgium, December 2014.

EURASIP - Bi-Annual Best Paper Award 2012 to P. Kauff, N. Atzpadin, C. Fehn, M. Mueller, O. Schreer, A. Smolic, and R. Tanger, for their paper “Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability,” published in Signal Processing: Image Communication. Vol. 22, pp. 217–234, 2007.

President's Award for Best Technical Paper at International Broadcast Conference 2001 (IBC) to C. Fehn, P. Kauff, O. Schreer and Ralf Schäfer for their paper "Interactive Virtual View Video for Immersive TV Applications", published at proceedings of International Broadcast Conference (IBC 2001), Amsterdam, Netherlands, pp. 53-61, September 2001.

Lectures, supervised theses, committees, demonstrations, patents

Lectures

Supervised theses

Committees

Demonstrations

Patents

Lectures

O. Schreer, "Challenges and Solutions for Real-Time Immersive Video Communication", University of Genova, Italy, Biophysical and Electronic Engineering Dept., Prof. Carlo Regazzoni, duration 10 hours, 13-15 April 2005.

O. Schreer, "Stereoanalysis and View Synthesis in 3D Video Communication", University of Verona, Italy; Vision, Image Processing and Sound Laboratory; Dept. of Computer Science, Prof. Andrea Fusiello, 7th VIPS Advanced School on Computer Vision, Pattern Recognition and Image Processing, duration 16 hours, 13-16 March 2006.

Supervised theses

Maximilian Claaßen, thesis (master), "Image-based classification of urban/rural driving environments using CNN", TU Berlin, 2021.

Azrin Rahman, thesis (master), "Hand Gesture Recognition using CNN on embedded device", TU Berlin, 2021.

Adveit Kumar, thesis (master), "Comparison and Evaluation of Disparity Estimators for an Embedded Platform", TU Berlin, 2020.

Weibo Qiu, thesis (master), "Feature Operators Evaluation on Embedded Platform", TU Berlin, 2019.

Marcus Zepp, thesis (master), "Automatische Rekalibrierung von Multiview-Kamerasysteme anhand natürlicher Features", TU Berlin, 2019.

Uuriintsolmon Tsedevsuren, thesis (master), "Analyse und Implementierung einer Testautomatisierung für mobile Webanwendung unter Verwendung von Bilderkennungswerkzeugen", TU Berlin, 2018.

Nikolaos Papanikoloudis, thesis (master), "Development and evaluation of a method for estimation of 3D surface structures based on geometric primitives", TU Berlin, 2016.

Eric Kallenbach, thesis (master), "Machbarkeitsstudie zur bildbasierten Stoßerkennung beim Remote-Laser-Schweißen", TU Berlin, 2016.

Matthias Lottmann, thesis (master), "Integration der perspektivischen Verzerrung in das hybrid-rekursive Matching für die optimierte Stereoanalyse", TU Berlin, 2018.

Erik Rudisch, thesis (master), "Integration und Evaluierung von Tiefeninformation in ein Video-basiertes Analyse‐Framework zur Gestenanalyse für deutsche Gebärdensprache", TU Berlin, 2015.

Marian Bertzen, thesis (diploma), "User-Feedback und Optimierung für Mehrkamera-Kalibriersysteme", TU Berlin, 2013.

Michal Reinhardt, thesis (master), "Entwicklung eines Verfahrens zur Fusion von Tiefensensordaten mit bildbasiert geschätzten Disparitäten", TU Berlin, 2013.

Florian Schreiber, thesis (diploma), "Entwicklung und Evaluierung eines Multi-View Patch Sweep Verfahrens zur 3D Analyse in Videokommunikationsanwendungen", TU Berlin, 2013.

Mario Bodemann, thesis (diploma), "Entwicklung von Algorithmen zur semantischen Annotation von Videosequenzen basierend auf einer 3D Szenenanalysen", TU Berlin, 2011.

Committees

Chair of EU XR Forum "Annual event of European initiative XR4ALL”, December 12, 2019, Brussels, Belgium.

Chair of Session “Interactive technologies – current state and challenges for the future”, NEM Summit 2019, May 22, 2019, Zagreb, Croatia.

Chair of Special Session “Interactive and Immersive Entertainment and Communication ”, 18th International Conference on MultiMedia Modeling (MMM 2012), January 4-6, 2012, Klagenfurt, Austria

Program Chair, 12th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), May 13-15, 2011, Delft, Netherlands

General Chair, 1st International Workshop on 3D Video Processing (3DVP), in conjunction with ACM Multimedia 2010, Florence, Italy, 29th October 2010.

Chair of Special Session “Real-time high definition depth estimation”, 3DTV-CONFERENCE, June 7-9, 2010, Tampere, Finland.

Chair of Special Session “Rushes - Multimedia Indexing and Retrieval of Unedited Audio-Visual Footage”, 9th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), May 7-9, 2008, Klagenfurt, Austria.

Demonstrations

O. Schreer, "Real-time Gesture Recognition and Avatar Animation System”, Int. Conf. on Image Analysis and Processing (ICIAP), Modena, Italy, September 2007.

O. Schreer, P. Eisert, P. Kauff, R. Tanger, R. Englert, "GestAvatar - Real-Time Animation of Avatars", 9th European Conf. on Computer Vision (ECCV), Graz, Austria, May 2006.

Patents

US 9521362 View Rendering for the Provision of Virtual Eye Contact Using Special Geometric Constraints in Combination With Eye-Tracking

EP2781099 Vorrichtung und Verfahren für Echtzeitfähige Disparitätsschätzung zur Darstellung einer Virtuellen Ansicht mit Eignung für Multi-Threaded-Ausführung

US9158994 Apparatus and Method for Real-Time Capable Disparity Estimation for Virtual View Rendering Suitable for Multi-Threaded Execution

An Artist's Impression by Emanuele Trucco

Emanuele Trucco is not only an enthusiastic researcher in computer vision, but also an outstanding artist. He kindly offered me a set of introductory drawings for my lecture book on stereo image processing and view synthesis at Springer.

All about his scientific work at School of Computing, University of Dundee, Scotland, can be found here.