Sylvain Renault is a scientist and project manager at the Immersive Media and Communication group in the Vision and Imaging Technologies department.
His R&D activities are related to the following keywords: 3D visualizations, real-time rendering, virtual and augmented reality, panorama visualizations, touchless interaction technologies, multimodal user-centred applications, DirectX, OpenGL, Unity3D, autostereoscopic displays, GPU-based algorithms.
For further details about his activities please check the subsections below.
Biography
Sylvain Renault received his diploma degree in Computer Science from the Technical University of Berlin, Germany, in 1997. After his studies, he has been working for the Fraunhofer HHI in the Interactive Media and Human Factors department in the research field of 3D Visualization with autostereoscopic Displays, Virtual Reality application developments and novel human-machine interaction technologies.
He developed from 1997 until 2002 the Visual Operation System VOS as part of the national R&D projects “BLICK” and “mUltimo3D”. VOS ran on Silicon Graphics (SGI) workstations O2, ONYX and ONYX 2 and was implemented under the VR toolkit “dVS” from DIVISION, an API for industrial and scientific visualization. VOS integrated a visual programming interface, a multimodal graphical interface with head and gaze sensors and a stereo output without glasses. He also integrated network capabilities allowing two users to work together in virtual rooms via two autostereoscopic displays. Thus he developed many interactive applications in the field of virtual reality.
From 2003 (start time of the R&D projects “Mixed3D”) until 2015 he developed a new 3D real-time software framework Workbench3D supporting quick design and implementation of multi-modal virtual environments. He early used the DirectX .NET API and continuously expanded the system for new user modalities with devices like: force-feedback PHANTOM from SenSable Technologies, 3D space mice, head-eye tracking devices, hand/head-position, gesture input, voice control, and natural speech output via micro-segment TTS. Further. Further he developed autostereoscopic drivers with GPU programming for a big range of multi-view and single-person 3D displays (active stereo, passive stereo and autostereoscopic) and for 180° panoramic projections. The WB3D became the common SDK of the department for many research projects and industrial and commercial solutions.
Currently he is working in the Vision and Imaging Technologies department in the research group “Immersive Media & Communication”. His current objectives are focused on novel rendering concepts for immersive media, VR and AR technologies, human-body-reconstruction (HBR), user-centered visualizations and applications for 3D displays and 3D panoramic screens. Today, he uses the UNITY platform to design and develop 3D applications in the industrial, teleconference, infotainment, cultural-heritage, and medical research fields. Further, he develops new modules for framework Veye, a capturing and reconstruction workflow from the Fraunhofer HHI for HBRs and static objects.
In the last 20 years, he realized various interactive 3D prototypes in many research projects and delivered special and innovative solutions for (i) cultural heritage e.g. 3D Book Explorer (Bavarian State Library), Apian Globus (Bavarian State Library), Trabi Car-Simulator (DDR Museum of Berlin), Autostereoscopic Web-Viewer (Fraunhofer-Allianz) – and (ii) industrial customers e.g. Intelligent Living Kiosk (T-Systems), many 3D-Kiosk (for MTU, Siemens, RITTAL, Shell, Uhren Lange, TESAT, VW, Lufthansa, BBVA), InfoSpace (Adidas), MI-Report (Karl Storz, HowToOrganize), Foto-Kiosk (CEWE), 3D-Cockpit (BMW), 3D-Indoor-Navigation-Display (3D-Berlin), HUD Visualization (Bosch), ZED3D Explorer (Zeutschel).
Publications
Articles in Journals
2022
- Oliver Schreer, Markus Worchel, Rodrigo Mauricio Diaz Fernandez, Sylvain Renault, Wieland Morgenstern, Ingo Feldmann, Marcus Zepp, Anna Hilsmann, Peter Eisert
Preserving Memories of Contemporary Witnesses Using Volumetric Video,
i-com, Oldenbourg Wissenschaftsverlag, ISSN: 2196-6826, vol. 21, no. 1, pp. 71-82, April 2022, doi: https://doi.org/10.1515/icom-2022-0015, Open Access, Invited Paper
2019
- Oliver Schreer, Ingo Feldmann, Thomas Ebner, Sylvain Renault, Christian Weissig, Danny Tatzelt, Peter Kauff
Advanced Volumetric Capture and Processing,
SMPTE Motion Imaging Journal, vol. 128, no. 5, May 2019, doi: 10.5594/JMI.2019.2906835, Invited Paper
2017
- Thomas Ebner, Ingo Feldmann, Sylvain Renault, Oliver Schreer, Peter Eisert
Multi-view reconstruction of dynamic real-world objects and their integration in augmented and virtual reality applications,
Journal of the Society for Information Display, vol. 25, no. 3, pp. 151–157, March 2017, doi: 10.1002/jsid.538
2015
- Simone Höckh, Annette Frederiksen, Sylvain Renault, Klaus Hopf, Michael Gilowski, Martin Schell
Exploring Crosstalk Perception for Stereoscopic 3D Head-Up Displays in a Crosstalk Simulator,
Journal of the Society for Information Display, Wiley Verlag, September 2015, doi: 10.1002/jsid.368
1999
- S. Pastoor, J. Liu, Sylvain Renault
An experimental multimedia system allowing 3-D visualization and eye-controlled interaction without user-worn devices,
IEEE Transactions on Multimedia, vol. 1, no. 1, pp. 41-52, January 1999
Conference Contributions
2025
- Sylvain Buche, Ingo Feldmann, Patrick Harns, Hugo Kreber, Jeremy Lacoche, Stephane Louis Dit Picard, Sylvain Renault, Jérome Royan
Interoperable and Open Source Solution for Anchoring Augmented Reality Content to the Real World,
IEEE VR, Saint-Malo, France, March 2025, arXiv: https://labs.etsi.org/rep/arf/world-analysis-api-helpers/unity-world-analysis-validation
2024
- Sylvain Renault, Ingo Feldmann, Lieven Raes, Jurgen Silence, Oliver Schreer
Dynamic Exposure Visualization of Air Quality Data with Augmented Reality,
10th Int. Conf. on Geographical Information Systems Theory, Applications and Management, Anger, France, May 2024, doi: 10.5220/0012586700003696, Best Poster Award
2021
- Oliver Schreer, Markus Worchel, Rodrigo Mauricio Diaz Fernandez, Sylvain Renault, Wieland Morgenstern, Ingo Feldmann, Marcus Zepp, Anna Hilsmann, Peter Eisert
Preserving Memories of Contemporary Witnesses Using Volumetric Video,
ACM Conference Culture and Computer Science, Berlin, Germany, September 2021, doi: 10.1515/icom-2022-0015, Science Physical und Virtual Spaces
2019
- Oliver Schreer, Ingo Feldmann, Sylvain Renault, Marcus Zepp, Peter Eisert, Peter Kauff
Capture and 3D Video Processing of Volumetric Video,
IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, September 2019, doi: 10.1109/ICIP.2019.8803576
2018
- Oliver Schreer, Ingo Feldmann, Thomas Ebner, Sylvain Renault, Christian Weissig, Danny Tatzelt, Peter Kauff
Advanced Volumetric Capture and Processing,
International Broadcasting Convention (IBC 2018), Amsterdam, The Netherlands, September 2018, selected as one of the top 10 best conference papers
2017
- Thomas Ebner, Ingo Feldmann, Sylvain Renault, Oliver Schreer
Dynamic Real World Objects in Augmented and Virtual Reality Applications,
SID Symposium Digest of Technical Papers, Los Angeles, California, USA, pp. 673–676, May 2017, doi: 10.1002/sdtp.11726, Distinguished Paper Award - René de la Barré, Roland Bartmann, Mathias Kuhlmey, Bernd Duckstein, Silvio Jurk, Sylvain Renault
A new design and image processing algorithm for lenticular lens displays,
IS&T International Symposium on Electronic Imaging, Stereoscopic Displays and Applications XXVIII, San Francisco, California, USA, pp. 194-199, February 2017, doi: 10.2352/issn.2470-1173.2017.5.sda-377
2016
- Sylvain Renault, Thomas Ebner, Ingo Feldmann, Oliver Schreer
Point cloud compression framework for the Web,
International Conference on 3D Imaging (IC3D 2016), Liége, Belgium, December 2016, doi: 10.1109/ic3d.2016.7823455 - René de la Barré, Roland Bartmann, Mathias Kuhlmey, Bernd Duckstein, Silvio Jurk, Sylvain Renault
A new design and algorithm for lenticular lenses display,
International Conference on 3D Imaging (IC3D 2016), Liége, Belgium, December 2016, doi: 10.1109/ic3d.2016.7823447 - Ingo Feldmann, Oliver Schreer, Thomas Ebner, Sascha Ebel, Sylvain Renault
Real Persons and Objects for Virtual Reality Applications,
Society for Information Display Mid-Europe Fall Meeting (SID-ME), Berlin, Germany, November 2016
2014
- Silvio Jurk, Bernd Duckstein, Sylvain Renault, Mathias Kuhlmey, René de la Barré, Thomas Ebner
Enhancing multi-view autostereoscopic displays by viewing distance control (VDC),
25th Stereoscopic Displays and Applications Conference (SD&A), San Francisco, California, USA, February 2014, doi: 10.1117/12.2040755
2013
- Sylvain Renault, Bernd Duckstein, Thomas Ebner, Christine Brand
Old books in interactive virtual 3D presentation,
20th consecutive EVA-Conference, Berlin, Germany, November 2013
2011
- René de la Barré, Sylvain Renault, Bernd Duckstein, Thomas Ebner, Silvio Jurk, M. Gravert
Hochauflösendes autostereoskopisches Heimkino – Vision und Wirklichkeit,
3D Forum, Lindlar, Germany, October 2011
2009
- Sylvain Renault, René de la Barré, Thomas Ebner
Verschmelzung von Haptik und räumlicher Sicht für die Interaktion mit medizinischen 3D-Modellen,
Proceedings of Innovationsforum "Anwendung der Haptik in der robotergestützten Chirurgie", KONGRESS&KULTUR, Magdeburg, Germany, p. 10f., October 2009
2007
- B. Horst, René de la Barré, Sylvain Renault, M. Horst
From real artefact to its quasi-holographic presentation - Mapping of texture and form in challenging circumstances,
Proceedings of 10th International Conference on Human and Computers (HC 2007), Düsseldorf, Germany, December 2007
2005
- René de la Barré, S. Pastoor, Ch. Conomis, David Przewozny, Sylvain Renault, O. Stachel, Bernd Duckstein, Klaus Schenke
Natural interaction in a desktop mixed reality environment,
Proceedings of 6th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2005), Montreux, Switzerland, April 2005
2004
- Sylvain Renault, O. Stachel
Unterstützung multimodaler und natürlicher Interaktionen durch die WORKBENCH3D bei der Modellierung und Visualisierung von VR-Umgebungen auf autostereoskopischen Endgeräten,
Internetpräsenz des 3D-Display-Innovationsforums, Jena, Germany, July 2004 - Sylvain Renault, O. Stachel
Erlebnisorientierter 3D-Kiosk mit berührungsloser Interaktion für Ausstellungslandschaften,
Proceedings of EVA Conference, Berlin, Germany, pp. 40-46, January 2004 - Klaus Hopf, René de la Barré, Sylvain Renault, O. Stachel
3D-Kiosk mit berührungsloser Interaktion,
Proceedings of EVA Conference, Berlin, Germany, pp. 161-162, January 2004
2003
- Sylvain Renault, O. Stachel
WORKBENCH3D – Modellierung und Visualisierung von VR-Umgebungen auf autostereoskopischen Endgeräten mit multimodalen, natürlichen Interaktionen,
Proceedings of 3D-NordOst 2003, 6. Anwendungsbezogener Workshop, Berlin, Germany, pp. 103-110, December 2003 - Sylvain Renault, O. Stachel
Möglichkeiten erlebnisorientierter 3D-Visualisierung mit natürlicher Interaktion für Ausstellungslandschaften,
Proceedings of EVA Conference International, Berlin, Germany, pp. 143-150, November 2003 - Sylvain Renault
Mixed 3D – Ecrans et interactions 3D pour applications multimedia,
Workshop "The digital city of the future", Logrono, Spain, May 2003
Talks
2013
- Sylvain Renault
Presentation of the Book-Explorer,
Zeutschel, Workshop: International Dealer Meeting, Tübingen-Hirschau, Germany, 2013, Talk
2012
- Sylvain Renault
Die Zukunft der Interaktion - wie die Hand zur smarten Fernbedienung wird!,
Schneider Digital, VR Tagung, Chemnitz, Germany, 2012, Talk
2003
- Sylvain Renault
Display- und Interaktionstechniken für Mixed Reality,
IFA 2003, Talk im Technisch-Wissenschaftliche Forum (TWF), Forum at Fair Trade, Berlin, Germany, 2003, Talk
Books/Chapters
2025
- Sylvain Renault, Lieven Raes, Burcu Celikkol, Oliver Schreer, Jaap De Winter, Jéssica Baltazar, Susie Ruston McAleer, Daniel Bertocci
Connected Services: IoT Data to Fuel Your Local Digital Twin,
In: Decide Better - Open and Interoperable Local Digital Twins, In: Open and Interoperable Local Digital Twins, Springer, Cham, ISBN: 978-3-031-81451-8, pp. 169-202, March 2025, doi: https://doi.org/10.1007/978-3-031-81451-8, Book Chapter
2022
- Sylvain Renault, Oliver Schreer
Visualization for Cultural Heritage,
In: Fraunhofer Technologies for Heritage Protection in Times of Climate Change and Digitization, Fraunhofer IRB Verlag, Stuttgart, ISBN: 978-3-7388-0787-5 (print), 978-3-7388-0788-2 (e-bo, pp. 52-63, November 2022, Book Chapter
Awards
Awards
Best Poster Award to Sylvain Renault, Ingo Feldmann, Lieven Raes, Jurgen Silence, Oliver Schreer for their paper "Dynamic Exposure Visualization of Air Quality Data with Augmented Reality" published at 10th Int. Conf. on Geographical Information Systems Theory, Applications and Management, Anger, France, May 2024.
Advanced Imaging Society (AIS) Technology Award 2017, Ingo Feldmann, Dr. Oliver Schreer, Peter Kauff, Christian Weissig, Danny Tatzelt, Thomas Ebner, Sylvain Renault, "3D Human Body Reconstruction"; Los Angeles, CA, USA, January 16, 2018.
Nomination for the Berlin Brandenburg Innovation Price 2017 Oliver Schreer. Ingo Feldmann, Thomas Ebner, Sylvain Renault, Peter, Kauff, D. Brückner (UFA Lab), E. Feiler (UFA Lab), F. Mrongowius (UFA Lab), F. Govaere (UFA Lab), "Volumetrisches Video - Schlüsseltechnologien für den begehbaren Film (Volumetric video - key technology for the walkable movie)"; 10 selecetd nominations out of 134 submissions, Berlin, Germany, December 1, 2017.
Distinguished Paper Award of SID Symposium Digest of Technical Papers 2017 to Thomas Ebner, Ingo Feldmann, Sylvain Renault, and Oliver Schreer for their paper "Dynamic Real World Objects in Augmented and Virtual Reality Applications" published at SID Symposium Digest of Technical Papers, Los Angeles, USA, May 2017.