Aktuelle Publikationen

November 2023

Langevin Cooling for Unsupervised Domain Translation

Vignesh Srinivasan, Klaus-Robert Müller, Wojciech Samek, Shinichi Nakajima

In this paper, we show that many of such unsuccessful samples in image-to-image translation lie at the fringe—relatively low-density areas of data distribution, where the DNN was not trained very well. To tackle this problem we propose to perform...


November 2023

Towards automated digital building model generation from floorplans and on-site images

Niklas Gard, Aleixo Cambeiro Barreiro

We propose a system to automatically generate enriched digital models from this data, consisting of two AI modules: one for 3D model reconstruction from 2D plans and one for 6D localization of images taken within a building in the corresponding...


November 2023

Characterization of C-Band Coherent Receiver Front-ends for Transmission Systems beyond S-C-L-Band

Robert Emmerich, Colja Schubert, Carsten Schmidt-Langhorst, Ronald Freund

Fraunhofer HHI Researchers investigate in this publication a cost-efficient capacity upgrade of optical transmission systems by the reuse of already deployed single mode fiber. This is enabled by the benefits of other transmission bands, to...


Oktober 2023

Private and Secure Over-the-Air Multi-Party Communication

Jan Jonas Brune, Slawomir Stanczak, Igor Bjelakovic, Matthias Frey, Felix Klement, Stefan Katzenbeisser

Over-the-Air Multi-Party Communication for scalable, private, secure and dependable data aggregation: This novel approach combines lattice coding, Over-the-Air computation and secure Multi-Party Communication to confidentially aggregate analog...


Oktober 2023

Pre-Training with Fractal Images Facilitates Learned Image Quality Estimation

Malte Silbernagel, Thomas Wiegand, Peter Eisert, Sebastian Bosse

Current image quality estimation relies on data-driven approaches, however the scarcity of annotated data poses a bottleneck. This paper introduces a novel pre-training approach utilizing synthetic fractal images. The proposed method is tested on...


Oktober 2023

A Differentiable Gaussian Prototype Layer for Explainable Fruit Segmentation

Michael Gerstenberger, Peter Eisert, Sebastian Bosse, Steffen Maaß

We introduce a GMM Layer for gradient-based prototype learning. It is used to cluster feature vectors by computing their probabilities for each gaussian and using the soft cluster assignment for prediction. Hence prototypical image regions can be...


Oktober 2023

Design and Fabrication of Crossing-free Waveguide Routing Networks using a Multi-layer Polymer-based Photonic Integration Platform

Madeleine Weigel, Martin Schell, Moritz Kleinert, Crispin Zawadzki, David de Felipe Mesquida, Martin Kresse, Norbert Keil, Hauke Conradi, Anja Scheu, Jakob Reck, Klara Mihov

A novel 16x4 crossing-free waveguide routing network on four layers of polymer-based stacked waveguides is presented. The design and fabricated device combine in-plane passive waveguide structures with vertical multimode interference couplers to...


September 2023

From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation

Reduan Achtibat, Thomas Wiegand, Sebastian Bosse, Wojciech Samek, Sebastian Lapuschkin, Maximilian Dreyer, Ilona Eisenbraun

We introduce the Concept Relevance Propagation (CRP) approach, which combines the local and global perspectives and thus allows answering both the ‘where’ and ‘what’ questions for individual predictions. We demonstrate the capability of our...


September 2023

When it comes to Earth observations in AI for disaster risk reduction, is it feast or famine? A topical review

Monique Kuglitsch, Jackie Ma, Arif Albayrak, Allison Craddock, Andrea Toreti, Elena Xoplaki, Jürg Lüterbacher, Paula Padrino Vilela, Rui Kotani, Dominique Berod, Jon Cox

Given the number of in situ and remote (e.g. radiosonde/satellite) monitoring devices, there is a common perception that there are no limits to the availability of EO for immediate use in such AI-based models. However, a mere fraction of EO is...


September 2023

FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning

Felix Sattler, Wojciech Samek, Roman Rischke, Tim Korjakow

In this work, we propose FEDAUX, an extension to Federated Distillation, which, under the same set of assumptions, drastically improves the performance by deriving maximum utility from the unlabeled auxiliary data. Our proposed method achieves...


September 2023

Unsupervised learning of style-aware facial animation from real acting performances

Wolfgang Paier, Peter Eisert, Anna Hilsmann

This paper presents a novel approach for text/speech-driven animation of a photo-realistic head model based on blend-shape geometry, dynamic textures, and neural rendering. Training a VAE for geometry and texture yields a parametric model for...


September 2023

Video-Driven Animation of Neural Head Avatars

Wolfgang Paier, Peter Eisert, Anna Hilsmann, Paul Hinzer

We present a new approach for video-driven animation of high-quality neural 3D head models, addressing the challenge of person-independent animation from video input.In order to achieve person-independent animation from video input, we introduce...


September 2023

From Multispectral-Stereo to Intraoperative Hyperspectral Imaging: a Feasibility Study

Eric Wisotzky, Peter Eisert, Anna Hilsmann, Philipp Arens, Benjamin Kossack, Brigitta Globke, Jost Triller

Spectral imaging allows to analyze optical tissue properties that are invisible to the naked eye. We present a novel approach using two multispectral snapshot cameras covering different spectral ranges as a stereo-system. The proposed method...


September 2023

Automatic Registration of Anatomical Structures of Stereo-Endoscopic Point Clouds

Sophie Beckmann, Peter Eisert, Anna Hilsmann, Jean-Claude Rosenthal, Eric Wisotzky

In this paper, we present an analysis and registration pipeline for confined point clouds acquired by stereo endoscopes into a fused representation. For a coarse registration, TEASER is applied, while a refinement is conducted utilizing...


September 2023

Surgical Phase Recognition for different hospitals

Eric Wisotzky, Peter Eisert, Anna Hilsmann, Sophie Beckmann, Lasse Renz-Kiefel, sebastian Lünse, Rene Mantke

Surgical phase recognition is an important aspect of surgical workflow analysis, as it allows an automatic analysis of the performance and efficiency of surgical procedures. A big challenge for training a neural network for surgical phase...


September 2023

3D Hyperspectral Light-Field Imaging: a first intraoperative implementation

Eric Wisotzky, Peter Eisert, Anna Hilsmann

Hyperspectral imaging is an emerging technology that has gained significant attention in the medical field due to its ability to provide precise and accurate imaging of biological tissues. The current methods of hyperspectral imaging, such as...


September 2023

Hybrid semantic clustering of 3D point clouds in construction

Marcus Zepp

In this work, we present an artificial intelligence (AI)-based semantic segmentation approach for three-dimensional (3D) point clouds which were generated from 2D images with a structure from motion (SfM) pipeline. We utilize state-of-the-art...


August 2023

Eight-channel SiNx microring–resonator based photonic biosensor for label-free fluid analysis in the optical C-band

Jakob Reck, Norbert Keil, Martin Schell, Moritz Kleinert, Crispin Zawadzki, David de Felipe Mesquida, Martin Kresse, Hauke Conradi, Tianwen Qian, Cafercan Yilmaz, Madeleine Weigel, Klara Mihov, Christina Hoffmann, Peter Hoffmann, Vera Froese, Ulrich Kertzscher, Kristina Mykhailiuk, Julia Michaelis, Wilfired Weigel, Sören Scholand, Hans-Jürgen Heupke

A lab-on-a-chip multichannel sensing platform for biomedical analysis based on optical silicon nitride (SiNx) microring-resonators (MRR) was established. The resonators were surface functionalized and finally combined with a microfluidic chamber...


August 2023

Diffuse-scattering-informed Geometric Channel Modeling for THz Wireless Communications Systems

Leyre Azpilicueta, Alper Schultze, Mikel Celaya-Echarri, Raed. M. Shubair, Francisco Falcone, Fidel A. Rodríguez-Corbo, Costas Constantinou, Miguel Navarro-Cía

This paper validates an in-house three-dimensional ray-launching (3D-RL) algorithm with a channel sounder measurement campaign that has been performed in a typical indoor environment at 300 GHz.


August 2023

A hybrid photonic integrated signal source with > 1.5 THz continuous tunability and < 0.25 GHz accuracy for mmW/THz applications

Tianwen Qian, Norbert Keil, Martin Schell, Moritz Kleinert, Crispin Zawadzki, David de Felipe Mesquida, Madeleine Weigel, Jakob Reck, Klara Mihov, Martin Kresse, Peer Liebermann

We present a hybrid photonic integrated mmW/THz signal source, which comprises two tunable lasers and on-chip wavelength meters. The continuous wavelength tunability of a single laser is over 12 nm (1.5 THz), and the wavelength meter accuracy is...


August 2023

1x4 Vertical Power Splitter/Combiner: A Basic Building Block for Complex 3D Waveguide Routing Networks

Madeleine Weigel, Norbert Keil, Martin Schell, Moritz Kleinert, Crispin Zawadzki, D. De Felipe, Martin Kresse, Tianwen Qian, Jakob Reck, Klara Mihov, Jan H. Bach, Philipp Winklhofer

A novel polymer-based 1x4 vertical multimode interference (MMI) coupler for 3D photonics is presented. It connects four vertically stacked waveguide layers with a spacing of 21.6 µm. The functionality is demonstrated on a fabricated device.


Juli 2023

Optimization of Ultra-Broadband Optical Wavelength Conversion in Nonlinear Multi-Modal Silicon-On-Insulator Waveguides

Isaac Sackey, Norbert Hanik, Colja Schubert, Ronald Freund, Lars Zimmermann, Gregor Ronniger, Tasnad Kernetzky, Yizhao Jia, Ulrike Höfler

Ultra-broadband wavelength conversion is identified as one of the key issues in future high capacity, flexible optical networks. In this contribution, methods to optimize the design of a multi-modal high-nonlinear SOI waveguide to achieve...


Juli 2023

Automatic Reconstruction of Semantic 3D Models from 2D Floor Plans

Aleixo Cambeiro Barreiro, Peter Eisert, Anna Hilsmann, Mariusz Trzeciakiewicz

Digitalization of existing buildings and the creation of 3D BIM models is crucial for many tasks. Of particular importance are floor plans, which contain information about building layouts and are vital for construction, maintenance or...


Juli 2023

Eight-channel SiNx microring–resonator based photonic biosensor for label-free fluid analysis in the optical C-band

Jakob Reck, Norbert Keil, Martin Schell, Moritz Kleinert, Crispin Zawadzki, David de Felipe Mesquida, Martin Kresse, Hauke Conradi, Tianwen Qian, Cafercan Yilmaz, Madeleine Weigel, Klara Mihov, Christina Hoffmann, Peter Hoffmann, Vera Froese, Ulrich Kertzscher, Kristina Mykhailiuk, Julia Michaelis, Wilfired Weigel, Sören Scholand, Hans-Jürgen Heupke

A lab-on-a-chip multichannel sensing platform for biomedical analysis based on optical silicon nitride (SiNx) mi- croring-resonators (MRR) was established. The resonators were surface functionalized and finally combined with a microfluidic...


Juni 2023

Accurate human body reconstruction for volumetric video

Decai Chen, Oliver Schreer, Peter Eisert, Ingo Feldmann, Markus Worchel

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras.We introduce and optimize deep learning based multi-view stereo networks for...


Juni 2023

Dynamic Multi-View Scene Reconstruction Using Neural Implicit Surface

Decai Chen, Oliver Schreer, Peter Eisert, Ingo Feldmann, Haofei Lu

In this paper, we propose a template-free method to reconstruct surface geometry and appearance using neural implicit representations from multi-view videos. We leverage topology-aware deformation and the signed distance field to learn complex...


Juni 2023

Preserving Memories of Contemporary Witnesses Using Volumetric Video

Volumetric Video is a novel technology that allows the creation of dynamic 3D models of persons, which can then be integrated in any 3D environment. It is authentic and much more realistic and therefore ideal for the transfer of emotions, facial expressions and gestures, which is highly relevant in the context of preservation of contemporary witnesses and survivors of the Holocaust. Fraunhofer HHI is working on two projects in this cultural heritage. A VR documentary about the last Ger! man survivor of the Holocaust Ernst Grube has been produced together with UFA GmbH. A second project is with Dr. Eva Umlauf, the youngest Jewish survivor in the concentration camp in Auschwitz.

Oliver Schreer, Peter Eisert, Ingo Feldmann, Anna Hilsmann, Sylvain Renault, Marcus Zepp, Wieland Morgenstern, Rodrigo Mauricio Diaz Fernandez, Markus Worchel


Juni 2023

Comparison of Polarization Diversity Configurations of SOI Strip Waveguide-Based Dual-Polarization Wavelength Conversion for S-Band Transmission

Isaac Sackey, Colja Schubert, Carsten Schmidt-Langhorst, Robert Elschner, Tomoyuki Kato, Takeshi Hoshida, Gregor Ronniger, Hidenobu Muranaka, Shun Okada, Yu Tanaka, Tsuyoshi Yamamoto

Using wavelength conversion of our fabricated SOI strip waveguide, we compared experimentally the polarization-insensitive configuration toward S-band real-time transmission. It is found that parallel configuration is 3dB superior in in-out...


Juni 2023

Experimental Demonstration of Optical Modulation Format Identification Using SOI-based Photonic Reservoir

Guillermo von Hünefeld, Colja Schubert, Ronald Freund, Johannes Fischer, Isaac Sackey, Gregor Ronniger, Pooyan Safari, Md Mahasin Khan, Rijil Thomas, Enes Seker, Stephan Suckow, Max Lemme, David Stahl

We experimentally show modulation format identification in the optical domain using Silicon-on-Insulator-based Photonic-Integrated-Circuit (PIC) reservoir. Identification of 32 GBd single-polarization signals of 4QAM, 16QAM, 32QAM and 64QAM is...


Juni 2023

Multi-View Mesh Reconstruction with Neural Deferred Shading

Markus Worchel, Oliver Schreer, Peter Eisert, Ingo Feldmann, Rodrigo Mauricio Diaz Fernandez, Weiwen Hu

We propose an analysis-by-synthesis method for fast multi-view 3D reconstruction of opaque objects with arbitrary materials and illumination. We represent surfaces as triangle meshes and build a differentiable rendering pipeline around triangle...


Ergebnisse pro Seite10ǀ20ǀ30
Ergebnisse 91-120 von 328
<< < 1 2 3 4 5 6 7 8 > >>