Hybrid semantic clustering of 3D point clouds in construction
In this work, we present an artificial intelligence (AI)-based semantic segmentation approach for three-dimensional (3D) point clouds which were generated from 2D images with a structure from motion (SfM) pipeline. We utilize state-of-the-art...
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning
In this work, we propose FEDAUX, an extension to Federated Distillation, which, under the same set of assumptions, drastically improves the performance by deriving maximum utility from the unlabeled auxiliary data. Our proposed method achieves...
Eight-channel SiNx microring–resonator based photonic biosensor for label-free fluid analysis in the optical C-band
A lab-on-a-chip multichannel sensing platform for biomedical analysis based on optical silicon nitride (SiNx) microring-resonators (MRR) was established. The resonators were surface functionalized and finally combined with a microfluidic chamber...
Diffuse-scattering-informed Geometric Channel Modeling for THz Wireless Communications Systems
This paper validates an in-house three-dimensional ray-launching (3D-RL) algorithm with a channel sounder measurement campaign that has been performed in a typical indoor environment at 300 GHz.
A hybrid photonic integrated signal source with > 1.5 THz continuous tunability and < 0.25 GHz accuracy for mmW/THz applications
We present a hybrid photonic integrated mmW/THz signal source, which comprises two tunable lasers and on-chip wavelength meters. The continuous wavelength tunability of a single laser is over 12 nm (1.5 THz), and the wavelength meter accuracy is...
1x4 Vertical Power Splitter/Combiner: A Basic Building Block for Complex 3D Waveguide Routing Networks
A novel polymer-based 1x4 vertical multimode interference (MMI) coupler for 3D photonics is presented. It connects four vertically stacked waveguide layers with a spacing of 21.6 µm. The functionality is demonstrated on a fabricated device.
Optimization of Ultra-Broadband Optical Wavelength Conversion in Nonlinear Multi-Modal Silicon-On-Insulator Waveguides
Ultra-broadband wavelength conversion is identified as one of the key issues in future high capacity, flexible optical networks. In this contribution, methods to optimize the design of a multi-modal high-nonlinear SOI waveguide to achieve...
Eight-channel SiNx microring–resonator based photonic biosensor for label-free fluid analysis in the optical C-band
A lab-on-a-chip multichannel sensing platform for biomedical analysis based on optical silicon nitride (SiNx) mi- croring-resonators (MRR) was established. The resonators were surface functionalized and finally combined with a microfluidic...
Automatic Reconstruction of Semantic 3D Models from 2D Floor Plans
Digitalization of existing buildings and the creation of 3D BIM models is crucial for many tasks. Of particular importance are floor plans, which contain information about building layouts and are vital for construction, maintenance or...
Accurate human body reconstruction for volumetric video
In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras.We introduce and optimize deep learning based multi-view stereo networks for...
Dynamic Multi-View Scene Reconstruction Using Neural Implicit Surface
In this paper, we propose a template-free method to reconstruct surface geometry and appearance using neural implicit representations from multi-view videos. We leverage topology-aware deformation and the signed distance field to learn complex...
Preserving Memories of Contemporary Witnesses Using Volumetric Video
Oliver Schreer, Peter Eisert, Ingo Feldmann, Anna Hilsmann, Sylvain Renault, Marcus Zepp, Wieland Morgenstern, Rodrigo Mauricio Diaz Fernandez, Markus Worchel
Comparison of Polarization Diversity Configurations of SOI Strip Waveguide-Based Dual-Polarization Wavelength Conversion for S-Band Transmission
Using wavelength conversion of our fabricated SOI strip waveguide, we compared experimentally the polarization-insensitive configuration toward S-band real-time transmission. It is found that parallel configuration is 3dB superior in in-out...
Multi-View Mesh Reconstruction with Neural Deferred Shading
We propose an analysis-by-synthesis method for fast multi-view 3D reconstruction of opaque objects with arbitrary materials and illumination. We represent surfaces as triangle meshes and build a differentiable rendering pipeline around triangle...
Explainable Sequence-to-Sequence GRU Neural Network for Pollution Forecasting
The goal of pollution forecasting models is to allow the prediction and control of the air quality. While such deep learning models were deemed for a long time as black boxes, recent advances in eXplainable AI (XAI) allow to look through the...
Optimizing Explanations by Network Canonization and Hyperparameter Search
Rule-based and modified backpropagation XAI methods struggle with innovative layer building blocks and implementation-invariance issues.
In this work we propose canonizations for popular deep neural network architectures and...
Experimental Demonstration of Optical Modulation Format Identification Using SOI-based Photonic Reservoir
We experimentally show modulation format identification in the optical domain using Silicon-on-Insulator-based Photonic-Integrated-Circuit (PIC) reservoir. Identification of 32 GBd single-polarization signals of 4QAM, 16QAM, 32QAM and 64QAM is...
Increasing the power and spectral efficiencies of an OFDM-based VLC system through multi-objective optimization
In order to minimize power usage and maximize spectral efficiency in visible light communication (VLC), we use a multi-objective optimization algorithm and compare DC-biased optical OFDM (DCO-OFDM) with constant envelope OFDM (CE-OFDM)...
Deep-Unfolded Adaptive Projected Subgradient Method for MIMO Detection
Deep-Unfolded Adaptive Projected Subgradient Method for MIMO Detection This paper proposes a MIMO detector based on a deep unfolded superiorized adaptive projected subgradient method (APSM). By learning the design parameters of a superiorized...
Fooling State-of-the-Art Deepfake Detection with High-Quality Deepfakes
Due to the rising threat of deepfakes to security and privacy, it is most important to develop robust and reliable detectors. In this paper, we examine the need for high-quality samples in the training datasets of such detectors. Accordingly, we...
Assessing the Value of Multimodal Interfaces: A Study on Human–Machine Interaction in Weld Inspection Workstations
Multimodal user interfaces promise natural and intuitive human–machine interactions. However, is the extra effort for the development of a complex multisensor system justified, or can users also be satisfied with only one input modality? This...
Shortcomings of Top-Down Randomization-Based Sanity Checks for Evaluations of Deep Neural Network Explanations
While the evaluation of explanations is an important step towards trustworthy models, it needs to be done carefully, and the employed metrics need to be well-understood. Specifically model randomization testing is often overestimated and regarded...
Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanations
Applying traditional post-hoc attribution methods to segmentation or object detection predictors offers only limited insights, as the obtained feature attribution maps at input level typically resemble the models' predicted segmentation mask or...
Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models
State-of-the-art machine learning models often learn spurious correlations embedded in the training data. This poses risks when deploying these models for high-stake decision-making, such as in medical applications like skin cancer detection. To...
The Meta-Evaluation Problem in Explainable AI: Identifying Reliable Estimators with MetaQuantus
Explainable AI (XAI) is a rapidly evolving field that aims to improve transparency and trustworthiness of AI systems to humans. One of the unsolved challenges in XAI is estimating the performance of these explanation methods for neural networks,...
Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvement
Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. This paper offers a comprehensive overview over techniques that apply XAI practically to...
Sydnone Methides: Intermediates between Mesoionic Compounds and Mesoionic N-Heterocyclic Olefins
Sydnone methides represent an almost unknown class of mesoionic compounds which possess exocyclic carbon substituents instead of oxygen (sydnones) or nitrogen (sydnone imines) in the 5-position of a 1,2,3-oxadiazolium ring. Unsubstituted...
Bridging the Gap: Gaze Events as Interpretable Concepts to Explain Deep Neural Sequence Models
Recent work in XAI for eye tracking data has evaluated the suitability of feature attribution methods to explain the output of deep neural sequence models for the task of oculomotric biometric identification. In this work, we employ established...
Experimental and Numerical Evaluation of CAZAC-type Training Sequences for MxM SDM-MIMO Channel Estimation
In this work, we experimentally and numerically compare cyclic shifted constant-amplitude zero-autocorrelation (CAZAC) training sequences (TS) with different number of repetitions, sequence lengths and scalings for channel estimation in an...
Semantic modeling of cell damage prediction: A machine learning approach at human-level performance in dermatology
In this work we investigate cell damage in whole slice images of the epidermis. A common way for pathologists to annotate a score, characterising the degree of damage for these samples, is the ratio between healthy and unhealthy nuclei. The...