Research
My research focuses on Reinforcement Learning (RL) and its application to complex, real-world systems. I lead the Smart Analytics & Reinforcement Learning (SARL) team, bridging the gap between theoretical advancements and industrial applications.
Core Research Areas
Learning from limited data for physical systems
Constrained optimization for critical infrastructure
Optimization of manufacturing & energy systems
AI for particle accelerators (CERN, DESY, etc.)
Current Projects
Forecasting and optimization under constraints and uncertainty for sustainable industrial energy systems
Principal Investigator. Contract research project in collaboration with Ing. Punzenberger COPA-DATA GmbH. Developing advanced RL and optimization methods for managing industrial energy systems under uncertainty.
Principal Investigator Energy Industrial AIIntelligent Novel Support for Personalized Instruction and Robust Evaluation in STEM Lessons
Principal Investigator (PLUS partner). Application-oriented basic research project funded by Land Salzburg (WISS2030) in collaboration with PH Salzburg. Focusing on AI-driven personalized learning and evaluation in primary education.
Principal Investigator Education AI for GoodDeep Reinforcement Learning for Large and Complex Systems
International collaboration with University of Malta and CERN. Focusing on solving complex control problems for the Large Hadron Collider (LHC). Methodologies are transferable to autonomous driving and manufacturing.
CERN LHC Control TheoryReinforcement Learning in Piezo Drivers
Research collaboration with W&H Dentalwerk Bürmoos GmbH. Developing adaptive controllers for piezoelectric drivers using RL to maintain cutting efficiency while minimizing heat generation.
Medical Control Theory PiezoData Science STIWA II
Research project with STIWA Group. Focusing on assembly line optimization using Hierarchical Reinforcement Learning to manage complex, multi-stage decisions in high-speed manufacturing.
Manufacturing Hierarchical RL OptimizationReinforcement Learning in Nautical Robotics
Expansion into maritime systems. Transferring control theory expertise to autonomous boats and submersibles, leveraging similarities between fluid dynamics and beam physics.
Robotics Maritime Control TheoryCompleted Projects
Danieli X – PLUS
Research collaboration with Danieli Automation focusing on applied research in steel automation.
Steel IndustryDEOP 2.5
Dynamische Energieoptimierung. Applied research project with COPA-DATA GmbH focusing on dynamic energy optimization.
EnergyUNSAD
Unsupervised Anomaly Detection in Sterilisation Devices. Research collaboration with W&H Dentalwerk Bürmoos GmbH.
Medical Anomaly DetectionAREP
Automatische Rechnungsprüfung. Applied research project with JUIX GmbH focusing on automated invoice auditing.
FinTechMuMa II & III
Mustererkennung Maschinendaten. Research collaborations with Palfinger AG on pattern recognition in machine data.
ManufacturingRedlink
Research co-operation with Redlink GmbH exploring the intersection of Neuro-Symbolic AI and Knowledge Graphs.
Neuro-Symbolic AI Knowledge GraphsCollaborations
I actively collaborate with leading research institutions and industry partners: