Research

My research focuses on Reinforcement Learning (RL) and its application to complex, real-world systems. I lead the Smart Analytics & Reinforcement Learning (SARL) team, bridging the gap between theoretical advancements and industrial applications.


Core Research Areas

Sample-Efficient RL
Learning from limited data for physical systems
Safe RL
Constrained optimization for critical infrastructure
Industrial Control
Optimization of manufacturing & energy systems
Accelerator Physics
AI for particle accelerators (CERN, DESY, etc.)

Current Projects

FOCUS 2025 - 2028

Forecasting and optimization under constraints and uncertainty for sustainable industrial energy systems

Principal Investigator. Contract research project in collaboration with Ing. Punzenberger COPA-DATA GmbH. Developing advanced RL and optimization methods for managing industrial energy systems under uncertainty.

Principal Investigator Energy Industrial AI
INSPIRE 2026 - 2029

Intelligent Novel Support for Personalized Instruction and Robust Evaluation in STEM Lessons

Principal Investigator (PLUS partner). Application-oriented basic research project funded by Land Salzburg (WISS2030) in collaboration with PH Salzburg. Focusing on AI-driven personalized learning and evaluation in primary education.

Principal Investigator Education AI for Good
DeepREL Ongoing

Deep Reinforcement Learning for Large and Complex Systems

International collaboration with University of Malta and CERN. Focusing on solving complex control problems for the Large Hadron Collider (LHC). Methodologies are transferable to autonomous driving and manufacturing.

CERN LHC Control Theory
RL-PD 2025 - 2026

Reinforcement Learning in Piezo Drivers

Research collaboration with W&H Dentalwerk Bürmoos GmbH. Developing adaptive controllers for piezoelectric drivers using RL to maintain cutting efficiency while minimizing heat generation.

Medical Control Theory Piezo
DS STIWA II 2025 - 2026

Data Science STIWA II

Research project with STIWA Group. Focusing on assembly line optimization using Hierarchical Reinforcement Learning to manage complex, multi-stage decisions in high-speed manufacturing.

Manufacturing Hierarchical RL Optimization
NauROM Ongoing

Reinforcement Learning in Nautical Robotics

Expansion into maritime systems. Transferring control theory expertise to autonomous boats and submersibles, leveraging similarities between fluid dynamics and beam physics.

Robotics Maritime Control Theory

Completed Projects

Danieli X – PLUS

Mar 2025 - Aug 2025

Research collaboration with Danieli Automation focusing on applied research in steel automation.

Steel Industry

DEOP 2.5

Feb 2025 - Aug 2025

Dynamische Energieoptimierung. Applied research project with COPA-DATA GmbH focusing on dynamic energy optimization.

Energy

UNSAD

Sep 2023 - May 2024

Unsupervised Anomaly Detection in Sterilisation Devices. Research collaboration with W&H Dentalwerk Bürmoos GmbH.

Medical Anomaly Detection

AREP

Sep 2022 - May 2023

Automatische Rechnungsprüfung. Applied research project with JUIX GmbH focusing on automated invoice auditing.

FinTech

MuMa II & III

Mar 2022 - May 2022

Mustererkennung Maschinendaten. Research collaborations with Palfinger AG on pattern recognition in machine data.

Manufacturing

Redlink

May 2024 - July 2024

Research co-operation with Redlink GmbH exploring the intersection of Neuro-Symbolic AI and Knowledge Graphs.

Neuro-Symbolic AI Knowledge Graphs

Collaborations

I actively collaborate with leading research institutions and industry partners:

CERN DESY KIT SLAC GSI DLR COPA-DATA Palfinger Danieli W&H