Visiting Scientist at CERN · Leading SARL at PLUS

Simon Hirländer

Vice Director, IDA Lab · Head of Smart Analytics & Reinforcement Learning
Department of Artificial Intelligence and Human Interfaces · Paris Lodron University Salzburg

Theoretical Physicist and Decision Scientist bridging rigorous mathematical physics—including Hamiltonian mechanics, symplectic geometry, and potential theory—with modern Deep Reinforcement Learning. In 2018, I led the first Deep RL experiment on the CERN accelerator complex. Today, my research team develops safe, uncertainty-aware, and physics-informed AI systems for critical physical infrastructures and industrial processes.

Simon Hirländer
100+
Publications & Reports
1st
Deep RL at CERN Complex
€1.08M
Doctoral Program (KI-MINTFIT)
4
IPAC'26 Contributions

Core Research Pillars

Integrating physical invariants and control guarantees into modern decision-making architectures.

Reinforcement Learning Theory
Sample-efficient offline-to-online RL, Model-Based Policy Optimization (MBPO/MOPO), and Hamiltonian neural networks preserving symplectic phase-space invariants.
Explore Theory →
Autonomous Accelerators
Data-driven control and Bayesian optimization for the world's most complex machines: CERN LHC/SPS, AWAKE, DESY, KIT, and GSI/FAIR SIS18.
Explore Accelerators →
Industrial Systems & Energy
Physics-informed world models and predictive control for heavy industry, including roughing mill optimization (Danieli) and energy management (COPA-DATA FOCUS).
Explore Industrial AI →
Safe Control & GP-MPC
Gaussian Process Model Predictive Control (Causal GP-MPC), constrained exploration, and uncertainty quantification for safety-critical operations.
Explore Safe Control →

Recent News & Highlights

December 12, 2026

Invited Talk at NeurIPS 2026 Workshop (Paris)

Invited talk on "Koopman Stabilised Symplectic World Models for Safe Offline-to-Online RL in Particle Accelerators" at the NeurIPS 2026 Workshop RL for Experimental Sciences: Bridging the Simulation-to-Reality Gap in Paris.

Invited Talk NeurIPS 2026
2026

Podcast: S2 #17 | Reinforcement Learning in Business

Featured episode on DIH West's EASY cheesy DIGITAL exploring decision-making under uncertainty, agentic AI, and business transformation through Reinforcement Learning.

Spotify Podcast
June 2026

Four IPAC'26 Papers Accepted

Contributions on Koopman-stabilised world models, Causal GP-MPC, delayed-consequence RL beyond greedy optimization, and SIS18 injection optimization accepted for presentation.

IPAC'26 Peer Reviewed
2026

KI-MINTFIT Doctoral Program Launches (€1.08M)

Launch of the cooperative doctoral program funded by the Austrian BMBWF in collaboration with PH Salzburg, advancing AI-driven STEM subject instruction and student models.

€1.08M BMBWF Doctoral Program
View All News & Archive →

Real-World Impact & Results

Demonstrated breakthroughs across extreme, high-dimensional experimental environments.

Particle Accelerators
SIS18 Beam Losses: 45% → 15%

Reduced beam losses at the GSI/FAIR SIS18 heavy-ion synchrotron by 67% using multi-objective Bayesian optimization and Gaussian Process MPC.

Pioneering Experiment
1st Deep RL at CERN Complex

Conducted the pioneering autonomous beam alignment experiment on the CERN Super Proton Synchrotron (SPS) and AWAKE lines, establishing international baselines.

Industrial Automation
Heavy Steel Roughing Mill (R² > 0.93)

Trained Stable Koopman State-Space Models on 58M+ operational industrial time-series points with Danieli Automation, achieving high-accuracy torque and tension prediction.

Institutional Partners & Collaborators

Paris Lodron University Salzburg CERN Accelerators GSI Helmholtzzentrum / FAIR COPA-DATA Danieli Automation B&R Industrial Automation (ABB) DIH West PH Salzburg Montanuniversität Leoben

Interested in Research Collaboration or Theses?

We regularly supervise motivated MSc and PhD students and collaborate with industrial partners and research labs on reinforcement learning and autonomous systems.

Get in Touch Meet the SARL Team