Publications & Dissemination

2026

• Koopman Stabilised Symplectic World Models for Safe Offline-to-Online RL in Particle Accelerators
  NeurIPS 2026 Workshop on Reinforcement Learning for Experimental Sciences (Invited Talk), Paris, 2026
  S. Hirlaender, O. Mironova, S. Trausner, K. M. Björkbom, B. Halilovic, A. Santamaria Garcia, L. Fischl, L. Grech, T. Gallien, S. Appel, N. Madysa, V. Kain, P. Auer, R. Ortner
  Show Details

  Invited talk at the NeurIPS 2026 Workshop "RL for Experimental Sciences: Bridging the Simulation-to-Reality Gap" (Paris, 12 December 2026). Addresses safe policy learning from archived beam data using Koopman-stabilised symplectic world models (S²K-MOPO), spectral stability guarantees, and physical structure certification.

• S2 #17 | Wie Reinforcement Learning Unternehmen verändert | Universität Salzburg (Podcast)
  DIH West / EASY cheesy DIGITAL, S2 #17, 2026
  S. Hirlaender, R. Grimm
  Show Details

  Interview with Simon Hirländer about Reinforcement Learning, decision making under uncertainty, and business transformation. Listen on Spotify | DIH West.

• Reinforcement Learning Beyond Greedy Optimisation for Delayed-Consequence Accelerator Control
  IPAC'26 (Accepted), 2026
  S. Hirlaender, K. M. Björkbom, S. Trausner, O. Mironova, L. Fischl, P. Auer, R. Ortner, V. Kain
• Structural Imbalances in Open-Access Critical Care Research: A Bibliometric Analysis of ICU Databases from 2018–2025
  Critical Care (Submitted), 2026
  A. Deribe, A. Koköfer, G. Zimmermann, S. Hirländer, B. Wernly, R. Rezar, C. Cozowicz, C. Jung, P. Rockenschaub, J. van den Brand, M. Beil, P. Elbers, O. Kimberger, M. van Genderen, N. Rodemund
• Anticipatory Reinforcement Learning for Trajectory Tracking
  DEXA AI4IP (Accepted / Springer CCIS), 2026
  G. Schäfer, J. Rehrl, S. Huber, S. Hirlaender
• Reinforcement Learning for Optimal Experiment Design in Parameter Identification of Mechatronic Systems
  DEXA AI4IP (Accepted / Springer CCIS), 2026 / arXiv:2606.00059
  J. Langschwert, G. Schäfer, J. Rehrl, S. Huber, S. Hirländer
• Safe Reinforcement Learning using Ideas from Model Predictive Control
  EUROCAST 2026 (Accepted / Springer LNCS), 2026
  G. Schäfer, S. Huber, J. Rehrl, S. Hirlaender
• Sample-Efficient Pareto Front Modeling for Energy-Aware Reinforcement Learning Using Bayesian Optimization
  EUROCAST 2026 (Accepted / Springer LNCS), 2026
  G. Schäfer, S. Huber, J. Rehrl, S. Hirlaender
• Robust Real-Time Optimization of SIS18 Injection using Gaussian Process MPC
  IPAC'26 (Accepted / LPR Volume) / RL4AA'26, 2026
  S. Hirlaender, S. Appel, B. Halilovic
• Automating accelerator tuning at GSI/FAIR
  EPJ Research Infrastructures (Resubmitted), 2026
  S. Appel, H. Alsmeier, M. Bajzek, O. Boine-Frankenheim, L. Dingeldein, R. Findeisen, B. Halilovic, S. Hirlaender, S. Hirt, D. Kallendorf, E. Kazantseva, O. Kazinova, M. Kraeft, E. Lenz, P. Madysa, A. Obertelli, M. Pfefferkorn, S. Pietri, C. Reinwald, M. Schlaich, S. Sorge, H. Weick
• Causal GP-MPC: Where Structure, Safety, and Online Learning Meet for Robust Accelerator Control
  IPAC'26 (Accepted / LPR Volume) / RL4AA'26, 2026
  S. Hirlaender, O. Mironova, L. Grech, L. Fischl, T. Gallien, S. Trausner
• Koopman-Stabilised World Models for Offline Reinforcement Learning in Accelerator Control
  IPAC'26 (Accepted / LPR Volume), 2026
  S. Hirlaender, O. Mironova, A. Santamaria Garcia, L. Fischl, S. Trausner
• AI for Particle Accelerators: Physics, Technologies and User Communities
  EPJ Research Infrastructures (In Preparation), 2026
  ARTIFACT Consortium (including S. Hirlaender)
• Binary Trigger Signals for Deep RL in Equity Trading
  RL4AA'26, 2026
  J. M. Montoya Bayardo, C. Borgelt, S. Hirlaender
• LUMEN Engine Control using Curriculum-Guided PPO
  RL4AA'26 (Poster), 2026
  F. Matanza, V. Bareiss, J. Dauer, K. Dresia, G. Waxenegger-Wilfing, S. Hirlaender
• Reliable Control via Contextual MPC and Approximate Dynamic Programming
  RL4AA'26, 2026
  S. Hirlaender, S. Trausner
• Multi-Agent RL for Resource Allocation in Wireless Networks
  RL4AA'26, 2026
  S. Hirlaender, S. Pochaba, P. Dorfinger, R. Kwitt
• Improving Trajectory Tracking by Augmenting States with Future Targets
  RL4AA'26, 2026
  G. Schäfer, J. Rehrl, S. Huber, S. Hirlaender
• Introduction to Deep RL Agents
  RL4AA'26 (Invited Lecture), 2026
  S. Hirlaender
  Show Details

  Invited advanced lecture at the 4th Collaboration Workshop on Reinforcement Learning for Autonomous Accelerators (RL4AA'26), University of Liverpool. Watch on YouTube.

2025

• The Crucial Role of Problem Formulation in Real-World Reinforcement Learning
  IEEE International Conference on Industrial Cyber-Physical Systems (ICPS), 2025
  G. Schäfer, T. Krau, J. Rehrl, S. Huber, S. Hirlaender
  Show Details (Citations: 3)

  Citations: 3

  Abstract not available in this view.

• Multi-objective reinforcement learning for energy-efficient industrial control
  International Conference on Database and Expert Systems Applications, 67-72, 2025
  G. Schäfer, R. Seliger, J. Rehrl, S. Huber, S. Hirlaender
  Show Details (Citations: 2)

  Citations: 2

  Abstract not available in this view.

• Efficient data-driven model predictive control for online accelerator tuning
  Proceedings of the 16th International Particle Accelerator Conference …, 2025
  C. Xu, A. Santamaria Garcia, J. Kaiser, C. Hespe, A. Eichler, B. Rodriguez Mateos, S. Hirlaender
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Achieving fast and robust perfect entangling gates via reinforcement learning
  Quantum Science and Technology 11 (1), 015030, 2025
  L. Grech, M. G. Krauss, M. Consiglio, T. J. G. Apollaro, C. P. Koch, S. Hirlaender, G. Valentino
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

2024

• Towards few-shot reinforcement learning in particle accelerator control
  15th International Particle Accelerator Conference, 2024
  Show Details (Citations: 10)

  Citations: 10

  Abstract not available in this view.

• The reinforcement learning for autonomous accelerators collaboration
  JACoW, TUPS62, 2024
  Show Details (Citations: 5)

  Citations: 5

  Abstract not available in this view.

• Python-based reinforcement learning on simulink models
  International Conference on Soft Methods in Probability and Statistics, 449-456, 2024
  Show Details (Citations: 5)

  Citations: 5

  Abstract not available in this view.

• Deep Meta Reinforcement Learning for Rapid Adaptation In Linear Markov Decision Processes: Applications to CERN’s AWAKE Project
  International Conference on Soft Methods in Probability and Statistics, 175-183, 2024
  Show Details (Citations: 5)

  Citations: 5

  Abstract not available in this view.

• Exploring the Dynamics of Reinforcement Learning in Aerospace Control
  RL4AA Salzburg, 2024
  Show Details (Citations: 3)

  Citations: 3

  Abstract not available in this view.

• DATA-DRIVEN MODEL PREDICTIVE CONTROL FOR AUTOMATED OPTIMIZATION OF INJECTION INTO THE SIS18 SYNCHROTRON: DATA-DRIVEN MODEL PREDICTIVE CONTROL FOR AUTOMATED OPTIMIZATION OF …
  15th International Particle Accelerator Conference: 15th International …, 2024
  Show Details (Citations: 3)

  Citations: 3

  Abstract not available in this view.

• Data-driven model predictive control for automated optimization of injection into the SIS18 synchrotron
  15th International Particle Accelerator Conference, 2024
  Show Details (Citations: 3)

  Citations: 3

  Abstract not available in this view.

• Comparison of Model Predictive Control and Proximal Policy Optimization for a 1-DOF Helicopter System
  2024 IEEE 22nd International Conference on Industrial Informatics (INDIN), 1-7, 2024
  Show Details (Citations: 3)

  Citations: 3

  Abstract not available in this view.

• Tutorial on Meta-Reinforcement Learning and GP-MPC at the RL4AA'24 Workshop
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• Continuous data-driven control of the GTS-LHC ion source at CERN
  Proc. eCRIS 24, 1, 2024
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• Tutorial on Meta-Reinforcement Learning and GP-MPC at the RL4AA'24 Workshop: Tutorial on Meta-Reinforcement Learning and GP-MPC at the RL4AA'24 Workshop
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• TOWARDS FEW-SHOT REINFORCEMENT LEARNING IN PARTICLE ACCELERATOR CONTROL: TOWARDS FEW-SHOT REINFORCEMENT LEARNING IN PARTICLE ACCELERATOR CONTROL
  15th International Particle Accelerator Conference: 15th International …, 2024
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• The Reinforcement Learning for Autonomous Accelerators Collaboration: The Reinforcement Learning for Autonomous Accelerators Collaboration
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Ph. D. Forum: Multi-Agent Reinforcement Learning in Wireless Network Communication
  2024 IEEE 25th International Symposium on a World of Wireless, Mobile and …, 2024
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Multi-Agent Reinforcement Learning in Wireless Network Communication
  Multi-Agent Reinforcement Learning in Wireless Network Communication, 2024
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Multi-agent Reinforcement Learning and Its Application to Wireless Network Communication
  International Conference on Soft Methods in Probability and Statistics, 363-370, 2024
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

2023

• Deep Q-learning versus proximal policy optimization: Performance comparison in a material sorting task
  2023 IEEE 32nd International Symposium on Industrial Electronics (ISIE), 1-6, 2023
  Show Details (Citations: 23)

  Citations: 23

  Abstract not available in this view.

• Ultra fast reinforcement learning in accelerator control demonstrated on CERN AWAKE
  IPAC'23, 4459–4462, 2023
  Show Details (Citations: 13)

  Citations: 13

  Abstract not available in this view.

• Towards automatic setup of 18 MeV electron beamline using machine learning
  Machine Learning: Science and Technology 4 (2), 025016, 2023
  Show Details (Citations: 10)

  Citations: 10

  Abstract not available in this view.

• Active deep learning for nonlinear optics design of a vertical FFA accelerator
  IPAC23: International particle accelerator conference, 2023
  Show Details (Citations: 3)

  Citations: 3

  Abstract not available in this view.

• A modular test bed for reinforcement learning incorporation into industrial applications
  International Data Science Conference, 99-101, 2023
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

2022

• Charge‐State Distributions of Highly Charged Lead Ions at Relativistic Collision Energies
  Annalen der Physik 534 (3), 2100245, 2022
  Show Details (Citations: 5)

  Citations: 5

  Abstract not available in this view.

• Application of reinforcement learning in the LHC tune feedback
  Frontiers in Physics 10, 929064, 2022
  Show Details (Citations: 5)

  Citations: 5

  Abstract not available in this view.

• Automatic setup of 18 MeV electron beamline using machine learning
  arXiv preprint arXiv:2209.03183, 2022
  Show Details (Citations: 3)

  Citations: 3

  Abstract not available in this view.

• Revisiting stylolites as a gage of overburden pressure-insights from fractal analysis
  EGU General Assembly Conference Abstracts, EGU22-9842, 2022
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Multi-Agent Reinforcement Learning for Coordination of Device-to-Device Communication
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• arXiv: Automatic setup of 18 MeV electron beamline using machine learning
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

2021

• Data Science—Analytics and Applications
  Springer Vieweg, 2021
  Show Details (Citations: 12)

  Citations: 12

  Abstract not available in this view.

• An online iterative linear quadratic approach for a satisfactory working point attainment at FERMI
  Information 12 (7), 262, 2021
  Show Details (Citations: 6)

  Citations: 6

  Abstract not available in this view.

• Test of Machine Learning at the CERN LINAC4
  JACoW Publishing, 2021
  Show Details (Citations: 4)

  Citations: 4

  Abstract not available in this view.

2020

• Sample-efficient reinforcement learning for CERN accelerator control
  Physical Review Accelerators and Beams 23 (12), 124801, 2020
  Show Details (Citations: 99)

  Citations: 99

  Abstract not available in this view.

• Online multi-objective particle accelerator optimization of the AWAKE electron beam line for simultaneous emittance and orbit control
  AIP Advances 10 (5), 2020
  Show Details (Citations: 37)

  Citations: 37

  Abstract not available in this view.

• Model-free and Bayesian ensembling model-based deep reinforcement learning for particle accelerator control demonstrated on the Fermi FEL
  arXiv preprint arXiv:2012.09737, 2020
  Show Details (Citations: 34)

  Citations: 34

  Abstract not available in this view.

• The gamma factory project at cern: A new generation of research tools made of light
  ACTA PHYSICA POLONICA B 13 (4), 645-652, 2020
  Show Details (Citations: 7)

  Citations: 7

  Abstract not available in this view.

• Charge state tailoring of relativistic heavy ion beams for the Gamma Factory project at CERN
  X‐Ray Spectrometry 49 (1), 25-28, 2020
  Show Details (Citations: 7)

  Citations: 7

  Abstract not available in this view.

• Gamma Factory for CERN initiative-progress report
  PoS, 020, 2020
  Show Details (Citations: 6)

  Citations: 6

  Abstract not available in this view.

• Exact solutions of indirect transverse field effects in elongated structures with applications to CERN LHC and PS
  Vienna, Tech. U., 2020
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Electron Beam Improvements in Preparation for AWAKE Run 2: Human and Machine Learning
  APS Division of Plasma Physics Meeting Abstracts 2020, BO03. 002, 2020
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• arXiv: Model-free and Bayesian Ensembling Model-based Deep Reinforcement Learning for Particle Accelerator Control Demonstrated on the FERMI FEL
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

2019

• First partially stripped ions in the LHC (208Pb81+)
  Journal of Physics: Conference Series 1350 (1), 012071, 2019
  Show Details (Citations: 35)

  Citations: 35

  Abstract not available in this view.

• Injectors beam performance evolution during run 2
  Show Details (Citations: 30)

  Citations: 30

  Abstract not available in this view.

• Gamma Factory at CERN--novel research tools made of light
  arXiv preprint arXiv:1903.09032, 2019
  Show Details (Citations: 26)

  Citations: 26

  Abstract not available in this view.

• Automatisation of the SPS ElectroStatic septa alignment
  10th Int. Particle Accelerator Conf.(IPAC’19), 4001-4004, 2019
  Show Details (Citations: 8)

  Citations: 8

  Abstract not available in this view.

• New paradigms for tuning accelerators: Automatic performance optimization and first steps towards reinforcement learning at the CERN Low Energy Ion Ring
  2nd ICFA Workshop on Machine Learning for Charged Particle, 2019
  Show Details (Citations: 6)

  Citations: 6

  Abstract not available in this view.

• MD3284: Partially Stripped Ions in the LHC
  Show Details (Citations: 4)

  Citations: 4

  Abstract not available in this view.

• Detailed characterisation of the LEIR intensity limitations for a Pb ion beam
  Journal of Physics: Conference Series 1350 (1), 012128, 2019
  Show Details (Citations: 4)

  Citations: 4

  Abstract not available in this view.

• Jacow: Automatisation of the sps electrostatic septa alignment
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• Energy Dependence of the Reproducibility and Injection Efficiency of the LINAC3-LEIR Complex
  10th Int. Particle Accelerator Conf.(IPAC'19), Melbourne, Australia, 19-24 …, 2019
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• JACoW: Energy dependence of the reproducibility and injection efficiency of the LINAC3-LEIR complex
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• JACoW: Detailed characterisation of the LEIR intensity limitations for a Pb ion beam
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Improvements to the SPS Slow Extraction for High Intensity Operation
  9th International Particle Accelerator Conference, 2019
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Gamma Factory Proof-of-Principle Experiment
  9th International Particle Accelerator Conference, 2019
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Gamma factory at CERN: design of a proof-of-principle experiment
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

2018

• Lifetime and Beam Losses Studies of Partially Strip Ions in the SPS (Xe)
  Show Details (Citations: 19)

  Citations: 19

  Abstract not available in this view.

• Space charge studies on LEIR
  Journal of Physics: Conference Series 1067 (6), 062020, 2018
  Show Details (Citations: 15)

  Citations: 15

  Abstract not available in this view.

• Observations of SPS slow-extracted spill quality degradation and possible improvements
  Proc. IPAC’18, 2018
  Show Details (Citations: 8)

  Citations: 8

  Abstract not available in this view.

• Electron cooling simulation and experimental benchmarks at LEIR
  Proceddings of 9th International Particle Accelerator Conference, Vancouver …, 2018
  Show Details (Citations: 2)

  Citations: 2

  Abstract not available in this view.

• Studies of the Injection and Cooling Efficiency in LEIR Using the Longitudinal Schottky Spectrum
  9th Int. Particle Accelerator Conf.(IPAC'18), Vancouver, BC, Canada, April …, 2018
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• Performance of the CERN low energy ion ring (LEIR) with Xenon beams
  9th International Particle Accelerator Conference, 2018
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• LEIR Injection Efficiency Studies as a Function of the Beam Energy Distribution from Linac3
  9th Int. Particle Accelerator Conf.(IPAC'18), Vancouver, BC, Canada, April …, 2018
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• Impedance and instability studies in LEIR with xenon
  Proceedings of IPAC18, 720-723, 2018
  Show Details (Citations: 1)

  Citations: 1

  Abstract not available in this view.

• The CERN Gamma Factory Initiative: An Ultra-High Intensity Gamma Source
  9th International Particle Accelerator Conference, 2018
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• Review of LEIR operation in 2018
  CERN Report, 2018
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• JACoW: Studies of the Injection and Cooling Efficiency in LEIR Using the Longitudinal Schottky Spectrum
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• JACoW: Performance of the CERN Low Energy Ion Ring (LEIR) with Xenon beams
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• JACoW: Observations of SPS Slow-Extracted Spill Quality Degradation and Possible Improvements
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• JACoW: LEIR Injection Efficiency Studies as a Function of the Beam Energy Distribution from Linac3
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• JACoW: Impedance and Instability Studies in LEIR with Xenon
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• JACoW: Electron Cooling Simulation and Experimental Benchmarks at LEIR
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

2017

• Numerical investigation of space charge effects on the positions of beamlets for transversely split beams
  Physical Review Accelerators and Beams 20 (12), 121001, 2017
  Show Details (Citations: 14)

  Citations: 14

  Abstract not available in this view.

2016

• Space charge effects and advanced modelling for CERN low energy machines
  CERN, 2016
  Show Details (Citations: 19)

  Citations: 19

  Abstract not available in this view.

• Intensity effects in the formation of stable islands in phase space during the multi-turn extraction process at the CERN PS
  57th ICFA Advanced Beam Dynamics Workshop on High-Intensity and High …, 2016
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

Unknown Year

• Machine learning and automated optimisation
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.

• AUTOMATION OF GSI KEY BEAM MANIPULATIONS WITH AI METHODS
  Show Details (Citations: 0)

  Citations: 0

  Abstract not available in this view.