Publications

It is likely that my Google Scholar or Semantic Scholar profile is more accurate and up-to-date:

2026

  • S2 #17 | Wie Reinforcement Learning Unternehmen verändert | Universität Salzburg (Podcast)
    DIH West / EASY cheesy DIGITAL, S2 #17, 2026
    S. Hirlaender, R. Grimm
    Show Details

    Interview with Simon Hirländer about Reinforcement Learning, decision making under uncertainty, and business transformation. Listen on Spotify | DIH West.

  • Reinforcement Learning Beyond Greedy Optimisation for Delayed-Consequence Accelerator Control
    IPAC'26 (Submitted), 2026
    K. M. Björkbom, S. Hirlaender, S. Trausner, O. Mironova, L. Fischl, P. Auer, R. Ortner, V. Kain
  • Robust Real-Time Optimization of SIS18 Injection using Gaussian Process MPC
    IPAC'26 (Submitted) / RL4AA'26, 2026
    S. Hirlaender, S. Appel, B. Halilovic
  • Causal GP-MPC: Where Structure, Safety, and Online Learning Meet
    IPAC'26 (Submitted) / RL4AA'26, 2026
    O. Mironova, S. Hirlaender
  • Koopman-Stabilised World Models for Offline Reinforcement Learning
    IPAC'26 (Submitted), 2026
    S. Hirlaender, O. Mironova, A. Santamaria Garcia
  • Binary Trigger Signals for Deep RL in Equity Trading
    RL4AA'26, 2026
    J. M. Montoya Bayardo, C. Borgelt, S. Hirlaender
  • Curriculum-Guided PPO for LUMEN Engine
    RL4AA'26, 2026
    F. Matanza, S. Hirlaender

2025

  • Achieving fast and robust perfect entangling gates via reinforcement learning
    Quantum Science and Technology 11 (1), 015030, 2025
    L. Grech, M. G. Krauss, M. Consiglio, T. J. G. Apollaro, C. P. Koch, S. Hirlaender, G. Valentino
  • The Crucial Role of Problem Formulation in Real-World Reinforcement Learning
    Journal of Machine Learning Research (Submitted), 2025
    G. Schäfer, T. Krau, J. Rehrl, S. Huber, S. Hirlaender
  • Multi-objective reinforcement learning for energy-efficient industrial control
    DEXA 2025, 67-72, 2025
    G. Schäfer, R. Seliger, J. Rehrl, S. Huber, S. Hirlaender
  • Efficient data-driven model predictive control for online accelerator tuning
    IPAC'25, 2025
    C. Xu, A. Santamaria Garcia, J. Kaiser, C. Hespe, A. Eichler, B. Rodriguez Mateos, S. Hirlaender

2024

  • Towards few-shot reinforcement learning in particle accelerator control
    15th International Particle Accelerator Conference, 2024
    S. Hirlaender, L. Lamminger, S. Pochaba, A. Santamaria Garcia, C. Xu, L. Scomparin, J. Kaiser, V. Kain
  • The Reinforcement Learning for Autonomous Accelerators Collaboration
    JACoW, TUPS62, 2024
    A. Santamaria Garcia, C. Xu, L. Scomparin, A. Eichler, J. Kaiser, M. Schenk, S. Pochaba, S. Hirlaender
  • Python-based reinforcement learning on simulink models
    International Conference on Soft Methods in Probability and Statistics, 449-456, 2024
    G. Schaefer, M. Schirl, J. Rehrl, S. Huber, S. Hirlaender
  • Deep Meta Reinforcement Learning for Rapid Adaptation In Linear Markov Decision Processes: Applications to CERN’s AWAKE Project
    International Conference on Soft Methods in Probability and Statistics, 175-183, 2024
    S. Hirlaender, S. Pochaba, L. Lamminger, A. Santamaria Garcia, C. Xu, J. Kaiser, A. Eichler, V. Kain
  • Exploring the Dynamics of Reinforcement Learning in Aerospace Control
    RL4AA Salzburg, 2024
    G. Schäfer, J. Rehrl, S. Huber, S. Hirlaender
  • Data-driven model predictive control for automated optimization of injection into the SIS18 synchrotron
    15th International Particle Accelerator Conference, 2024
    S. Hirlaender, S. Appel, N. Madysa
  • Comparison of Model Predictive Control and Proximal Policy Optimization for a 1-DOF Helicopter System
    2024 IEEE 22nd International Conference on Industrial Informatics (INDIN), 1-7, 2024
    G. Schäfer, J. Rehrl, S. Huber, S. Hirlaender
  • Tutorial on Meta-Reinforcement Learning and GP-MPC at the RL4AA'24 Workshop
    RL4AA'24, 2024
    S. Hirlaender, A. Santamaria Garcia, C. Xu, J. Kaiser, S. Pochaba
  • Continuous data-driven control of the GTS-LHC ion source at CERN
    Proc. eCRIS 24, 1, 2024
    V. Kain, B. Rodriguez Mateos, N. Bruchon, D. Küchler, S. Hirlaender, M. Schenk
  • Multi-Agent Reinforcement Learning in Wireless Network Communication
    IEEE WoWMoM 2024 / SMPS 2024, 2024
    S. Pochaba, P. Dorfinger, M. Herlich, R. Kwitt, S. Hirlaender

2023

  • Deep Q-learning versus proximal policy optimization: Performance comparison in a material sorting task
    2023 IEEE 32nd International Symposium on Industrial Electronics (ISIE), 1-6, 2023
    Show Details (Citations: 23)

    Citations: 23

    Abstract not available in this view.

  • Ultra fast reinforcement learning in accelerator control demonstrated on CERN AWAKE
    IPAC'23, 4459–4462, 2023
    Show Details (Citations: 13)

    Citations: 13

    Abstract not available in this view.

  • Towards automatic setup of 18 MeV electron beamline using machine learning
    Machine Learning: Science and Technology 4 (2), 025016, 2023
    Show Details (Citations: 10)

    Citations: 10

    Abstract not available in this view.

  • Active deep learning for nonlinear optics design of a vertical FFA accelerator
    IPAC23: International particle accelerator conference, 2023
    Show Details (Citations: 3)

    Citations: 3

    Abstract not available in this view.

  • A modular test bed for reinforcement learning incorporation into industrial applications
    International Data Science Conference, 99-101, 2023
    Show Details (Citations: 1)

    Citations: 1

    Abstract not available in this view.

2022

  • Charge‐State Distributions of Highly Charged Lead Ions at Relativistic Collision Energies
    Annalen der Physik 534 (3), 2100245, 2022
    Show Details (Citations: 5)

    Citations: 5

    Abstract not available in this view.

  • Application of reinforcement learning in the LHC tune feedback
    Frontiers in Physics 10, 929064, 2022
    Show Details (Citations: 5)

    Citations: 5

    Abstract not available in this view.

  • Automatic setup of 18 MeV electron beamline using machine learning
    arXiv preprint arXiv:2209.03183, 2022
    Show Details (Citations: 3)

    Citations: 3

    Abstract not available in this view.

  • Revisiting stylolites as a gage of overburden pressure-insights from fractal analysis
    EGU General Assembly Conference Abstracts, EGU22-9842, 2022
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • Multi-Agent Reinforcement Learning for Coordination of Device-to-Device Communication
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • arXiv: Automatic setup of 18 MeV electron beamline using machine learning
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

2021

  • Data Science—Analytics and Applications
    Springer Vieweg, 2021
    Show Details (Citations: 12)

    Citations: 12

    Abstract not available in this view.

  • An online iterative linear quadratic approach for a satisfactory working point attainment at FERMI
    Information 12 (7), 262, 2021
    Show Details (Citations: 6)

    Citations: 6

    Abstract not available in this view.

  • Test of Machine Learning at the CERN LINAC4
    JACoW Publishing, 2021
    Show Details (Citations: 4)

    Citations: 4

    Abstract not available in this view.

2020

  • Sample-efficient reinforcement learning for CERN accelerator control
    Physical Review Accelerators and Beams 23 (12), 124801, 2020
    Show Details (Citations: 99)

    Citations: 99

    Abstract not available in this view.

  • Online multi-objective particle accelerator optimization of the AWAKE electron beam line for simultaneous emittance and orbit control
    AIP Advances 10 (5), 2020
    Show Details (Citations: 37)

    Citations: 37

    Abstract not available in this view.

  • Model-free and Bayesian ensembling model-based deep reinforcement learning for particle accelerator control demonstrated on the Fermi FEL
    arXiv preprint arXiv:2012.09737, 2020
    Show Details (Citations: 34)

    Citations: 34

    Abstract not available in this view.

  • The gamma factory project at cern: A new generation of research tools made of light
    ACTA PHYSICA POLONICA B 13 (4), 645-652, 2020
    Show Details (Citations: 7)

    Citations: 7

    Abstract not available in this view.

  • Charge state tailoring of relativistic heavy ion beams for the Gamma Factory project at CERN
    X‐Ray Spectrometry 49 (1), 25-28, 2020
    Show Details (Citations: 7)

    Citations: 7

    Abstract not available in this view.

  • Gamma Factory for CERN initiative-progress report
    PoS, 020, 2020
    Show Details (Citations: 6)

    Citations: 6

    Abstract not available in this view.

  • Exact solutions of indirect transverse field effects in elongated structures with applications to CERN LHC and PS
    Vienna, Tech. U., 2020
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • Electron Beam Improvements in Preparation for AWAKE Run 2: Human and Machine Learning
    APS Division of Plasma Physics Meeting Abstracts 2020, BO03. 002, 2020
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • arXiv: Model-free and Bayesian Ensembling Model-based Deep Reinforcement Learning for Particle Accelerator Control Demonstrated on the FERMI FEL
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

2019

  • First partially stripped ions in the LHC (208Pb81+)
    Journal of Physics: Conference Series 1350 (1), 012071, 2019
    Show Details (Citations: 35)

    Citations: 35

    Abstract not available in this view.

  • Injectors beam performance evolution during run 2
    Show Details (Citations: 30)

    Citations: 30

    Abstract not available in this view.

  • Gamma Factory at CERN--novel research tools made of light
    arXiv preprint arXiv:1903.09032, 2019
    Show Details (Citations: 26)

    Citations: 26

    Abstract not available in this view.

  • Automatisation of the SPS ElectroStatic septa alignment
    10th Int. Particle Accelerator Conf.(IPAC’19), 4001-4004, 2019
    Show Details (Citations: 8)

    Citations: 8

    Abstract not available in this view.

  • New paradigms for tuning accelerators: Automatic performance optimization and first steps towards reinforcement learning at the CERN Low Energy Ion Ring
    2nd ICFA Workshop on Machine Learning for Charged Particle, 2019
    Show Details (Citations: 6)

    Citations: 6

    Abstract not available in this view.

  • MD3284: Partially Stripped Ions in the LHC
    Show Details (Citations: 4)

    Citations: 4

    Abstract not available in this view.

  • Detailed characterisation of the LEIR intensity limitations for a Pb ion beam
    Journal of Physics: Conference Series 1350 (1), 012128, 2019
    Show Details (Citations: 4)

    Citations: 4

    Abstract not available in this view.

  • Jacow: Automatisation of the sps electrostatic septa alignment
    Show Details (Citations: 1)

    Citations: 1

    Abstract not available in this view.

  • Energy Dependence of the Reproducibility and Injection Efficiency of the LINAC3-LEIR Complex
    10th Int. Particle Accelerator Conf.(IPAC'19), Melbourne, Australia, 19-24 …, 2019
    Show Details (Citations: 1)

    Citations: 1

    Abstract not available in this view.

  • JACoW: Energy dependence of the reproducibility and injection efficiency of the LINAC3-LEIR complex
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • JACoW: Detailed characterisation of the LEIR intensity limitations for a Pb ion beam
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • Improvements to the SPS Slow Extraction for High Intensity Operation
    9th International Particle Accelerator Conference, 2019
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • Gamma Factory Proof-of-Principle Experiment
    9th International Particle Accelerator Conference, 2019
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • Gamma factory at CERN: design of a proof-of-principle experiment
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

2018

  • Lifetime and Beam Losses Studies of Partially Strip Ions in the SPS (Xe)
    Show Details (Citations: 19)

    Citations: 19

    Abstract not available in this view.

  • Space charge studies on LEIR
    Journal of Physics: Conference Series 1067 (6), 062020, 2018
    Show Details (Citations: 15)

    Citations: 15

    Abstract not available in this view.

  • Observations of SPS slow-extracted spill quality degradation and possible improvements
    Proc. IPAC’18, 2018
    Show Details (Citations: 8)

    Citations: 8

    Abstract not available in this view.

  • Electron cooling simulation and experimental benchmarks at LEIR
    Proceddings of 9th International Particle Accelerator Conference, Vancouver …, 2018
    Show Details (Citations: 2)

    Citations: 2

    Abstract not available in this view.

  • Studies of the Injection and Cooling Efficiency in LEIR Using the Longitudinal Schottky Spectrum
    9th Int. Particle Accelerator Conf.(IPAC'18), Vancouver, BC, Canada, April …, 2018
    Show Details (Citations: 1)

    Citations: 1

    Abstract not available in this view.

  • Performance of the CERN low energy ion ring (LEIR) with Xenon beams
    9th International Particle Accelerator Conference, 2018
    Show Details (Citations: 1)

    Citations: 1

    Abstract not available in this view.

  • LEIR Injection Efficiency Studies as a Function of the Beam Energy Distribution from Linac3
    9th Int. Particle Accelerator Conf.(IPAC'18), Vancouver, BC, Canada, April …, 2018
    Show Details (Citations: 1)

    Citations: 1

    Abstract not available in this view.

  • Impedance and instability studies in LEIR with xenon
    Proceedings of IPAC18, 720-723, 2018
    Show Details (Citations: 1)

    Citations: 1

    Abstract not available in this view.

  • The CERN Gamma Factory Initiative: An Ultra-High Intensity Gamma Source
    9th International Particle Accelerator Conference, 2018
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • Review of LEIR operation in 2018
    CERN Report, 2018
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • JACoW: Studies of the Injection and Cooling Efficiency in LEIR Using the Longitudinal Schottky Spectrum
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • JACoW: Performance of the CERN Low Energy Ion Ring (LEIR) with Xenon beams
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • JACoW: Observations of SPS Slow-Extracted Spill Quality Degradation and Possible Improvements
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • JACoW: LEIR Injection Efficiency Studies as a Function of the Beam Energy Distribution from Linac3
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • JACoW: Impedance and Instability Studies in LEIR with Xenon
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • JACoW: Electron Cooling Simulation and Experimental Benchmarks at LEIR
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

2017

  • Numerical investigation of space charge effects on the positions of beamlets for transversely split beams
    Physical Review Accelerators and Beams 20 (12), 121001, 2017
    Show Details (Citations: 14)

    Citations: 14

    Abstract not available in this view.

2016

  • Space charge effects and advanced modelling for CERN low energy machines
    CERN, 2016
    Show Details (Citations: 19)

    Citations: 19

    Abstract not available in this view.

  • Intensity effects in the formation of stable islands in phase space during the multi-turn extraction process at the CERN PS
    57th ICFA Advanced Beam Dynamics Workshop on High-Intensity and High …, 2016
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

Unknown Year

  • Machine learning and automated optimisation
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.

  • AUTOMATION OF GSI KEY BEAM MANIPULATIONS WITH AI METHODS
    Show Details (Citations: 0)

    Citations: 0

    Abstract not available in this view.