Publications

XAI for Benchmarking Black-Box Metaheuristics

Published in Explainable AI for Evolutionary Computation, 2025

Use Google Scholar for full citation

Recommended citation: Anna Kononova, Diederick Vermetten, Niki Stein, "XAI for Benchmarking Black-Box Metaheuristics." Explainable AI for Evolutionary Computation, 2025.

TeVAE: a variational autoencoder aproach for discrete online anomaly detection in variable-state multivariate time-series data

Published in Studies in Computational Intelligence, 2025

Use Google Scholar for full citation

Recommended citation: L Ferreira, JC Goos, P Klein, THW B{\"a}ck, AV Kononova, N Stein, C Wagner, JM Garibaldi, F Marcelloni, HK Lam, "TeVAE: a variational autoencoder aproach for discrete online anomaly detection in variable-state multivariate time-series data." Studies in Computational Intelligence, 2025.

Structural bias in optimization algorithms

Published in Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2025

Use Google Scholar for full citation

Recommended citation: Anna Kononova, Niki Stein, "Structural bias in optimization algorithms." Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2025.

Stalling in Space: Attractor Analysis for any Algorithm

Published in International Conference on the Applications of Evolutionary Computation (Part of EvoStar), 2025

Use Google Scholar for full citation

Recommended citation: Sarah Thomson, Quentin Renau, Diederick Vermetten, Emma Hart, Niki Stein, Anna Kononova, "Stalling in Space: Attractor Analysis for any Algorithm." International Conference on the Applications of Evolutionary Computation (Part of EvoStar), 2025.

Neighborhood Adaptive Differential Evolution

Published in Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2025

Use Google Scholar for full citation

Recommended citation: Niki Stein, "Neighborhood Adaptive Differential Evolution." Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2025.

Controlling the mutation in large language models for the efficient evolution of algorithms

Published in International Conference on the Applications of Evolutionary Computation (Part of EvoStar), 2025

Use Google Scholar for full citation

Recommended citation: Haoran Yin, Anna Kononova, Thomas B{\"a}ck, Niki Stein, "Controlling the mutation in large language models for the efficient evolution of algorithms." International Conference on the Applications of Evolutionary Computation (Part of EvoStar), 2025.

Benchmarking that Matters: Rethinking Benchmarking for Practical Impact

Published in arXiv preprint arXiv:2511.12264, 2025

Use Google Scholar for full citation

Recommended citation: Anna Kononova, Niki Stein, Olaf Mersmann, Thomas B{\"a}ck, Thomas Bartz-Beielstein, Tobias Glasmachers, Michael Hellwig, Sebastian Krey, Jakub K{\uu}dela, Boris Naujoks, "Benchmarking that Matters: Rethinking Benchmarking for Practical Impact." arXiv preprint arXiv:2511.12264, 2025.

BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics

Published in Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2025

Use Google Scholar for full citation

Recommended citation: Niki Stein, Anna V., Haoran Yin, Thomas B{\"a}ck, "BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics." Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2025.

Agentic large language models, a survey

Published in arXiv preprint arXiv:2503.23037, 2025

Use Google Scholar for full citation

Recommended citation: Aske Plaat, Max Duijn, Niki Stein, Mike Preuss, Peter Putten, Kees Batenburg, "Agentic large language models, a survey." arXiv preprint arXiv:2503.23037, 2025.

Reasoning with large language models, a survey

Published in arXiv preprint arXiv:2407.11511, 2024

Use Google Scholar for full citation

Recommended citation: Aske Plaat, Annie Wong, Suzan Verberne, Joost Broekens, Niki Stein, Thomas Back, "Reasoning with large language models, a survey." arXiv preprint arXiv:2407.11511, 2024.

Landscape-aware automated algorithm configuration using multi-output mixed regression and classification

Published in International Conference on Parallel Problem Solving from Nature, 2024

Use Google Scholar for full citation

Recommended citation: Fu Long, Moritz Frenzel, Peter Krause, Markus Gitterle, Thomas B{\"a}ck, Niki Stein, "Landscape-aware automated algorithm configuration using multi-output mixed regression and classification." International Conference on Parallel Problem Solving from Nature, 2024.

Evolutionary computation and explainable AI: A roadmap to understandable intelligent systems

Published in IEEE Transactions on Evolutionary Computation, 2024

Use Google Scholar for full citation

Recommended citation: Ryan Zhou, Jaume Bacardit, Alexander Brownlee, Stefano Cagnoni, Martin Fyvie, Giovanni Iacca, John McCall, Niki Stein, David Walker, Ting Hu, "Evolutionary computation and explainable AI: A roadmap to understandable intelligent systems." IEEE Transactions on Evolutionary Computation, 2024.

Development of a photonic crystal spectrometer for greenhouse gas measurements

Published in arXiv preprint arXiv:2411.02056, 2024

Use Google Scholar for full citation

Recommended citation: Marijn Siemonsa, Martijn Veen, Irina Malysheva, Johannes Algera, Stefan Philippi, Kirill Antonov, Niki Stein, J{\'e}r{\^o}me Loicq, Nandini Bhattacharya, Ren{\'e} Berlich, "Development of a photonic crystal spectrometer for greenhouse gas measurements." arXiv preprint arXiv:2411.02056, 2024.

Beyond the veil of similarity: Quantifying semantic continuity in explainable AI

Published in World Conference on Explainable Artificial Intelligence, 2024

Use Google Scholar for full citation

Recommended citation: Qi Huang, Emanuele Mezzi, Osman Mutlu, Miltiadis Kofinas, Vidya Prasad, Shadnan Khan, Elena Ranguelova, Niki Stein, "Beyond the veil of similarity: Quantifying semantic continuity in explainable AI." World Conference on Explainable Artificial Intelligence, 2024.

Automated Federated Learning via Informed Pruning

Published in ArXiv, vol. abs/2405.10271, 2024

Use Google Scholar for full citation

Recommended citation: Christian Intern{\`o}, Elena Raponi, Niki Stein, Thomas B{\"a}ck, Markus Olhofer, Yaochu Jin, Barbara Hammer, "Automated Federated Learning via Informed Pruning." ArXiv, vol. abs/2405.10271, 2024.

Adaptive model pruning in federated learning through loss exploration

Published in 2nd Workshop on Advancing Neural Network Training: Computational Efficiency, Scalability, and Resource Optimization (WANT@ ICML 2024), 2024

Use Google Scholar for full citation

Recommended citation: Christian Interno, Elena Raponi, Niki Stein, Thomas B{\"a}ck, Markus Olhofer, Yaochu Jin, Barbara Hammer, "Adaptive model pruning in federated learning through loss exploration." 2nd Workshop on Advancing Neural Network Training: Computational Efficiency, Scalability, and Resource Optimization (WANT@ ICML 2024), 2024.

A functional analysis approach to symbolic regression

Published in Proceedings of the Genetic and Evolutionary Computation Conference, 2024

Use Google Scholar for full citation

Recommended citation: Kirill Antonov, Roman Kalkreuth, Kaifeng Yang, Thomas B{\"a}ck, Niki Stein, Anna Kononova, "A functional analysis approach to symbolic regression." Proceedings of the Genetic and Evolutionary Computation Conference, 2024.

A Functional Analysis Approach to Symbolic Regression

Published in Preprint on arXiv preprint arXiv:2402.06299, 2024

Use Google Scholar for full citation

Recommended citation: Kirill Antonov, Roman Kalkreuth, Kaifeng Yang, Thomas B{\"a}ck, Niki Stein, Anna Kononova, "A Functional Analysis Approach to Symbolic Regression." Preprint on arXiv preprint arXiv:2402.06299, 2024.

A Critical Analysis of Raven Roost Optimization

Published in Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2024

Use Google Scholar for full citation

Recommended citation: Martijn Halsema, Diederick Vermetten, Thomas B{\"a}ck, Niki Van, "A Critical Analysis of Raven Roost Optimization." Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2024.

Real-World Optimization Benchmark from Vehicle Dynamics: Specification of Problems in 2D and Methodology for Transferring (Meta-) Optimized Algorithm Parameters.

Published in IJCCI, 2023

Use Google Scholar for full citation

Recommended citation: Andr{\'e} Thomaser, Marc-Eric Vogt, Thomas B{\"a}ck, Anna Kononova, N Stein, F Marcelloni, HK Lam, M Cottrell, J Filipe, "Real-World Optimization Benchmark from Vehicle Dynamics: Specification of Problems in 2D and Methodology for Transferring (Meta-) Optimized Algorithm Parameters.." IJCCI, 2023.

BBOB Instance Analysis: Landscape Properties and Algorithm Performance Across Problem Instances

Published in International Conference on the Applications of Evolutionary Computation (Part of EvoStar), 2023

Use Google Scholar for full citation

Recommended citation: Fu Long, Diederick Vermetten, Bas Stein, Anna Kononova, "BBOB Instance Analysis: Landscape Properties and Algorithm Performance Across Problem Instances." International Conference on the Applications of Evolutionary Computation (Part of EvoStar), 2023.

Using structural bias to analyse the behaviour of modular CMA-ES

Published in Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2022

Use Google Scholar for full citation

Recommended citation: Diederick Vermetten, Fabio Caraffini, Bas Stein, Anna Kononova, "Using structural bias to analyse the behaviour of modular CMA-ES." Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2022.

Learning the characteristics of engineering optimization problems with applications in automotive crash

Published in Proceedings of the Genetic and Evolutionary Computation Conference, 2022

Use Google Scholar for full citation

Recommended citation: Fu Long, Bas Stein, Moritz Frenzel, Peter Krause, Markus Gitterle, Thomas B{\"a}ck, "Learning the characteristics of engineering optimization problems with applications in automotive crash." Proceedings of the Genetic and Evolutionary Computation Conference, 2022.

Samo-cobra: A fast surrogate assisted constrained multi-objective optimization algorithm

Published in Evolutionary Multi-Criterion Optimization: 11th International Conference, EMO 2021, Shenzhen, China, March 28--31, 2021, Proceedings 11, 2021

Use Google Scholar for full citation

Recommended citation: Roy Winter, Bas Stein, Thomas B{\"a}ck, "Samo-cobra: A fast surrogate assisted constrained multi-objective optimization algorithm." Evolutionary Multi-Criterion Optimization: 11th International Conference, EMO 2021, Shenzhen, China, March 28--31, 2021, Proceedings 11, 2021.

Optimally weighted ensembles for efficient multi-objective optimization

Published in International Conference on Machine Learning, Optimization, and Data Science. Springer, 2021

Use Google Scholar for full citation

Recommended citation: Gideon Hanse, Roy Winter, Bas Stein, Thomas B{\"a}ck, "Optimally weighted ensembles for efficient multi-objective optimization." International Conference on Machine Learning, Optimization, and Data Science. Springer, 2021.

Exploiting generative models for performance predictions of 3D car designs

Published in 2021 IEEE Symposium Series on Computational Intelligence (SSCI), 2021

Use Google Scholar for full citation

Recommended citation: Sneha Saha, Thiago Rios, Leandro Minku, Bas Stein, Patricia Wollstadt, Xin Yao, Thomas Back, Bernhard Sendhoff, Stefan Menzel, "Exploiting generative models for performance predictions of 3D car designs." 2021 IEEE Symposium Series on Computational Intelligence (SSCI), 2021.

Emergence of structural bias in differential evolution

Published in Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2021

Use Google Scholar for full citation

Recommended citation: Bas Stein, Fabio Caraffini, Anna Kononova, "Emergence of structural bias in differential evolution." Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2021.

Improving NSGA-III for flexible job shop scheduling using automatic configuration, smart initialization and local search

Published in Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion, 2020

Use Google Scholar for full citation

Recommended citation: Yali Wang, Bas Stein, Thomas B{\"a}ck, Michael Emmerich, "Improving NSGA-III for flexible job shop scheduling using automatic configuration, smart initialization and local search." Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion, 2020.

Feature visualization for 3D point cloud autoencoders

Published in 2020 International Joint Conference on Neural Networks (IJCNN), 2020

Use Google Scholar for full citation

Recommended citation: Thiago Rios, Bas Stein, Stefan Menzel, Thomas Back, Bernhard Sendhoff, Patricia Wollstadt, "Feature visualization for 3D point cloud autoencoders." 2020 International Joint Conference on Neural Networks (IJCNN), 2020.

Back to meshes: Optimal simulation-ready mesh prototypes for autoencoder-based 3D car point clouds

Published in 2020 IEEE Symposium Series on Computational Intelligence (SSCI), 2020

Use Google Scholar for full citation

Recommended citation: Thiago Rios, Jiawen Kong, Bas Stein, Thomas B{\"a}ck, Patricia Wollstadt, Bernhard Sendhoff, Stefan Menzel, "Back to meshes: Optimal simulation-ready mesh prototypes for autoencoder-based 3D car point clouds." 2020 IEEE Symposium Series on Computational Intelligence (SSCI), 2020.

Scalability of learning tasks on 3D CAE models using point cloud autoencoders

Published in 2019 IEEE Symposium Series on Computational Intelligence (SSCI), 2019

Use Google Scholar for full citation

Recommended citation: Thiago Rios, Patricia Wollstadt, Bas Stein, Thomas B{\"a}ck, Zhao Xu, Bernhard Sendhoff, Stefan Menzel, "Scalability of learning tasks on 3D CAE models using point cloud autoencoders." 2019 IEEE Symposium Series on Computational Intelligence (SSCI), 2019.

Designing ships using constrained multi-objective efficient global optimization

Published in Machine Learning, Optimization, and Data Science: 4th International Conference, LOD 2018, Volterra, Italy, September 13-16, 2018, Revised Selected Papers 4, 2019

Use Google Scholar for full citation

Recommended citation: Roy Winter, Bas Stein, Matthys Dijkman, Thomas B{\"a}ck, "Designing ships using constrained multi-objective efficient global optimization." Machine Learning, Optimization, and Data Science: 4th International Conference, LOD 2018, Volterra, Italy, September 13-16, 2018, Revised Selected Papers 4, 2019.

A novel uncertainty quantification method for efficient global optimization

Published in Information Processing and Management of Uncertainty in Knowledge-Based Systems. Applications: 17th International Conference, IPMU 2018, C'adiz, Spain, June 11-15, 2018, Proceedings, Part III 17, 2018

Use Google Scholar for full citation

Recommended citation: Bas Stein, Hao Wang, Wojtek Kowalczyk, Thomas B{\"a}ck, "A novel uncertainty quantification method for efficient global optimization." Information Processing and Management of Uncertainty in Knowledge-Based Systems. Applications: 17th International Conference, IPMU 2018, C'adiz, Spain, June 11-15, 2018, Proceedings, Part III 17, 2018.

Algorithm configuration data mining for cma evolution strategies

Published in Proceedings of the Genetic and Evolutionary Computation Conference, 2017

Use Google Scholar for full citation

Recommended citation: Sander Rijn, Hao Wang, Bas Stein, Thomas B{\"a}ck, "Algorithm configuration data mining for cma evolution strategies." Proceedings of the Genetic and Evolutionary Computation Conference, 2017.

A multi-method simulation of a high-frequency bus line

Published in 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), 2017

Use Google Scholar for full citation

Recommended citation: Thierry Spek, Bas Stein, Marcel Holst, Thomas B{\"a}ck, "A multi-method simulation of a high-frequency bus line." 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), 2017.

Towards data driven process control in manufacturing car body parts

Published in 2016 International Conference on Computational Science and Computational Intelligence (CSCI), 2016

Use Google Scholar for full citation

Recommended citation: Bas Van, Matthijs Van, Hao Wang, Stephan Purr, Sebastian Kreissl, Josef Meinhardt, Thomas B{\"a}ck, "Towards data driven process control in manufacturing car body parts." 2016 International Conference on Computational Science and Computational Intelligence (CSCI), 2016.

Fuzzy clustering for optimally weighted cluster kriging

Published in 2016 IEEE international conference on fuzzy systems (FUZZ-IEEE), 2016

Use Google Scholar for full citation

Recommended citation: Bas Stein, Hao Wang, Wojtek Kowalczyk, Michael Emmerich, Thomas B{\"a}ck, "Fuzzy clustering for optimally weighted cluster kriging." 2016 IEEE international conference on fuzzy systems (FUZZ-IEEE), 2016.

Analysis and visualization of missing value patterns

Published in Information Processing and Management of Uncertainty in Knowledge-Based Systems: 16th International Conference, IPMU 2016, Eindhoven, The Netherlands, June 20-24, 2016, Proceedings, Part II 16, 2016

Use Google Scholar for full citation

Recommended citation: Bas Stein, Wojtek Kowalczyk, Thomas B{\"a}ck, "Analysis and visualization of missing value patterns." Information Processing and Management of Uncertainty in Knowledge-Based Systems: 16th International Conference, IPMU 2016, Eindhoven, The Netherlands, June 20-24, 2016, Proceedings, Part II 16, 2016.

An incremental algorithm for repairing training sets with missing values

Published in Information Processing and Management of Uncertainty in Knowledge-Based Systems: 16th International Conference, IPMU 2016, Eindhoven, The Netherlands, June 20-24, 2016, Proceedings, Part II 16, 2016

Use Google Scholar for full citation

Recommended citation: Bas Van, Wojtek Kowalczyk, "An incremental algorithm for repairing training sets with missing values." Information Processing and Management of Uncertainty in Knowledge-Based Systems: 16th International Conference, IPMU 2016, Eindhoven, The Netherlands, June 20-24, 2016, Proceedings, Part II 16, 2016.

Optimally weighted cluster kriging for big data regression

Published in Advances in Intelligent Data Analysis XIV: 14th International Symposium, IDA 2015, Saint Etienne. France, October 22-24, 2015. Proceedings, 2015

Use Google Scholar for full citation

Recommended citation: Bas Stein, Hao Wang, Wojtek Kowalczyk, Thomas B{\"a}ck, Michael Emmerich, "Optimally weighted cluster kriging for big data regression." Advances in Intelligent Data Analysis XIV: 14th International Symposium, IDA 2015, Saint Etienne. France, October 22-24, 2015. Proceedings, 2015.

Fitness landscape analysis of nk landscapes and vehicle routing problems by expanded barrier trees

Published in EVOLVE-A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation IV: International Conference held at Leiden University, July 10-13, 2013, 2013

Use Google Scholar for full citation

Recommended citation: Bas Van, Michael Emmerich, Zhiwei Yang, "Fitness landscape analysis of nk landscapes and vehicle routing problems by expanded barrier trees." EVOLVE-A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation IV: International Conference held at Leiden University, July 10-13, 2013, 2013.