
Ph.D. student
Reinforcement Learning and Computational Decision-Making
Julius-Maximilians-Universität Würzburg
John-Skilton-Straße 8a, 97074 Würzburg
Building JS8 · Room 04.017
I joined the LiteRL group at JMU Würzburg in April 2023 as a Ph.D. candidate. Before joining the group, I graduated from Télécom Paris with a major in Machine Learning and Operations Research.
I wrote my thesis, “Deterministic Exploration in Reinforcement Learning”, while working in the Scool group at INRIA Lille as a visiting student under the supervision of Prof. Riad Akrour. In this work, we built a bridge between direct policy search methods, which are oblivious to the sequential nature of MDPs, and value-based reinforcement learning algorithms, which suffer under sparse rewards.
I am passionate about model-based reinforcement learning, Bayesian optimization, explainability, and incorporating human feedback into the learning loop.
Journal
TMLR 2026
M. Kallel, J. Tölle, A. Hendawy, C. D’Eramo
Transactions on Machine Learning Research (TMLR)
Journal
RLJ 2026
M. Kallel, J. L. Holgado-Alvarez, S. Tosatto, C. D’Eramo
Reinforcement Learning Journal (RLJ)
Conference
ICLR 2026
A. Hendawy, H. Metternich, T. Vincent, M. Kallel, J. Peters, C. D’Eramo
International Conference on Learning Representations (ICLR)
Workshop
NeurIPS 2026
M. Kallel, N. Jamoussi, J. Tölle, M. Kountouris, C. D’Eramo
Workshop at Advances in Neural Information Processing Systems (NeurIPS)
Workshop
EWRL 2026
A. Hendawy, H. Metternich, T. Vincent, M. Kallel, J. Peters, C. D’Eramo
European Workshop on Reinforcement Learning (EWRL)
Workshop
EWRL 2026
M. Kallel, J. Tölle, A. Hendawy, C. D’Eramo
European Workshop on Reinforcement Learning (EWRL)
Workshop
RLC 2026
M. Kallel, J. Tölle, A. Hendawy, C. D’Eramo
Finding the Frame Workshop, Reinforcement Learning Conference (RLC)
Workshop
EWRL 2025
M. Kallel, J. L. Holgado-Alvarez, S. Tosatto, C. D’Eramo
European Workshop on Reinforcement Learning (EWRL)
Journal
RLJ 2024
O. Järnefelt, M. Kallel, C. D’Eramo
Reinforcement Learning Journal (RLJ)
Conference
ICLR 2024
M. Kallel, D. Basu, R. Akrour, C. D’Eramo
International Conference on Learning Representations (ICLR)
Workshop
EWRL 2024
M. Kallel, D. Basu, R. Akrour, C. D’Eramo
European Workshop on Reinforcement Learning (EWRL)
Workshop
EWRL 2024
O. Järnefelt, M. Kallel, C. D’Eramo
European Workshop on Reinforcement Learning (EWRL)
Workshop
EWRL 2024
M. Kallel, S. Tosatto, C. D’Eramo
European Workshop on Reinforcement Learning (EWRL)