Welcome !
I'm a Reinforcement Learning PhD student at Ecole Polytechnique,
Palaiseau, France, working under the supervision of Professors
Erwan Le Pennec,
Hind Castel-Taleb, and
Emmanuel Hyon. I hold
a Master's degree from Ecole Normale Supérieure Paris Saclay
and an Engineering Diploma from Ecole Polytechnique.
My Research
My research lies at the intersection of Reinforcement Learning, Dynamic Programming, and Markov Decision
Processes
(MDPs), with a focus on scalable decision-making in high-dimensional environments. I explore methods for state
abstraction and hierarchical reinforcement learning, aiming to reduce complexity through divide-and-conquer
strategies. These approaches are particularly relevant in applications such as large-scale planning, resource
allocation, and network optimization. Recent work includes the development of abstraction-refinement algorithms
and learning-based orchestration methods for dynamic systems, including use cases in edge computing networks.
Articles
-
Faster Latency Constrained Service
Placement in Edge Computing with Deep Reinforcement Learning
Methods
Orso Forghieri, Yannick Carlinet, Emmanuel
Hyon, Erwan Le Pennec, Nancy Perrot, .
TX4NETs Workshop at IFIP NETWORKING
Conference, Limassol, Cyprus.
-
State Abstraction Discovery from
Progressive Disaggregation
Methods
Orso Forghieri, Erwan Le Pennec, Hind Castel-Taleb, Emmanuel
Hyon.
17th European Workshop on Reinforcement
Learning.
-
Progressive State
Space Disaggregation for Infinite Horizon
Dynamic Programming
Orso Forghieri, Erwan Le Pennec, Hind Castel-Taleb, Emmanuel
Hyon.
International Conference on Automated
Planning and Scheduling,
2024.
Communications
-
June 2025: Talk at the SIMPAS Team retreat, Rouen, France.
Slides
-
Nov. 2024: Talk at the PGMO Days, EDF Labs, Palaiseau, France.
Slides
-
Sep. 2024: Talk at the Argo Seminar, Inria Paris, France.
Slides
-
Apr. 2024: PhD seminar of Centre de Mathématiques Appliquées de
Polytechnique, Palaiseau, France.
Slides
-
Mar. 2024: Two sessions in the Conference on Operational Reasearch
ROADEF 2024, Amiens, France.
Abstract on HRL
and
Abstract on MDPs
-
Nov. 2023:
Presentation
in the Young Researchers session at
Grenoble
Workshop on Bandits.
-
Jan. 2023: Talk at the SIMPAS team seminar
SIMPAS team.
Slides
-
Feb. 2022: Session in the Conference on Operational Reasearch
ROADEF 2022.
Abstract
Teaching
-
Mar 2024: Teaching Assistant in
Rare Events Numerical
Simulation, Engineering degree, École Polytechnique, France
-
Feb 2024: Interviewer in mathematics for MSc X-HEC
Data Science for Business
-
Sep 2023: Teaching Assistant in Statistics, Engineering degree,
École Polytechnique, France
-
Sep 2023: Teaching Assistant in Probabilities, MsC, École
Polytechnique, France
-
Feb 2023: Teaching Assistant in Operational Research, BSc,
Université Paris Nanterre, France
Side activities
-
Reviewer for
ROADEF2025 conference.
-
Alpha tester for
Marmote MDP solver,
created by Emmanuel Hyon and Alain Jean-Marie.
-
Laboratory Life Council PhD Representative at CMAP, École Polytechnique, 2024-2025.