Welcome !
I'm a Reinforcement Learning PhD student at Ecole Polytechnique,
Palaiseau, France, working under the supervision of Professors
Erwan Le Pennec,
Hind Castel-Taleb, and
Emmanuel Hyon. I hold a Master's degree from Ecole Normale Supérieure Paris Saclay
and an Engineering Diploma from Ecole Polytechnique.
My Research
My research lies at the intersection of Reinforcement Learning,
Dynamic Programming, and Markov Decision Processes (MDPs), with a
focus on scalable decision-making in high-dimensional environments. I
explore methods for state abstraction and hierarchical reinforcement
learning, aiming to reduce complexity through divide-and-conquer
strategies. These approaches are particularly relevant in applications
such as large-scale planning, resource allocation, and network
optimization. Recent work includes the development of
abstraction-refinement algorithms and learning-based orchestration
methods for dynamic systems, including use cases in edge computing
networks.
Articles
-
Faster Latency Constrained Service Placement in Edge Computing
with Deep Reinforcement Learning Methods
Orso Forghieri, Yannick Carlinet, Emmanuel Hyon, Erwan Le Pennec,
Nancy Perrot, .
TX4NETs Workshop at IFIP NETWORKING Conference, Limassol, Cyprus.
-
State Abstraction Discovery from Progressive Disaggregation
Methods
Orso Forghieri, Erwan Le Pennec, Hind Castel-Taleb, Emmanuel
Hyon.
17th European Workshop on Reinforcement Learning.
-
Progressive State Space Disaggregation for Infinite Horizon
Dynamic Programming
Orso Forghieri, Erwan Le Pennec, Hind Castel-Taleb, Emmanuel
Hyon.
International Conference on Automated Planning and Scheduling,
2024.
Communications
-
Jun. 2025: Talk at the Simpas Team Retreat, Rouen, France.
Slides
-
Nov. 2024: Talk at the PGMO Days, EDF Labs, Palaiseau, France.
Slides
-
Sep. 2024: Talk at the Argo Seminar, Inria Paris, France.
Slides
-
Apr. 2024: PhD seminar of Centre de Mathématiques Appliquées de
Polytechnique, Palaiseau, France.
Slides
-
Mar. 2024: Two sessions in the Conference on Operational Reasearch
ROADEF 2024, Amiens, France.
Abstract on HRL
and
Abstract on MDPs
-
Nov. 2023:
Presentation
in the Young Researchers session at
Grenoble Workshop on Bandits.
-
Jan. 2023: Talk at the SIMPAS team seminar
SIMPAS team.
Slides
-
Feb. 2022: Session in the Conference on Operational Reasearch
ROADEF 2022.
Abstract
Teaching
-
Mar 2024: Teaching Assistant in
Rare Events Numerical Simulation, Engineering degree, École Polytechnique, France
-
Feb 2024: Interviewer in mathematics for MSc X-HEC
Data Science for Business
-
Sep 2023: Teaching Assistant in Statistics, Engineering degree,
École Polytechnique, France
-
Sep 2023: Teaching Assistant in Probabilities, MsC, École
Polytechnique, France
-
Feb 2023: Teaching Assistant in Operational Research, BSc,
Université Paris Nanterre, France
Side activities
-
Reviewer for
ROADEF2025 conference.
-
Alpha tester for
Marmote MDP solver, created by Emmanuel Hyon and Alain Jean-Marie.
-
Laboratory Life Council PhD Representative at CMAP, École
Polytechnique, 2024-2025.