Publications

Publications in reverse chronological order.

2026

  1. Confidence-Adaptive State Abstraction for Model-Free Q-Learning
    Orso Forghieri, Emmanuel Hyon, Hind Castel, and 1 more author
    2026
    Manuscript submitted to AISTATS 2027
    HTML
  2. Value-Aware State Disaggregation for Continuous-State MDPs
    Orso Forghieri, Hind Castel, Emmanuel Hyon, and 1 more author
    2026
    Manuscript submitted to AISTATS 2027
    HTML

2025

  1. Approximate Dynamic Programming and State Abstraction Discovery
    Orso Forghieri, Hind Castel-Taleb, Emmanuel Hyon, and 1 more author
    2025
    Manuscript under peer review
  2. Disaggregation Techniques for Faster Markov Decision Process Solving and State Abstraction Discovery
    Orso Forghieri, Hind Castel-Taleb, Emmanuel Hyon, and 1 more author
    2025
    Manuscript and associated experimental code repository
  3. Faster Latency Constrained Service Placement in Edge Computing with Deep Reinforcement Learning
    Orso Forghieri, Yannick Carlinet, Emmanuel Hyon, and 2 more authors
    In TX4NETs Workshop at IFIP NETWORKING Conference, 2025
    HTML PDF Code
  4. Hierarchical Reinforcement Learning for Large Scale Problems
    Orso Forghieri
    Institut Polytechnique de Paris, 2025

2024

  1. State Abstraction Discovery from Progressive Disaggregation Methods
    Orso Forghieri, Erwan Le Pennec, Hind Castel-Taleb, and 1 more author
    In 17th European Workshop on Reinforcement Learning, 2024
    HTML PDF
  2. Progressive State Space Disaggregation for Infinite Horizon Dynamic Programming
    Orso Forghieri, Erwan Le Pennec, Hind Castel-Taleb, and 1 more author
    In International Conference on Automated Planning and Scheduling, 2024
    HTML PDF Code