Description
Tutorial 1 : Adil Zouitine - Efficient RL, interleaving training and policy interaction
The tutorial builds from MDPs to Soft Actor-Critic with TorchRL and TensorDict, then to an asynchronous, SERL-style system with Ray. Its main idea is that efficiency has three meanings: samples, compute and wall-clock time. SAC is off-policy, so collecting data with the current policy and training on replayed data can run in parallel instead of taking turns. A simple budget, the update-to-data ratio, sets how many gradient updates each new transition earns. Rollout workers keep acting while a learner trains, and fresh policy weights are sent back periodically. This improves wall-clock efficiency, not sample efficiency by itself, and it costs a small amount of policy staleness that the system measures and bounds.
Tutorial 2 : Ronan Sicre, Hajar Dekdegue and Moncef Garouani: Explainable AI (XAI) and visual recognition models
The practical session will allow you to delve into some standard explanations such as gradCAM.
Tutorial 3: Antonin Poché - Language models explainability
Through a tutorial, we will apply the methods notably with a bias detection use case.