Skip to content

RL API

RL APIs cover baseline learners, shared training data structures, policy adapters, and model export helpers.

Shared Training Helpers

src.rl.base.AgentSpec dataclass

src.rl.base.TrainResult dataclass

src.rl.base.PolicyAdapter dataclass

src.rl.base.merge_configs(defaults, overrides)

src.rl.base.infer_agent_specs(env)

src.rl.base.compute_gae(rewards, bootstrap_dones, values, last_value, gamma, gae_lambda)

src.rl.base.normalize_advantages(advantages)

src.rl.base.num_updates_for_timesteps(timesteps, rollout_length)

Algorithms

src.rl.ippo.IPPO

src.rl.ippo.ActorCritic

Bases: Module

src.rl.ippo_lag.IPPO_Lagrangian

src.rl.ippo_lag.ActorCriticWithCost

Bases: Module

src.rl.ICPO.ICPO

src.rl.ICPO.CategoricalActor

Bases: Module

src.rl.ICPO.ValueNetwork

Bases: Module

Model Export

src.rl.model_io.save_models(env, models, folder)