RLlib: Scalable Reinforcement Learning

RLlib is an open-source library for reinforcement learning that offers both a collection of reference algorithms and scalable primitives for composing new ones.


Learn more about RLlib’s design by reading the ICML paper.


RLlib has extra dependencies on top of ray. First, you’ll need to install either PyTorch or TensorFlow. Then, install the Ray RLlib module:

pip install tensorflow  # or tensorflow-gpu
pip install ray[rllib]

You might also want to clone the Ray repo for convenient access to RLlib helper scripts:

git clone https://github.com/ray-project/ray
cd ray/python/ray/rllib