The Plasma Object Store¶
Using Plasma with Huge Pages¶
On Linux, it is possible to increase the write throughput of the Plasma object store by using huge pages. You first need to create a file system and activate huge pages as follows.
sudo mkdir -p /mnt/hugepages gid=`id -g` uid=`id -u` sudo mount -t hugetlbfs -o uid=$uid -o gid=$gid none /mnt/hugepages sudo bash -c "echo $gid > /proc/sys/vm/hugetlb_shm_group" sudo bash -c "echo 20000 > /proc/sys/vm/nr_hugepages"
You need root access to create the file system, but not for running the object store.
You can then start Ray with huge pages on a single machine as follows.
In the cluster case, you can do it by passing
ray start on any machines where
huge pages should be enabled.
See the relevant Arrow documentation for huge pages.