ray.data.Dataset.write_datasource#
- Dataset.write_datasource(datasource: Datasource, *, ray_remote_args: Dict[str, Any] = None, **write_args) None [source]#
Writes the dataset to a custom
Datasource
.Note
This operation will trigger execution of the lazy transformations performed on this dataset.
Time complexity: O(dataset size / parallelism)
- Parameters:
datasource – The
Datasource
to write to.ray_remote_args – Kwargs passed to
ray.remote
in the write tasks.write_args – Additional write args to pass to the
Datasource
.
Warning
DEPRECATED: This API is deprecated and may be removed in future Ray releases.