Ray Summit unites the community. Submit a session proposal to share your experience.

ray.serve.config.AutoscalingConfig.target_num_ongoing_requests_per_replica#