Skip to main content

Ctrl+K

Ray Summit unites the community. Submit a session proposal to share your experience.

Site Navigation

Get Started
Use Cases
Example Gallery
Library
Docs
Resources

Manage Ray on Anyscale

Site Navigation

Get Started
Use Cases
Example Gallery
Library
Docs
Resources

Manage Ray on Anyscale

Overview
Getting Started
Installation
Use Cases
- Ray for ML Infrastructure
Example Gallery
Ecosystem
Ray Core
Ray Data
Ray Train
Ray Tune
Ray Serve
Ray RLlib
More Libraries
Ray Clusters
Monitoring and Debugging
Developer Guides
Glossary
Security

Ray Serve: Scalable and Programmable Serving
ray.serve.schema.DeploymentSchema
ray.serve.sc...

ray.serve.schema.DeploymentSchema.max_ongoing_requests#

DeploymentSchema.max_ongoing_requests: int#

previous

ray.serve.schema.DeploymentSchema.max_concurrent_queries

next

ray.serve.schema.DeploymentSchema.max_queued_requests

On this page

DeploymentSchema.max_ongoing_requests

Thanks for the feedback!

Was this helpful?

Yes

No

Feedback

Submit

© Copyright 2024, The Ray Team.

Created using Sphinx 7.1.2.

Built with the PyData Sphinx Theme 0.14.1.