Model Ray backends should support dynamic batching #15
Description
See https://docs.ray.io/en/latest/serve/api/doc/ray.serve.batch.html for a straightforward implementation
{{ message }}
See https://docs.ray.io/en/latest/serve/api/doc/ray.serve.batch.html for a straightforward implementation