### First check - [X] I added a descriptive title to this issue. - [X] I used the GitHub search to look for a similar issue and didn't find it. - [X] I searched the Marvin documentation for this feature. ### Describe the current behavior It is cheaper if we batch in regular llm frameworks, just wondering if this is doable in case of marvin. ### Describe the proposed behavior as above. ### Example Use _No response_ ### Additional context _No response_
First check
Describe the current behavior
It is cheaper if we batch in regular llm frameworks, just wondering if this is doable in case of marvin.
Describe the proposed behavior
as above.
Example Use
No response
Additional context
No response