接口定义:
async def openai_chat_completion(
request: OpenAICompletionRequest,
authorization: Optional[str] = Header(None)
):
接口输出格式:
res = {
"id": "",
"object": "chat.completion.chunk",
"created": 0,
"model": model_name,
"choices": [{"index": 0, "delta": {"content": ""}, "logprobs":None, "finish_reason": None}]
}