Skip to content

feat: streaming API responses #31

Description

@rajnavakoti

Description

Add streaming support to the /ask API endpoint and the Ask viewer page. Currently the full answer is generated before returning, causing long waits. Stream the retrieval stages and synthesis for better UX.

Acceptance Criteria

  • /ask endpoint supports Accept: text/event-stream for SSE streaming
  • Streams: retrieval progress → entity matches → synthesis tokens → gap detection
  • Ask page in viewer shows streaming answer as it's generated
  • Non-streaming mode still works for backward compatibility
  • CLI cb ask shows streaming output by default

Out of Scope

  • WebSocket support
  • Streaming for extraction pipeline

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1-nextNext after OSS releaseframeworkScientific frameworks

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions