Streaming & failover

Honest limits for Ohm’s edge. Mid-stream provider handoff without a client reconnect is not shipped.

Non-streaming

Failover retries the fallback upstream before a committed successful response body. It is not dual-provider racing.

Streaming

  • Pass-through SSE for OpenAI; Anthropic events are translated to OpenAI chunk frames.
  • If the upstream drops mid-stream, the client may see a truncated stream.
  • Prefer non-streaming for critical paths until mid-stream handoff ships.