Streaming & failover
Honest limits for Ohm’s edge. Mid-stream provider handoff without a client reconnect is not shipped.
Non-streaming
Failover retries the fallback upstream before a committed successful response body. It is not dual-provider racing.
Streaming
- Pass-through SSE for OpenAI; Anthropic events are translated to OpenAI chunk frames.
- If the upstream drops mid-stream, the client may see a truncated stream.
- Prefer non-streaming for critical paths until mid-stream handoff ships.