infera — LLM reverse proxy.
Routes requests across OpenAI and Ollama,
with streaming, failover, and circuit breaking.

Type a message to try it.