Blog
How the market works, from the people who build it. Plain notes on routing, failover and where your prompts go, with the requests to try.
A market, not a gateway
Most gateways put one provider behind each model name. On llm.buzz several providers can serve the same model at their own prices, and every request goes to the one that ranks best for it.
Read the post
What happens when a provider fails
Providers time out, throttle and go down. Here is exactly what llm.buzz does when that happens to your request, what you can change about it, and what you pay for.
Keeping prompts in the EU
EU residency on llm.buzz is one request field, on every plan. How to keep a request on EU providers, what happens when they fail, and how to ask for providers that keep nothing.