Pricing and discounts

How a request is priced

Each provider of a model sets its own prices for input, output, cached input and cache writes. A request is billed at the prices of the provider that answered it, so when a request fails over, you pay the provider that produced the answer, and the failed attempts cost nothing. The llm.buzz provider has no price list of its own: for each price it bills the lowest of the model's direct providers, shown with an Auto tag (The llm.buzz provider).

• usage.cost in every answer is the request's cost in US dollars, when every part of it is known.
• GET /models/{author}/{slug}/endpoints lists each provider's prices, in US dollars per token, and the tag you can name in provider.order or provider.only.
• The model list shows one price per model: with your key, the average over the providers that may serve you; without a key, the price of the provider requests go to first.
• The site shows prices per million tokens, except where a price names its unit (per million seconds of audio or characters, or per image). The API lists them as OpenRouter does: per token, or per second of audio or per character on an audio model, and an image model's output price in pricing.image_output, as Images explains.

Add :floor to a model's name, or send provider: {"sort": "price"}, to try the cheapest provider first. Models and routing explains the order providers are tried in.

Prepaid credit

Requests draw on your organization's credit: one balance that every member's keys share. Buy $5 to $25,000 of credit on the console's Credits page. A service fee of 5.5%, at least $0.80, is added on top:

With auto top-up on, llm.buzz charges a saved card for an amount you choose, $5 to $25,000 plus the service fee, whenever your balance falls below your threshold, $2 to $25,000. It tops up at most 5 times per UTC day. It turns itself off, and the Credits page says why, when the card is declined, when the bank asks to confirm the payment (buy credit once with the card, then turn it on again), when the day's 5 top-ups are used, and when the saved card is removed with no default card left.

When the balance is spent, a request to a paid model answers 402 insufficient_credits; free models still answer.

You can refund a purchase or an auto top-up from the Credits page for 24 hours after the payment. It refunds the smaller of the payment's credit not yet refunded and your balance less what running requests hold. The service fee is never refunded.

Provider discounts

A provider can run a discount for a set period, a whole percent off every price it bills. While it runs:

• requests routed to that provider are priced, budgeted and ranked at the discounted price, and usage.cost shows it;
• the endpoints route lists the discounted prices with pricing.discount, the fraction taken off, such as 0.51 for 51% off;
• the site shows the original price struck through beside the discounted one, with the end date.

A request admitted before a discount ends pays the discounted price even if it finishes after the end. A discount never changes which provider holds a conversation's cache.

Free offers

A provider discount of 100% makes that provider free until the discount ends, up to an allowance: a number of input and output tokens for each organization over the whole offer, and a number of requests per minute for each key. The site marks such a provider "free", with the end date.

• Once your organization has used its tokens, or your key reaches the per-minute limit, the model's other providers serve the request at their own prices.
• A model with no other provider then answers 429 free_allowance_exceeded. Its message names the allowance and when the offer ends. For the per-minute limit it carries Retry-After: 60: retry after a minute, or choose a paid model.
• Requests already running when the allowance runs out finish, so use can go a little over it.

Offers on the site

The banner at the top of every page carries the current offer: a promotion the llm.buzz team sets, such as a model that is free for a week, or else the biggest provider discount running now. Close it and it stays closed until the next offer.

The market log

The market log is the price history of the whole market, newest first: new models, new providers serving a model, and every change to a provider's input or output price, each dated and linked to the model. It has an RSS feed for agents and dashboards.

It also lists provider discounts as they start and end, and the prices other providers list for the same models, read from their public listings, with how much the llm.buzz price saves against each. Every row says where its price comes from and when it was read.

The inventory

The inventory lists everything on llm.buzz in one place: every provider, model, app and agent, with which serve from the EU. Providers and models the team is bringing on appear there as coming soon before they serve.