Features

What the platform actually does

Every capability below is implemented and exercised by the seeded demonstration. Where something is deliberately out of scope, it is listed in the roadmap rather than implied here.

Applications and environments

Each application is an isolated consumer with separate development and production environments. A key issued for one environment cannot address the other, and every request is attributed to exactly one application.

Provider connections

Seven adapters — a deterministic demo provider plus OpenAI, Anthropic, Gemini, OpenRouter, DeepSeek and Ollama. Credentials are encrypted at rest with AES-256-GCM and are never returned to a browser.

Model catalogue

Context window, capabilities, configured pricing, availability and health per model. This is what the routing engine filters and scores on, so it is editable without a deployment.

Virtual API keys

Scoped to one application and environment, stored only as a SHA-256 hash, shown once at creation, revocable instantly without touching a provider credential.

Prompt registry

Immutable versions with a moving active pointer and declared template variables. Rolling back moves the pointer rather than editing history.

Quotas

Per-minute, per-day and per-month caps on requests, tokens or estimated cost. Evaluated before a provider is contacted, so a rejected request consumes no provider capacity.

Request traces

Every request stores its lifecycle stages, every provider attempt including failures, and the routing decision that produced it.

Audit log

Append-only. There is no code path in the application that updates or deletes an entry, and sensitive values are redacted before a snapshot is written.

Eight selection strategies

Each one produces a stored explanation naming every candidate considered and rejected. None of them claims to identify an objectively best model — each expresses a configured preference.

MANUAL

Uses the model named in the request. No scoring is applied, and no alternative is substituted.

PRIORITY

Tries eligible targets strictly in their configured order, lowest priority number first.

WEIGHTED

Draws a target at random in proportion to its configured weight, then orders the remainder the same way for fallback.

LOWEST_ESTIMATED_COST

Chooses the lowest projected cost among targets that meet the capability and context requirements.

LOWEST_RECENT_LATENCY

Chooses the target with the lowest mean latency across recent successful attempts. A target with no samples ranks after one with evidence.

RELIABILITY_FIRST

Chooses the healthiest target, breaking ties on recent success rate.

CAPABILITY_MATCH

Filters to targets that satisfy every required capability, then prefers the largest context window.

BALANCED

Scores each target on health, recent success rate, latency, cost and configured preference, then selects the highest total. The weights are a workspace setting, not a universal ranking.

Failure is classified before it is retried

Retrying an authentication failure wastes quota and can lock an account. Retrying a validation error can never succeed. Each category carries its own policy.

Retry policy by failure category

Applied by the fallback engine on every request.

Retry and fallback policy for each failure category
Category	Retry	Fallback	Why
AUTHENTICATION	no	allowed	Credentials will not become valid by repetition. The connection is flagged for an administrator and the next eligible target is used.
PERMISSION	no	allowed	The credential lacks access to this model. Retrying cannot grant it.
RATE_LIMIT	1×	allowed	Rate limits are transient. One backed-off retry is attempted before moving to the next target.
TIMEOUT	1×	allowed	A single retry covers transient slowness; a second would risk duplicating a request that may already be executing.
PROVIDER_UNAVAILABLE	no	allowed	The provider reported itself unavailable. Fallback is immediate rather than delayed.
INVALID_REQUEST	no	blocked	The request is malformed. It will fail identically everywhere, so no fallback is attempted.
CONTEXT_LIMIT	no	allowed	Fallback is permitted only to a target with a larger context window. Content is never silently truncated.
SAFETY_REFUSAL	no	blocked	A safety refusal is returned to the caller. Shopping the same prompt to another provider to obtain a different answer is not a default behaviour.
MALFORMED_RESPONSE	1×	allowed	A response that failed schema validation may succeed on retry; otherwise the next target is used.
NETWORK	1×	allowed	Transient network faults are retried once, then fall back.
QUOTA_EXCEEDED	no	blocked	A workspace quota was exceeded. This is a deliberate rejection, not a provider failure.
UNKNOWN	no	allowed	An unclassified failure falls back once without retrying, so an unrecognised condition cannot cause repeated calls.
CLIENT_CANCELLED	no	blocked	The client cancelled the request. No retry or fallback is attempted.