Compare / Gateway

Envoy AI Gateway

Open-source Kubernetes AI gateway on Envoy Gateway; token-cost based rate limits per tenant.

GatewayVendor: Envoy Proxy project (CNCF)Last checked 2026-10-20Not vendor-verified
Hard budgets (team / key / user) (scored)partial
Usage-based rate limits on token costs per user/tenant header act as token budgets; no currency budgets
Rate & spend limits (scored)yes
llmRequestCosts (input/output/total/cached/CEL) + global rate limit
Cost attribution / chargeback tags (scored)partial
Token usage keyed by headers/metadata; no chargeback reporting
FOCUS export (scored)unknown
No FOCUS export found
EU data residency option (scored)yes
Self-hosted
Public pricing (scored)yes
Open sourceyes
Apache-2.0
HostingSelf-host
Kubernetes
Supported providers / modelsunknown
README names OpenAI, Azure OpenAI, Gemini, Vertex AI, Bedrock, Mistral and others; no count
Cachingunknown
Pricing modelOpen source
Public price pointsFree

Not verified yet: FOCUS export, Supported providers / models, Caching. "unknown" means we could not confirm it in public sources. Vendors can send evidence to update a cell; see get verified. Verification never changes the scoring rules.