Enterprise AI Gateway
your team can trust
Route, protect, and audit every LLM request. PII redaction, data residency enforcement, tamper-evident logs, and cost analytics — all in a single open-source gateway.
Everything enterprise AI needs
Six production-ready enterprise capabilities built as Bifrost plugins and standalone services. Deploy together or pick what you need.
PII / DLP Protection
Automatically detect and redact SSNs, credit cards, emails, API keys, and more before they reach the LLM — or block the request entirely. Three modes: detect, redact, block.
Tamper-Evident Audit Log
SHA-256 chained audit records for every LLM request. Prompt hashes, response hashes, token counts, latency, and user identity — stored in PostgreSQL with compliance mode tagging.
Data Residency Routing
Tag requests with X-Data-Residency: EU and InferexGuard restricts routing to EU-based providers only. Fail-closed mode blocks non-compliant requests outright.
Cost Analytics & Forecasting
Real-time cost dashboards grouped by team, model, or provider. Linear regression forecasting with 90% confidence bounds. Chargeback reports formatted for finance teams.
Compliance Reports
Generate SOC2, HIPAA, and GDPR audit evidence on demand. Async report generation with download as JSON. Supports YYYY, YYYY-MM, and YYYY-Qq period formats.
Prompt Registry
Version your prompts like code. Semver versioning, environment deployments (dev → staging → production), {{variable}} template rendering, and A/B traffic splitting.
How it works
Three steps from zero to enterprise-grade AI infrastructure.
Drop-in replacement
Point your existing OpenAI SDK at InferexGuard gateway. No code changes required — same API, same request format.
openai = OpenAI(base_url="https://gateway.yourdomain.com/openai")
Request flows through enterprise pipeline
Every request passes through: PII/DLP scan → data residency check → provider routing → response scan → audit record.
X-Data-Residency: EU → routes to EU providers only X-Virtual-Key: team-a → applies team budget & policies
Insights flow to your dashboards
Audit logs power the analytics service. Query cost by team, model, or provider. Generate compliance reports on demand.
GET /api/v1/cost/summary?period=30d&group_by=team_id
POST /api/v1/reports/generate {"framework":"soc2","period":"2026-Q1"}Enterprise Plugin Pipeline
Post-hooks run in reverse order — audit-log captures final state after all transformations
Ready to deploy?
Open source, self-hosted, and production-tested. Get the full enterprise AI gateway running in under 10 minutes.