~/shivansh.dev — boot
shivansh@portfolio:~$
All projects
AI INTEGRATION2025 — present

Supergate

A production-grade, multi-tenant API gateway for large language model providers.

FastifyTypeScriptPostgreSQLpgvectorRedisNext.js 15
~40%
cost reduction
<30ms
cache lookup
5+
unified providers
// problem

Enterprises using LLM providers face high API costs, lack of centralized rate limiting, and no unified way to attribute costs across multiple internal teams. They need a single, secure gateway to manage API keys, route requests, cache similar prompts semantically, enforce tenant-isolated RBAC, and mask PII — all while maintaining sub-millisecond overhead.

// architecture
ClientSupergate APIRedis Cachepgvector DBLLM Providers
// key decisions
// results
40%
redundant cost saved
<30ms
cache latency
0
downtime during peak load

Supergate successfully reduces third-party LLM API costs by an estimated 40% on repeated prompt patterns through its pgvector semantic caching. It provides high-throughput routing with automatic fallback across five major LLM providers. The client SDK and Next.js analytics dashboard give engineering teams full visibility into cost attribution, rate-limiting statuses, and error rates in real time.