#01API gateway / Highload
Raven Gate
A high-throughput API gateway with rate limiting, JWT auth and hot route reloading.
- Go
- Redis
- PostgreSQL
- Kubernetes
- NGINX Ingress
- Prometheus
Results in numbers
-
120k
requests per second at peak
-
<8 ms
p99 latency
-
99.98%
uptime over six months
-
−42%
infrastructure costs
01
Challenge
The legacy monolithic proxy buckled under peak load, and every routing change required a restart that caused downtime.
02
Solution
We built a Go gateway with distributed rate limiting in Redis, on-the-fly JWT validation and PostgreSQL-backed routes with hot reload, deployed behind NGINX Ingress with Kubernetes autoscaling.
03
Result
The gateway handles peak load without degradation, routes change with zero downtime and Prometheus metrics give a full picture of the traffic.
Key features
- 01 Distributed rate limiting per key, IP and plan
- 02 Hot route reload without dropping connections
- 03 Service-to-service mTLS and key rotation
- 04 Canary releases with automatic rollback
Architecture
- Clients web & mobile apps
- NGINX Ingress TLS, load balancing
- Raven Gate Go, auth, limits
- Redis rate counters
- Services 30+ microservices
Tech stack
- Go
- Redis
- PostgreSQL
- Kubernetes
- NGINX Ingress
- Prometheus
Timeline
-
1 week
Audit of the current system
-
2 weeks
Architecture & prototype
-
7 weeks
Development & integration
-
2 weeks
Load testing & launch
Need something similar?
Describe your task in a messenger — we will come back with questions, an architecture and an estimate.