Respan Gateway

Respan (formerly Keywords AI) is a unified LLM engineering platform that bundles an AI gateway, observability, evaluations, and prompt management into one product. Its OpenAI-compatible gateway routes requests to 500+ models through a single endpoint with per-request provider fallback, exact-match and semantic caching, per-user and per-feature budgets, and rate limits, while every call is traced and can be scored with LLM-as-judge or human review. It adds roughly 10ms P95 latency overhead and is SOC 2 / HIPAA / GDPR aligned.