Definition
A central infrastructure component that sits between client applications and multiple AI models or providers, routing requests, managing credentials, and enforcing security policies. It acts as a single control point for all AI model traffic in an enterprise.
Why it matters
As enterprises use dozens of AI models and providers simultaneously, an AI gateway becomes the critical chokepoint for governance: it can track usage, enforce rate limits, scan prompts for injection, and audit every interaction in one place.