Discover the future of intelligent API traffic management. Learn how AI-powered gateways enable smarter routing, adaptive security, and real-time decision-making to optimize and secure API ecosystems.
llm-d is an open-source, Kubernetes-native framework for serving large language models at scale. It doesn't run models itself. It sits in front of inference engines such as vLLM, another open-source, high-throughput serving engine, and decides how requests are spread across them. Teams taking a…
Kong AI Gateway sees every model call your teams make, so it knows who spent what, on which model, shortly after each request. Your FinOps platform holds the invoices from your cloud and model providers and runs showback and chargeback for each business unit. Put the two together and each business…
Agents are moving from demos into production, and the platform teams running them keep hitting the same four problems: spend nobody can attribute, credentials that security cannot manage, enterprise APIs rewrapped as agent tools team by team, and no single view of what an agent actually did. Today…
As enterprises put more AI applications and agents into production, managing the associated costs is becoming an increasingly important operational challenge. AI spending is distributed across multiple providers, models, applications, and teams, making it difficult to understand where costs…
At Kong, we fully agree with Gartner’s recent reporting on the emerging marketing of AI FInOps tools. AI FinOps must not be an afterthought but should be a critical and mandatory component for any enterprise AI program. The explosive growth of AI workloads from simple AI-assisted coding to product…
Today ServiceNow launched the ServiceNow Control Tower Alliance , and Kong is proud to be a founding member to help enterprises put AI to work safely, at scale. It's a milestone for Kong, and we think it's an important moment for the industry. Here's what the alliance is, why it matters, and why we…
When an application calls a model provider directly, the service needs the provider's API key, and any control over that traffic has to be built into the service itself. For one service calling one model, that is the right amount of machinery. It holds up less well as the application grows. Every…
A healthy API and a successful model call do not prove that an AI application produced a useful result. AI observability connects logs, metrics, and traces with evidence about behavior, retrieval, tool use, quality, safety, and token consumption. That combined view helps AI engineers explain what…
AI governance is an operating model organizations can use to keep AI systems accountable, safe, observable, and aligned with applicable requirements. It can combine decision rights, lifecycle processes, and technical controls across models, agents, tools, data, and APIs. [1] [2] [3] For enterprise…
AI coding tool spend is projected to top $13 billion in 2026, compounding at more than 60% a year. That's an entire category showing up at once, according to the recent Palo Alto Networks' Secure AI Coding report. These agents don't just autocomplete a line of code anymore. They plan. They act.…
AI infrastructure is changing fast. Enterprises are no longer building around a small set of models exposed through relatively consistent interfaces. New model architectures are emerging (Here’s looking at you Jev!). Providers are introducing new APIs and capabilities. Enterprises are running…
New AI cost management capabilities help organizations price, attribute, plan, control, and optimize AI spend across models, applications, teams, and agents. AI is getting easier to build with. Paying for it is getting harder to manage. As organizations move from AI experiments to production…
Kong Webhook Engine turns business events into triggers for applications and AI agents — connecting what happens in the business to what happens next. Most AI agent interactions today start with an explicit request. A user sends a prompt. An application invokes an agent. A workflow calls one. The…
In April 2026, Uber burned through its entire year’s AI budget by the middle of the month, driven largely by usage of Anthropic's Claude Code and Cursor. Nothing was broken. No one misused the tool. Engineers were doing exactly what every team's been told to do: adopt AI, use it well, use it…
Enterprise AI governance requires a composed stack connecting high-level risk and compliance oversight with real-time runtime enforcement. While oversight tools manage inventories, approvals, and evidence, AI gateways apply policy controls directly to live model, API, MCP, and agent traffic.…
Kong and Straiker are partnering to help enterprises secure AI agents across the traffic, tools, and systems they already manage through Kong AI Gateway . The integration brings Straiker into the Kong ecosystem, giving customers a way to add deeper security visibility, testing, LLM runtime…