Building better platforms with Azure, GitHub, Terraform and AI
Part 1 covered the consumption side of an AI gateway: rate limits, token quotas, usage attribution and the telemetry needed to understand them. The next runtime decision is whether a request should be allowed through at all, followed by whether that consumer is entitled to use the model it asked for. Those are separate controls, … Read more
If you are using Azure API Management service, you may get notified or see an Azure advisor recommendation regarding – Disable trusted service connectivity in API Management. While reviewing Azure Advisor recommendations across multiple subscriptions, I noticed something interesting: only a subset of our API Management (APIM) services appeared in the advisor alerts. This prompted … Read more
Working with Azure API Management across multiple tenants? Tired of managing service principal secrets and certificates? In this blog post, I’m going to show you how to set up passwordless cross-tenant authentication using User-Assigned Managed Identities and Federated Credentials. This approach eliminates the need for client secrets while enabling secure service-to-service authentication between API Management … Read more