Routing and Failover for Microsoft.Extensions.AI - .NET Blog (blogs.msdn.microsoft.com)

Route requests across models and providers natively in Microsoft.Extensions.AI with RoutingChatClient, SemanticRoutingChatClient, and FailoverChatClient — new experimental primitives for content-based routing, failover, and custom routing policies.

🥃 Nightcap Routing as middleware keeps provider logic out of your application code. The sticky session example shows how to layer app concerns on top without coupling them to model selection.

0 comments — live from bluesky

No comments yet.