feat(azure): add AzureServerlessPathHook for legacy serverless support#436
Draft
Nelson-PROIA wants to merge 1 commit intomainfrom
Draft
feat(azure): add AzureServerlessPathHook for legacy serverless support#436Nelson-PROIA wants to merge 1 commit intomainfrom
Nelson-PROIA wants to merge 1 commit intomainfrom
Conversation
…nt support Add is_foundry parameter (default True) to MistralAzure. When is_foundry=False, a BeforeRequestHook rewrites Foundry Resource paths to legacy serverless paths, allowing users on *.models.ai.azure.com to continue using the SDK after the spec is updated to Foundry Resource format.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Related to #292
Summary
is_foundryparameter (defaultTrue) toMistralAzure.__init__AzureServerlessPathHookthat rewrites Foundry Resource paths to legacy serverless paths whenis_foundry=False, allowing users on*.models.ai.azure.comto continue using the SDKhttpx/pydanticdependenciesImportant
Context
Azure has two endpoint types with different path formats:
<resource>.services.ai.azure.com/models/chat/completions/providers/mistral/azure/ocr<deployment>.<region>.models.ai.azure.com/chat/completions/ocrThe spec update will make generated paths match Foundry format. Without the hook, legacy serverless users would have no workaround (you can't strip path prefixes via
server_url). The hook follows the same pattern as the existingGCPVertexAIPathHook.Test plan
is_foundry=True(no path rewriting)is_foundry=False(paths rewritten)