Azure AI Proxy¶
Introduction to the Azure AI Proxy¶
The goal of the Azure OpenAI proxy service is to simplify access to an AI Playground
experience, support for Azure OpenAI SDKs, LangChain, and REST endpoints for developer events, workshops, and hackathons. Access is granted using a time bound API Key
.
There are four primary use cases for the Azure OpenAI proxy service:
- Access to an AI
Playground
experience for developers to explore the Azure OpenAI chat completion using a time bound event code and different models and parameters. - Access to developer APIs via REST endpoints and the OpenAI SDKs and LangChain. Access to these services is granted using a time bound event code. Initially, the proxy service supports the
chat completion
,completion
,embeddings
, anddall-e-3
APIs. - Access to Azure AI Search queries using the Azure OpenAI proxy service. Access to these services is granted using a time bound event code.
- You are running a hackathon and users can't provision their own Azure OpenAI resources as they don't have a corporate email address.
OpenAI Proxy Playground¶
The Azure OpenAI proxy service provides a Playground-like
experience for developers to explore the Azure OpenAI chat completion using the time bound event code with different models and parameters.
Azure AI Proxy Architecture¶
The Azure AI Proxy consists of the following components:
- Self-service event management. Configure and manage events and resources for the events.
- Self-service attendee registration. Attendees can register for an event and receive a time bound API Key to access the AI Proxy service.
- The AI Proxy service. The AI Proxy service provides access to the Azure AI resources using a time bound API Key.
- The AI Playground. The AI Playground provides an AI
Playground
experience for developers to explore the Azure OpenAI chat completion using the time bound event code with different models and parameters.