Skip to main content Link Menu Expand (external link) Document Search Copy Copied

Task 03 - Create and configure the Azure OpenAI Service (20 minutes)

Introduction

The hero service for this training is the Azure OpenAI Service, which we will use throughout these exercises along with Azure AI Services. The staff at Contoso Suites has heard of OpenAI and are interested in seeing what it takes to get started with the service.

Description

In this task, you will create an Azure OpenAI Service resource and two model deployments.

You will work with the GPT-4 model in this training. This will limit the number of regions you can use for deployment. Review the region availability table and ensure that you choose a region that supports GPT-4. Also, you will want to ensure that your region has support for Azure AI Services

The key tasks are as follows:

  1. Create an instance of the Azure OpenAI Service.
  2. In the OpenAI Studio, create two new deployments:
    1. A gpt-4 deployment using the latest available model and a rate limit of 10K tokens per minute.
    2. A text-embedding-ada-002 deployment using the latest available model and a rate limit of 120,000 tokens per minute.

Success Criteria

  • You have created an Azure OpenAI service instance in a valid region and have created two model deployments.

Learning Resources

Solution

Expand this section to view the solution
  • To create an instance of the Azure OpenAI Service, perform the following steps:
    • Navigate to the Azure portal and enter Azure OpenAI into the search box. Then, select the Azure OpenAI service link.

      Select the Azure OpenAI service

    • Select + Create to create a new instance of the service.
    • Choose the resource group you selected in Task 1 of this exercise. Make sure to create your resource in a region that supports GPT-4, such as East US 2. Provide a unique name and select Standard S0 as the pricing tier. Then, choose Next.

      Fill in the details to create an OpenAI service instance

    • Select Next for each of the following steps and Create on the final step to create the OpenAI resource.
  • To create Azure OpenAI deployments, perform the following steps:
    • Navigate to the OpenAI Studio.
    • Select the appropriate directory, subscription,and resource.
    • Navigate to the Deployments option in the Management menu.

      Navigate to the Deployments menu option

    • Select + Create new deployment to create a deployment. Select gpt-4 for the model and the latest version (e.g., 0125-Preview). Provide it a deployment name like gpt-4. In the Advanced options menu, set the Tokens per Minute Rate Limit (thousands) to 10. Then select Create to create the deployment.

      Create a new deployment

    • Perform the same steps to create a text-embedding-ada-002 model deployment but ensure that it has a rate limit of 120,000 tokens.