Skip to main content Link Menu Expand (external link) Document Search Copy Copied
Operationalize LLMs with GenAIOps automation

TechExcel: Operationalize LLMs with GenAIOps automation

  • Azure AI Foundry
  • Azure OpenAI
  • Azure Hub
  • Azure Prompt Flows
  • Azure AI Deployments
  • Azure Content Safety

Solution architecture

Diagram showing Azure AI Studio and the scope of use within the environment

The diagram shows the solution architecture of an AI project within Azure AI Foundry. The AI Foundry Hub includes the Azure Subcription, Resource Group, and Azure Content Safety service. The AI Foundry Hub provides integration with services including Azure OpenAI, Azure AI Search, and Azure Storage Accounts to implement AI-based solutions. The AI Playground offers tools like Chat Playground, Deployments, and Prompt Flow, that enable quick and easy access to AI models such as GPT-4 and Llama-2 and interactive development tools.

Exercises

These labs have exercises on:

  • Configuring and setting up Azure AI Foundry Project
  • Set up a Conversational RAG Flow
  • Emulated chat interactions and testing
  • Creating and testing multiple prompt flows and models
  • Using a notebook to setup and configure a project

These lab are available as GitHub pages here

Prerequisites

An Azure external subscription is required, where you can create an AI Project along with its AI Hub Resource, a Content Safety service, a new instance of Azure OpenAI, and an AI Search service.