Azure OpenAI Resources
Introduction
Azure OpenAI is a collaboration between Microsoft Azure and OpenAI, a leading research organization in artificial intelligence. It is a cloud-based platform that enables developers and data scientists to build and deploy AI models quickly and easily. With Azure OpenAI, users can access a wide range of AI tools and technologies to create intelligent applications, including natural language processing (NLP), computer vision, and deep learning.
Azure OpenAI is designed to accelerate the development of AI applications, allowing users to focus on creating innovative solutions that deliver value to their organizations and customers.
Request Access
- Rate Increase: Azure OpenAI Service: Request for Quota Increase (microsoft.com)
- GPT4: GPT-4 and GPT-4-32k are now available to all Azure OpenAI Service customers. You no longer need to request access to use GPT-4 and GPT-4-32k. Availability is currently limited by region to ensure a smooth rollout. You still need to apply for the AOAI Service if you do not have that already.
Keeping Up (May 2024 Update📰)
- Microsoft Build 2024 – Explore technical learning, community connection, and insights into cutting-edge technologies. With 200,000+ registered attendees and 300+ sessions, it’s a great opportunity to explore the latest developments in AI, data, security, and more.
Outline of all Azure AI Sessions at Build 2024 (May 21st – 23rd). Session titles that are bold have been recommended by Microsoft’s AI PG.
Title | Time | Speaker(s) |
---|---|---|
Azure AI Studio - Creating and scaling your custom copilots | 11:30AM - 12:15PM | Asha Sharma, Nabila Babar, Jithendra Veeramachaneni |
Build, Evaluate and Deploy a RAG-based retail copilot with Azure AI | 2:15PM - 3:15PM | Nitya Narasimhan |
AI Everywhere – Accelerate your development from the edge to cloud | 11:30 AM - 12:15 PM | Lior Kamrat |
Build sophisticated custom copilots with Azure OpenAI Assistants | 1:00 PM - 1:45 PM | Salman Quazi, Mona Whalin |
Learn how to interact with Large Language Models | 1:00 PM - 2:00 PM | Henk Boelman, Gustavo Cordido |
Multi-model, multimodal, and multi-agent innovations in Azure AI | 2:15PM - 3:00PM | Marco Casalaina |
Build copilot experiences with your data on Azure OpenAI Service | 3:15PM - 3:30PM | Pavan Li, Linda Li |
Build and run intelligent apps with AKS and Azure OpenAI Service | 3:30 PM - 4:30 PM | Sachi Desai, Paul Yu |
Operationalize AI responsibly with Azure AI Studio | 3:30PM - 4:15PM | Mehrnoosh Sameki |
Discover, test and deploy models with ease with Azure AI model catalog | 4:00PM - 4:15PM | Kriti Faujdar, Shubhi Raj |
Unlock the potential of foundation models with MaaS | 4:45PM - 5:30PM | Manoj Bableshwar, Sharmila Chockalingam |
Multimodal use cases with GPT and Azure AI Vision | 5:15PM - 5:30PM | Adina Trufinescu, Cenyu Zhang |
Build, Evaluate and Deploy a RAG-based retail copilot with Azure AI | 4:45PM - 5:30PM | Nitya Narasimhan |
Create Generative AI experiences using Phi | 11:45AM - 12:30PM | Sam Kemp |
Next generation AI for developers with the Microsoft Cloud | 8:30 AM - 10:00 AM | Scott Guthrie, Sarah Bird, Seth Juarez, Charles Lamanna |
Safeguard user and AI-generated content with Azure AI Content Safety | 10:15AM - 10:30AM | Federico Zarfati, Ken Archer |
RAG at scale: production-ready GenAI apps with Azure AI Search | 10:15AM - 11:00AM | Pablo Castro |
Discover, test and deploy models with ease with Azure AI model catalog | 10:45AM - 11:00AM | Kriti Faujdar, Shubhi Raj |
Integrating Azure AI and Microsoft Fabric for Next-Gen AI Solutions | 1:00PM - 1:45PM | Facundo Santiago, Nellie Gustafsson |
Learn how to interact with Large Language Models | 1:00 PM - 2:00 PM | Henk Boelman, Gustavo Cordido |
Revolutionizing search and retrieval with Azure AI Search | 1:45PM - 2:00PM | Vinod Valloppillil, Matt Gotteiner |
Blow past benchmarks using vector search and RAG with Elasticsearch | 2:15PM - 3:00PM | Kim Bryille |
Practical applications of multimodal vision AI models | 2:15PM - 3:00PM | Fisayo Feyisetan, Adina Trufanisco |
Evaluate, monitor, and optimize LLM app performance in Azure AI Studio | 3:15PM - 3:30PM | Minsoo Thigpen; Alexander Hughes |
Build and run intelligent apps with AKS and Azure OpenAI Service | 3:30 PM - 4:30 PM | Sachi Desai, Paul Yu |
Optimize productivity by meeting next-level demands of the AI era | 3:30PM - 4:15PM | Nidhi Chappell |
Safeguard your copilot with Azure AI | 3:30PM - 4:15PM | Suzana Ilic, Andrew Gully |
Code-First LLMOps from prototype to production with GenAI tools | 3:30PM - 4:15PM | Cassie Breviu, Dan Taylor |
Give your GenAI apps a multilingual voice with Azure AI Speech | 4:45PM - 5:30PM | Heiko Rahmel; Panos Periorellis |
Video prompting with Azure AI Vision and GPT-4 Turbo with Vision | 5:15PM - 5:30PM | Joe Filcik |
Bridge the chasm between your ML and app devs with Semantic Kernel | 6:00 PM - 6:45 PM | Matthew Bolanos, Evan Chaki, John Maeda |
Build, Evaluate and Deploy a RAG-based retail copilot with Azure AI | 3:00PM - 4:00PM | Nitya Narasimhan |
Generative AI from your local machine to Azure with LangChain | 8:45AM - 9:00AM | Arun Sekhar, Natalia Venditto |
Learn how to interact with Large Language Models | 9:45 AM - 10:45 AM | Henk Boelman, Gustavo Cordido |
Bring your copilots to life with a customized visual identity | 11:00AM - 11:15AM | Qinying Liao; Binggong Ding |
Revamping the Document Automation Workflow with Generative AI | 11:00AM - 11:45AM | Vinod Kurpad |
End-to-End AI Development: A Practical Approach | 11:00AM - 11:45AM | Seth Juarez |
Power your AI Transformation with Microsoft Learn | 11:30AM - 11:45AM | Julie-Anne Arsenault, Sandra Marin |
Build and run intelligent apps with AKS and Azure OpenAI Service | 12:30 PM - 1:30 PM | Sachi Desai, Paul Yu |
Advanced RAG with Azure AI Search - top questions answered | 12:30PM - 1:15PM | Vinod Valloppillil |
Build AI faster with task-optimized language models in Azure AI | 1:00PM - 1:15PM | Xiaoying Guo; Rena Liu |
Revolutionizing search and retrieval with Azure AI Search | 2:00PM - 2:15PM | Vinod Valloppillil, Matt Gotteiner |
Practicalities of Fine-Tuning Llama 2 with AI Studio | 3:00PM - 3:45PM | Cedric Vidal; Bala Venkataraman |
Transforming the future of startups with Microsoft AI | 4:15PM - 5:00PM | Annie Pearl, Lahini |
- Azure OpenAI Service model deprecations and retirements – Learn about models that are currently available, deprecated, and retired.
Please visit our Academy page to see Code Snippets & Architecture Examples: AI & ML Academy.
- What’s New in Azure OpenAI
- Azure OpenAI – YouTube
- Model Availability
- Quotas & Limitations: Azure OpenAI Service Quotas & Limits – Azure Cognitive Services
- Pricing: Azure OpenAI Service Pricing
Fundamentals
- Azure OpenAI Documentation – Overview, QuickStart, tutorials, how-to guides, API reference
- Video: Combining OpenAI models with the power of Azure
- Introduction to Azure OpenAI Service – Microsoft Learn
- Introduction to Prompt Engineering
- System message framework and template recommendations for Large Language Models (LLMs)
- How to ground models
- ChatGPT Enterprise: Revolutionize your Enterprise Data with ChatGPT: Next-gen Apps w/ Azure OpenAI and Cognitive Search – Microsoft Community Hub
- GPT4 Model: How to work with the GPT-35-Turbo and GPT-4 models — Azure OpenAI Service
Evaluating models:
- LangChain Lib: Evaluation — 🦜🔗
- Evals framework for evaluating LLMs and LLM systems
- Leverage Prompt Flow to evaluate your model
Responsible AI:
- Code of Conduct for the Azure OpenAI Service
- Data, privacy, and security for Azure OpenAI Service
- Transparency Note for Azure OpenAI Service
- Content Filtering: Azure OpenAI Content Filtering
- Microsoft Azure Legal Information
- Azure AI announces Prompt Shields for Jailbreak and Indirect prompt injection attacks – Our Azure OpenAI Service and Azure AI Content Safety teams are excited to launch a new Responsible AI capability called Prompt Shields. Prompt Shields protect applications, powered by Foundation Models, from two types of attacks: direct (jailbreak) and indirect attacks, both of which are now available in Public Preview.
AI Business Material:
Tooling:
- The Azure OpenAI benchmarking tool helps you test and measure the performance of your provisioned throughput deployments. These deployments give you a fixed amount of model compute, but the actual performance depends on factors like prompt size, generation size, and call rate. The tool sends test traffic to your deployment and shows you the throughput, latency, and utilization statistics. You can use it to try different traffic patterns and find the best settings for your prompt size, generation size, and PTUs.
Associate
- How to generate text with Azure OpenAI - Learn how to generate or manipulate text, including code with Azure OpenAI
- How to prepare a dataset for Azure OpenAI custom model training - Learn how to prepare your dataset for fine-tuning
- Semantic Kernel Library - .NET Code Snippets
- LLMOps - Operational capabilities and infrastructure required to fine-tune existing foundational models
- JARVIS - Collaborative system that uses an LLM as the controller
- Can ChatGPT work with your enterprise data? - Bring OpenAI’s ChatGPT model in Azure to your own enterprise-grade app experiences with precise control over the knowledge base, for in-context and relevant responses. Interact with your organization’s private internal data, while respecting the information protection controls put in place.
- DALL-E 3 is now generally available (available in East US, Sweden Central, and Australia East) – providing service reliability for production scenarios, annotations for content filtering, and continuing to deliver high-quality generated images.
- Speech to text with the Azure OpenAI Whisper model
Past Events
- Microsoft AI Tour 2024 In-person
- The First Annual Microsoft Fabric Community Conference In-person March 26-28, 2024: See firsthand how Microsoft Fabric and the data and AI products at Microsoft can help your organization prepare for the era of AI. You’ll hear from leading Microsoft and community experts from around the world and receive hands-on experiences with the latest features from Microsoft Fabric, Power BI, Databases, Azure AI, Microsoft Purview, and more.
- Microsoft Ignite 2023: Watch the recordings for various sessions, covering updates on services, product announcements, and demos.
- Microsoft Build: Catch the recordings from the event. See Microsoft Build 2023 Recommended AI Session Guide
- Azure OpenAI What the Hack (WTH): This introductory hackathon will provide participants with hands-on experience on how to integrate the Azure OpenAI offering
Demos & Code Samples
- Customer Service Conversational Insights with Azure OpenAI — Architecture Example
- OpenAI End-to-End Code Snippets
- OpenAI Use Cases & ChatGPT Demo
- AI-powered Call Center Architecture Example
- Business Process Automation Accelerator - Provides a no-code Studio for users to quickly build complex, multi-stage AI pipelines across multiple Azure AI and ML Services
- Microsoft Tech Community: Azure OpenAI (GPT) with Power Apps - Build a Power App to create a demo or Personal Knowledge Bot
- Build a low-code conversational SMS bot with Azure Communication Services & Azure OpenAI
- Q&A using Azure OpenAI & document’s vector embeddings
- Create a chatbot using enterprise data with DevOps best practices
Community Resources
- AI – Azure Platform Blog – Microsoft Community Hub
- AI – Azure AI Services Blog – Microsoft Community Hub
- Microsoft Q&A - Get answers to your questions using the tag: azure-openai
- OpenAI Python Library - examples · PyPI
- OpenAI Cookbook
- Awesome ChatGPT Prompts
- Tokenizer for Python & NodeJS
Interesting Reads
- New Microsoft Copilot Studio Implementation Guide
- Vector Similarity Search with Azure SQL database and OpenAI
- Using Microsoft Fabric’s Lakehouse Data and prompt flow in Azure Machine Learning Service to create RAG applications – Microsoft Fabric Blog
- Azure AI Search: Outperforming vector search with hybrid retrieval and ranking capabilities – Microsoft Community Hub
- Building GPT-3 applications — beyond the prompt