Azure OpenAI Resources¶Updated • 3 contributors
Introduction¶
Azure OpenAI is a collaboration between Microsoft Azure and OpenAI, a leading research organization in artificial intelligence. It is a cloud-based platform that enables developers and data scientists to build and deploy AI models quickly and easily. With Azure OpenAI, users can access a wide range of AI tools and technologies to create intelligent applications, including natural language processing (NLP), computer vision, and deep learning.
Azure OpenAI is designed to accelerate the development of AI applications, allowing users to focus on creating innovative solutions that deliver value to their organizations and customers.
Request Access¶
- Rate Increase: Azure OpenAI Service: Request for Quota Increase (microsoft.com)
- GPT-4.5 Preview is now available. Access is granted based on Microsoft’s eligibility criteria
Book of News: Ignite and Build 2024¶
-
Microsoft Ignite 2024 (November 19th – 21st) – Ignite 2024 is a premier event where technology enthusiasts and professionals gather to explore cutting-edge innovations, network with peers, and gain valuable insights from industry leaders.
-
Microsoft Build 2024 (May 21st – 23rd) – Explore technical learning, community connection, and insights into cutting-edge technologies. With 200,000+ registered attendees and 300+ sessions, it’s a great opportunity to explore the latest developments in AI, data, security, and more.
-
Azure OpenAI Service model deprecations and retirements – Learn about models that are currently available, deprecated, and retired.
Please visit our Academy page to see Code Snippets & Architecture Examples: AI & ML Academy.¶
- What’s New in Azure OpenAI
- Azure OpenAI – YouTube
- Model Availability
- Quotas & Limitations: Azure OpenAI Service Quotas & Limits – Azure Cognitive Services
- Pricing: Explore the updated pricing options for Azure OpenAI Service, including Standard, Provisioned, and Batch API pricing
Fundamentals¶
- Azure OpenAI Documentation – Overview, QuickStart, tutorials, how-to guides, API reference
- Video: Combining OpenAI models with the power of Azure
- Introduction to Azure OpenAI Service – Microsoft Learn
- Introduction to Prompt Engineering
- System message framework and template recommendations for Large Language Models (LLMs)
- How to ground models
- ChatGPT Enterprise: Revolutionize your Enterprise Data with ChatGPT: Next-gen Apps w/ Azure OpenAI and Cognitive Search – Microsoft Community Hub
- GPT4 Model: How to work with the GPT-35-Turbo and GPT-4 models — Azure OpenAI Service
Evaluating and monitoring models:
- Use Azure AI Evaluation SDK to view your model performance
- Enable Tracing to visualize you agents actions
- LangChain Lib: Evaluation — 🦜🔗
- Evals framework for evaluating LLMs and LLM systems
- Leverage Prompt Flow to evaluate your model
Responsible AI:
- Code of Conduct for the Azure OpenAI Service
- Data, privacy, and security for Azure OpenAI Service
- Transparency Note for Azure OpenAI Service
- Content Filtering: Azure OpenAI Content Filtering
- Microsoft Azure Legal Information
- Azure AI announces Prompt Shields for Jailbreak and Indirect prompt injection attacks – Our Azure OpenAI Service and Azure AI Content Safety teams are excited to launch a new Responsible AI capability called Prompt Shields. Prompt Shields protect applications, powered by Foundation Models, from two types of attacks: direct (jailbreak) and indirect attacks, both of which are now available in Public Preview.
AI Business Material:
Tooling:
- The Azure OpenAI benchmarking tool helps you test and measure the performance of your provisioned throughput deployments. These deployments give you a fixed amount of model compute, but the actual performance depends on factors like prompt size, generation size, and call rate. The tool sends test traffic to your deployment and shows you the throughput, latency, and utilization statistics. You can use it to try different traffic patterns and find the best settings for your prompt size, generation size, and PTUs.
Associate¶
- How to generate text with Azure OpenAI - Learn how to generate or manipulate text, including code with Azure OpenAI
- How to prepare a dataset for Azure OpenAI custom model training - Learn how to prepare your dataset for fine-tuning
- Semantic Kernel Library - .NET Code Snippets
- LLMOps - Operational capabilities and infrastructure required to fine-tune existing foundational models
- JARVIS - Collaborative system that uses an LLM as the controller
- Can ChatGPT work with your enterprise data? - Bring OpenAI’s ChatGPT model in Azure to your own enterprise-grade app experiences with precise control over the knowledge base, for in-context and relevant responses. Interact with your organization’s private internal data, while respecting the information protection controls put in place.
- DALL-E 3 - OpenAI’s DALL-E models generate images based on user-provided text prompts. This guide demonstrates how to use the DALL-E models and configure their options through REST API calls.
- Speech to text with the Azure OpenAI Whisper model
Past Events¶
- Microsoft AI Tour 2024 In-person
- The First Annual Microsoft Fabric Community Conference In-person March 26-28, 2024: See firsthand how Microsoft Fabric and the data and AI products at Microsoft can help your organization prepare for the era of AI. You’ll hear from leading Microsoft and community experts from around the world and receive hands-on experiences with the latest features from Microsoft Fabric, Power BI, Databases, Azure AI, Microsoft Purview, and more.
- Microsoft Ignite 2023: Watch the recordings for various sessions, covering updates on services, product announcements, and demos.
- Microsoft Build: Catch the recordings from the event. See Microsoft Build 2023 Recommended AI Session Guide
- Azure OpenAI What the Hack (WTH): This introductory hackathon will provide participants with hands-on experience on how to integrate the Azure OpenAI offering
Demos & Code Samples¶
- Azure AI Samples - This repository acts as the top-level directory for official Azure AI sample code and examples. It includes notebooks and sample code that contain end-to-end samples as well as smaller code snippets for common developer tasks
- Build and Deploy Production-Grade LangGraph Agent(s) on Azure
- Customer Service Conversational Insights with Azure OpenAI — Architecture Example
- OpenAI Use Cases & ChatGPT Demo
- AI-powered Call Center Architecture Example
- Business Process Automation Accelerator - Provides a no-code Studio for users to quickly build complex, multi-stage AI pipelines across multiple Azure AI and ML Services
- Microsoft Tech Community: Azure OpenAI (GPT) with Power Apps - Build a Power App to create a demo or Personal Knowledge Bot
- Build a low-code conversational SMS bot with Azure Communication Services & Azure OpenAI
- Q&A using Azure OpenAI & document’s vector embeddings
- Create a chatbot using enterprise data with DevOps best practices
Community Resources¶
- AI – Azure Platform Blog – Microsoft Community Hub
- AI – Azure AI Services Blog – Microsoft Community Hub
- Gen AI Ops Playbook - GenAIOps playbook of crowd-source materials to deploy your Gen AI apps to production
- Azure Samples
- Microsoft Q&A - Get answers to your questions using the tag: azure-openai
- OpenAI Python Library - examples · PyPI
- OpenAI Cookbook
- Awesome ChatGPT Prompts
- Tokenizer for Python & NodeJS
Interesting Reads¶
- New Microsoft Copilot Studio Implementation Guide
- Vector Similarity Search with Azure SQL database and OpenAI
- Using Microsoft Fabric’s Lakehouse Data and prompt flow in Azure Machine Learning Service to create RAG applications – Microsoft Fabric Blog
- Azure AI Search: Outperforming vector search with hybrid retrieval and ranking capabilities – Microsoft Community Hub
- Building GPT-3 applications — beyond the prompt