Azure OpenAI GPT-4 Turbo with Vision#

Introduction#

Azure OpenAI GPT-4 Turbo with Vision tool enables you to leverage your AzureOpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them.

Prerequisites#

  • Create AzureOpenAI resources

    Create Azure OpenAI resources with instruction

  • Create a GPT-4 Turbo with Vision deployment

    Browse to Azure OpenAI Studio and sign in with the credentials associated with your Azure OpenAI resource. During or after the sign-in workflow, select the appropriate directory, Azure subscription, and Azure OpenAI resource.

    Under Management select Deployments and Create a GPT-4 Turbo with Vision deployment by selecting model name: gpt-4 and model version vision-preview.

Connection#

Setup connections to provisioned resources in prompt flow.

Type

Name

API KEY

API Type

API Version

AzureOpenAI

Required

Required

Required

Required

Inputs#

Name

Type

Description

Required

connection

AzureOpenAI

the AzureOpenAI connection to be used in the tool

Yes

deployment_name

string

the language model to use

Yes

prompt

string

The text prompt that the language model will use to generate it’s response.

Yes

max_tokens

integer

the maximum number of tokens to generate in the response. Default is 512.

No

temperature

float

the randomness of the generated text. Default is 1.

No

stop

list

the stopping sequence for the generated text. Default is null.

No

top_p

float

the probability of using the top choice from the generated tokens. Default is 1.

No

presence_penalty

float

value that controls the model’s behavior with regards to repeating phrases. Default is 0.

No

frequency_penalty

float

value that controls the model’s behavior with regards to generating rare phrases. Default is 0.

No

detail

string

configure how the model interprets and processes images, default is “auto”. Read more

No

Outputs#

Return Type

Description

string

The text of one response of conversation