Ctrl+K
🚀Promptflow 1.13.0 has released! Try new feature: tracing interaction with LLMs.
Prompt flow Prompt flow

Prompt flow

Site Navigation

  • How-to Guides
  • Tutorials
  • Concepts
  • Reference
  • Cloud
  • Integrations

Site Navigation

  • How-to Guides
  • Tutorials
  • Concepts
  • Reference
  • Cloud
  • Integrations

Section Navigation

Command Line Interface

  • pf
  • pfazure

Python Library ChangeLog

  • promptflow package
    • promptflow-azure package
    • promptflow-core package
    • promptflow-devkit package
    • Release History
    • promptflow-rag package
    • promptflow-tracing package

Python Library Reference

  • promptflow-tracing package
    • promptflow.tracing module
      • promptflow.tracing.contracts module
        • promptflow.tracing.contracts.context_manager_proxy module
        • promptflow.tracing.contracts.iterator_proxy module
        • promptflow.tracing.contracts.trace module
  • promptflow-core package
    • promptflow.connections module
    • promptflow.contracts module
      • promptflow.contracts.flow module
      • promptflow.contracts.multimedia module
      • promptflow.contracts.run_info module
      • promptflow.contracts.run_mode module
      • promptflow.contracts.tool module
      • promptflow.contracts.types module
    • promptflow.core module
    • promptflow.executor module
      • promptflow.executor.flow_executor module
      • promptflow.executor.flow_validator module
    • promptflow.integrations module
      • promptflow.integrations.langchain module
    • promptflow.storage module
      • promptflow.storage.run_records module
    • promptflow.constants module
    • promptflow.exceptions module
  • promptflow-devkit package
    • promptflow.batch module
    • promptflow.client module
    • promptflow.entities module
    • promptflow.operations module
  • promptflow-azure package
    • promptflow.azure module
      • promptflow.azure.operations module
  • promptflow-rag package
    • promptflow.rag module
      • promptflow.rag.config module
      • promptflow.rag.constants module
  • promptflow-evals package
    • promptflow.evals module
      • promptflow.evals.evaluate module
      • promptflow.evals.evaluators module
      • promptflow.evals.synthetic module
        • promptflow.evals.synthetic.adversarial_scenario module
        • promptflow.evals.synthetic.adversarial_simulator module
        • promptflow.evals.synthetic.direct_attack_simulator module
        • promptflow.evals.synthetic.xpia_simulator module

Tool Reference

  • LLM
  • LLM Vision
  • Prompt
  • Python
  • SerpAPI
  • Faiss Index Lookup
  • Vector DB Lookup
  • Embedding
  • Open Model LLM
  • OpenAI GPT-4V
  • Content Safety (Text)
  • Azure OpenAI GPT-4 Turbo with Vision
  • Rerank

YAML Schema

  • Flow YAML Schema
  • Run YAML Schema

Trace Specification

  • Trace Span Specification

promptflow.evals module#

Subpackages#

  • promptflow.evals.evaluate module
  • promptflow.evals.evaluators module
  • promptflow.evals.synthetic module
    • Submodules
      • promptflow.evals.synthetic.adversarial_scenario module
      • promptflow.evals.synthetic.adversarial_simulator module
      • promptflow.evals.synthetic.direct_attack_simulator module
      • promptflow.evals.synthetic.xpia_simulator module

previous

promptflow-evals package

next

promptflow.evals.evaluate module
On this page
  • Subpackages
Edit this page

© Copyright 2024, Microsoft.

Created using Sphinx 5.1.0.