Olive

OVERVIEW

  • Olive
  • Quick Tour
  • Olive Options

GET STARTED

  • Installation
  • Quickstart Examples
    • BERT optimization with PTQ on CPU
    • ResNet optimization with PTQ on CPU

EXAMPLES

  • Examples

OLIVE COMMANDS

  • Run
  • Finetune
  • Auto-Optimization
  • Quantization
  • Capture Onnx Graph
  • Generate Adapters
  • Convert Adapters
  • Tune OnnxRuntime Session Params
  • Generate Cost Model for Model Splitting
  • Qualcomm SDK
  • AzureML
  • Shared Cache
  • Providing Input Models
  • Model Script File Information

FEATURES

  • Azure ML integration
  • Huggingface Integration
  • LoRA Adapters
  • Packaging Olive artifacts
  • Shared Cache
  • Remote Workflow
  • Model Conversions
  • Model Quantizations
  • Model Transformations and Optimizations
  • Model Splitting

EXTENDING OLIVE

  • Design
  • How to add new optimization Pass
  • Custom Scripts

TUTORIALS

  • How To Configure System
  • How To Configure Metric
  • How To Configure Auto Optimizer
  • How To Configure Pass
  • How To Configure Data
  • How To Set Model Path
  • Advanced User Tour
  • Self-hosted Kubernetes cluster
  • Azure ML scripts

API REFERENCE

  • OliveModels
  • ResourcePath
  • OliveSystems
  • OliveEvaluator
  • Metric
  • SearchAlgorithms
  • Engine
  • Passes
Olive
  • Quickstart Examples
  • View page source

Quickstart Examples

  • BERT optimization with PTQ on CPU
  • ResNet optimization with PTQ on CPU
Previous Next

© Copyright 2023, olivedevteam@microsoft.com.

Built with Sphinx using a theme provided by Read the Docs.