Olive
0.2.1

OVERVIEW

  • Olive
  • Quick Tour
  • Olive Options

GET STARTED

  • Installation
  • Quickstart Examples

EXAMPLES

  • Acceleration on CPU
  • Acceleration on GPU
  • Acceleration on NPU

TUTORIALS

  • Design
  • Configuring OliveSystem
  • Configuring Metric
  • Configuring Pass
  • Configuring HW-dependent optimizations
    • ONNX related – General
    • PyTorch related – General
    • OpenVINO related – Intel HW
    • SNPE related – Qualcomm HW
  • Advanced User Tour
  • How to write user_script
  • my_script.py
  • You can use file module here
  • Packaging Olive artifacts
  • How to add new optimization Pass

API REFERENCE

  • OliveModels
  • OliveSystems
  • OliveEvaluator
  • Metric
  • SearchAlgorithms
  • Engine
  • Passes
Olive
  • Configuring HW-dependent optimizations
  • View page source

Configuring HW-dependent optimizations¶

  • ONNX related – General
    • Model Conversion
    • Model Optimizer
    • ORT Transformers Optimization
    • Append Pre/Post Processing Ops
    • Insert Beam Serch Op
    • Post Training Quantization (PTQ)
    • ORT Performance Tuning
    • Float16 Conversion
    • Mixed Precision Conversion
  • PyTorch related – General
    • Quantization Aware Training
  • OpenVINO related – Intel HW
    • Prerequisites
    • Model Conversion
    • Post Training Quantization (PTQ)
  • SNPE related – Qualcomm HW
    • Prerequisites
    • Model Conversion
    • Post Training Quantization (PTQ)
Previous Next

© Copyright 2023, olivedevteam@microsoft.com.

Built with Sphinx using a theme provided by Read the Docs.