Olive
0.2.1

OVERVIEW

  • Olive
  • Quick Tour
  • Olive Options

GET STARTED

  • Installation
  • Quickstart Examples

EXAMPLES

  • Acceleration on CPU
  • Acceleration on GPU
  • Acceleration on NPU

TUTORIALS

  • Design
  • Configuring OliveSystem
  • Configuring Metric
  • Configuring Pass
  • Configuring HW-dependent optimizations
  • Advanced User Tour
  • How to write user_script
  • my_script.py
  • You can use file module here
  • Packaging Olive artifacts
  • How to add new optimization Pass

API REFERENCE

  • OliveModels
  • OliveSystems
  • OliveEvaluator
  • Metric
  • SearchAlgorithms
  • Engine
  • Passes
Olive
  • Acceleration on CPU
  • View page source

Acceleration on CPU¶

Whisper optimization with PTQ and pre/post processing

BERT optimization with Intel® Neural Compressor Post Training quantization

BERT optimization with QAT Customized Training Loop

ResNet optimization with QAT Default Training Loop

ResNet optimization with QAT PyTorch Lightning Module

ResNet optimization with PTQ using Vitis-AI

Cifar10 optimization with OpenVINO for Intel HW

Acceleration on GPU¶

SqueezeNet latency optimization with DirectML

Stable Diffusion optimization with DirectML

Dolly V2 optimization with DirectML

Acceleration on NPU¶

Inception model optimization on Qualcomm NPU

Previous Next

© Copyright 2023, olivedevteam@microsoft.com.

Built with Sphinx using a theme provided by Read the Docs.