Welcome to Olive’s documentation!

Important

Olive is currently under pre-release. There will be constant updates and improvements to the functions and usage. Feel free to give feedback and suggestions to us.

This document introduces Olive and provides some examples to get you started.

OVERVIEW

• Olive
• Quick Tour
• Olive Options

GET STARTED

• Installation
• Quickstart Examples

EXAMPLES

• Acceleration on CPU
• Acceleration on GPU
• Acceleration on NPU
• Acceleration on DPU

FEATURES

• Model Transformations and Optimizations
• Huggingface Model Optimization
• Packaging Olive artifacts
• Custom Scripts
• Azure ML integration

EXTENDING OLIVE

• Design
• How to add new optimization Pass

TUTORIALS

• How To Configure System
• How To Configure Metric
• How To Configure Pass
• How To Configure Data
• How To Set Model Path
• Advanced User Tour
• Self-hosted Kubernetes cluster
• Azure ML scripts

API REFERENCE

• OliveModels
• ResourcePath
• OliveSystems
• OliveEvaluator
• Metric
• SearchAlgorithms
• Engine
• Passes