Olive

OVERVIEW

  • Olive
  • Quick Tour
  • Olive Options

GET STARTED

  • Installation
  • Quickstart Examples

EXAMPLES

  • Examples

OLIVE COMMANDS

  • Run
  • Finetune
  • Auto-Optimization
  • Quantization
  • Capture Onnx Graph
  • Generate Adapters
  • Convert Adapters
  • Tune OnnxRuntime Session Params
  • Qualcomm SDK
  • AzureML
  • Shared Cache
  • Providing Input Models

FEATURES

  • Azure ML integration
  • Huggingface Integration
  • LoRA Adapters
  • Packaging Olive artifacts
  • Shared Cache
  • Remote Workflow
  • Model Conversions
  • Model Quantizations
  • Model Transformations and Optimizations

EXTENDING OLIVE

  • Design
  • How to add new optimization Pass
  • Custom Scripts

TUTORIALS

  • How To Configure System
  • How To Configure Metric
  • How To Configure Auto Optimizer
  • How To Configure Pass
  • How To Configure Data
  • How To Set Model Path
  • Advanced User Tour
  • Self-hosted Kubernetes cluster
  • Azure ML scripts

API REFERENCE

  • OliveModels
  • ResourcePath
  • OliveSystems
  • OliveEvaluator
  • Metric
  • SearchAlgorithms
  • Engine
  • Passes
Olive
  • Overview: module code

All modules for which code is available

  • olive.azureml.azureml_client
  • olive.engine.config
  • olive.engine.engine
  • olive.evaluator.metric
  • olive.evaluator.metric_config
  • olive.evaluator.olive_evaluator
  • olive.hardware.accelerator
  • olive.model.config.model_config
  • olive.model.handler.composite
  • olive.model.handler.hf
  • olive.model.handler.onnx
  • olive.model.handler.openvino
  • olive.model.handler.pytorch
  • olive.model.handler.snpe
  • olive.passes.pytorch.lora
  • olive.resource_path
  • olive.strategy.search_strategy
  • olive.systems.azureml.aml_system
  • olive.systems.common
  • olive.systems.docker.docker_system
  • olive.systems.isolated_ort.isolated_ort_system
  • olive.systems.local
  • olive.systems.python_environment.python_environment_system
  • olive.systems.system_alias
  • olive.systems.system_config

© Copyright 2023, olivedevteam@microsoft.com.

Built with Sphinx using a theme provided by Read the Docs.