Skip to main content

Releasing SuperBench v0.4

· One min read
Peng Cheng
Peng Cheng
SuperBench Team

We are very happy to announce that SuperBench 0.4.0 version is officially released today!

You can install and try superbench by following Getting Started Tutorial.

SuperBench 0.4.0 Release Notes#

SuperBench Framework#

Monitor#

  • Add monitor framework for NVIDIA GPU, CPU, memory and disk.

Data Diagnosis and Analysis#

  • Support baseline-based data diagnosis.
  • Support basic analysis feature (boxplot figure, outlier detection, etc.).

Single-node Validation#

Micro Benchmarks#

  • CPU Memory Validation (tool: Intel Memory Latency Checker).
  • GPU Copy Bandwidth (tool: built by MSRA).
  • Add ORT Model on AMD GPU platform.
  • Add inference backend TensorRT.
  • Add inference backend ORT.

Multi-node Validation#

Micro Benchmarks#

  • IB Networking validation.
  • TCP validation (tool: TCPing).
  • GPCNet Validation (tool: GPCNet).

Other Improvement#

  1. Enhancement

    • Add pipeline for AMD docker.
    • Integrate system config info script with SuperBench.
    • Support FP32 mode without TF32.
    • Refine unit test for microbenchmark.
    • Unify metric names for all benchmarks.

  2. Document

    • Add benchmark list
    • Add monitor document
    • Add data diagnosis document