Data Pipeline

Robot-to-cloud data capture pipeline for recording, compressing, and uploading robotic training episodes. This section covers recording configuration, edge device setup, and data flow from ROS 2 nodes to Azure storage.

📖 Guides

Guide	Description
Chunking and Compression Configuration	Configure bag chunking thresholds and zstd compression for ROS 2 edge recording on Jetson devices

🏗️ Architecture

data-pipeline/
├── capture/
│   ├── config/          # Recording configuration and schema
│   ├── models/          # Pydantic config models
│   └── tests/           # Config model tests
├── setup/               # Arc agent setup scripts
└── specifications/      # Domain specifications