<– Back to project listing
| Summary |
In this project, we will demonstrate how to use a Camera Serial Interface (CSI) Infrared (IR) Camera on the NVIDIA Jetson Nano with Microsoft Cognitive Services, Azure IoT Edge, and Azure IoT Central. This setup will allow us to accurately capture images at any time of day, to be analyzed in real-time using a custom object detection model with reporting to the cloud. Specifically, we will cover techniques in this article that will allow us to interact with the CSI hardware and access the host X11 windowing system from a containerized IoT Edge workload.
This will give us the baseline knowledge to modify an existing solution to operate with new hardware, namely the IMX219-77IR 8-Megapixels Infrared Night Vision IR Camera Module to allow consistent image capture regardless of lighting conditions. With our camera properly configured, we will then demonstrate how to apply a custom object detection model to the image stream. We will then package our application as a containerized IoT Edge deployment with reporting into Azure IoT Central.
At the end, you will leave with the knowledge to create an end-to-end edge-to-cloud object detection solution that can be modified to a variety of use cases.
|
| Software and Services used |
Hardware |
|
|
|
|
| Repository |
A full write-up on how to reproduce this project can be found here.
|
|
Future Improvements and Project Suggestions |
|
Readers are encouraged to innovate and improve the functionality of this project by modifying to their use case. If you are able to add support for additional image capture devices, leverage a new feature in DeepStream or IoT Central, or build a custom object detection model for something unique, please share your results in the comments!
|
| About the Creator |
 |
Paul DeCarlo is a Microsoft Cloud Advocate and Professor for the Bauer College of Business at the University of Houston. His current technology interests focus on Internet of Things, Cloud Applications, and development of AIOT solutions using small form-factor GPU accelerated IoT devices from NVIDIA. During time off, he enjoys taking care of his thirteen trees, riding mountain bikes, and taking care of his dog – Chief and cat - Kitty. You can learn more about what Paul is working on here.
|