Ad

yolact_edge: Real-time Instance Segmentation on Edge Devices

YolactEdge enables real-time instance segmentation on small edge devices by optimizing the YOLACT architecture for efficiency. This repository offers implementations and evaluation code for the YolactEdge model, boasting impressive speed and accuracy on resource-constrained platforms.
Screenshot of WisconsinAIVision/yolact_edge homepage

YolactEdge is a novel implementation of the YOLACT instance segmentation approach specifically designed for deployment on edge devices. It achieves real-time performance (up to 30.8 FPS on a Jetson AGX Xavier) by leveraging optimized network structures and efficient inference techniques. The core focus of YolactEdge is to provide accurate and fast instance segmentation on hardware with limited computational resources. It facilitates efficient target object identifying and localization, making it ideal for embedded vision applications.

YolactEdge stands out due to its exceptional speed-accuracy trade-off, achieving real-time performance on edge devices while maintaining competitive segmentation accuracy. The project provides clear instructions for training and evaluation, and integrates with TensorRT for further optimization. It also features a user-friendly Colab notebook for quick experimentation and a focus on providing flexible options, including both standard and TensorRT inference modes.

  • Real-Time Performance: Achieves real-time instance segmentation on edge devices with up to 30.8 FPS on Jetson AGX Xavier.
  • TensorRT Integration: Includes support for TensorRT optimization to further enhance performance on NVIDIA hardware.
  • Flexible Training: Provides clear instructions and scripts for training YolactEdge models on custom datasets.
  • Comprehensive Evaluation: Offers a robust evaluation pipeline for assessing the performance of YolactEdge models.
  • Colab Notebooks: Includes interactive Colab notebooks for experimentation and quick demos.
  • Extensive Benchmarking: provides script for benchmarking the model computational performance.
  • Configurable Inference: Offers options for model customization to fit different accuracy and latency demands.

YolactEdge is an actively maintained project with a clear development roadmap. The repository includes comprehensive documentation, supporting scripts, and a vibrant community. Recent commits indicate continued development and bug fixes. The availability of thorough evaluation metrics and clear deployment guidelines confirms its reliability and potential for practical applications. It provides simple scripts to Run, Train and Evalulate the trained model

This project benefits researchers and developers seeking real-time instance segmentation solutions for edge devices. It addresses the need for efficient object detection in resource-constrained environments, suitable for applications like robotics, autonomous vehicles, and surveillance systems. By offering an optimized and well-documented implementation of YOLACT, YolactEdge reduces the barriers to deploying sophisticated computer vision capabilities on edge hardware.

Summarize:
Share:
Stars
1,321
Forks
274
Issues
77
Created
5 years ago
Commit
3 years ago
License
MIT
Archived
No
Updated 1 month ago

Similar Repositories