High-level interface for C++/Python. Simplify the implementation of the custom plugin. And serialization and deserialization have been encapsulated for easier usage. Simplify the compilation of fp32, fp16 and int8 for facilitating the deployment with C++/Python in server or embedded device. Models ready for use also with examples are RetinaFace, Scrfd, YoloV5, YoloX, Arcface, AlphaPose, CenterNet and DeepSORT(C++).

Features

  • Yolov7 support
  • Released python solution for hardware decoding with tensorRT integration
  • Docker Image has been released
  • tensorRT_Pro_comments_version(co-contributing version) is also provided for a better learning experienc
  • yolov5-1.0-6.0/master are supported
  • Tutorial for exporting CenterNet from pytorch to tensorRT

Project Samples

TensorRT Pro Screenshot 1

Project Activity

See All Activity >

Categories

Libraries, Machine Learning

License

MIT License

Follow TensorRT Pro

TensorRT Pro Web Site

Other Useful Business Software
Host LLMs in Production With On-Demand GPUs Icon
Host LLMs in Production With On-Demand GPUs

NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
Try Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of TensorRT Pro!

Additional Project Details

Programming Language

C++

Related Categories

C++ Libraries, C++ Machine Learning Software

Registered

2022-08-19
Report inappropriate content