EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
CTC Firewall git-lfs 图形思考法 Bitcoin GoogLeNet SPIE ModelScope Markdown Password Cloudreve COCO Plate 强化学习 Baidu Website OpenCV 音频 Qwen2 公式 Crawler Shortcut Sklearn FP16 Gemma transformers PDF GPT4 XML Animate CSV Vmess CAM Tensor torchinfo HaggingFace Breakpoint 图标 算法题 FP64 论文速读 v0.dev 多线程 Miniforge Domain Base64 Datetime Land mmap PyTorch EXCEL Review Attention Quantization BeautifulSoup QWEN Mixtral Logo diffusers BF16 VPN OpenAI Distillation Knowledge Data Paddle Anaconda 顶会 News Clash Search DeepStream CUDA hf NLTK Docker Augmentation VGG-16 Interview Math WebCrawler Ubuntu 版权 LoRA 阿里云 Card VSCode DeepSeek Statistics Ptyhon Hilton NLP Freesound MD5 Python Excel 第一性原理 AI Use 净利润 Pandas 搞笑 ms-swift Diagram CEIR 域名 Proxy 云服务器 IndexTTS2 LLM UNIX Rebuttal Permission CV RL PDB Google FlashAttention Hungarian Tiktoken RAR Vim ONNX Dataset Plotly OCR Nginx Template FP32 TTS CC Disk Food 报税 Streamlit Image2Text Heatmap LeetCode Paper Safetensors Pillow uWSGI JSON NameSilo Pytorch SQL Claude InvalidArgumentError printf 证件照 YOLO Random SVR FastAPI BTC Hotel Git Jupyter Pickle Input Bert WAN 继承 HuggingFace TSV 财报 递归学习法 XGBoost SQLite logger CLAP Conda git tar Magnet ChatGPT LLAMA Qwen2.5 Tracking RGB GGML Color TensorFlow Quantize Llama 腾讯云 scipy UI 论文 Transformers Zip Jetson Qwen Django Bin tqdm v2ray Web 关于博主 Windows 签证 GPTQ Algorithm LaTeX 飞书 Bipartite Agent Github llama.cpp ResNet-50 PyCharm GIT Translation uwsgi Numpy Video TensorRT SAM Michelin C++ API 多进程 FP8 Linux icon PIP
站点统计

本站现有博文332篇,共被浏览875539

本站已经建立2583天!

热门文章
文章归档
回到顶部