EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
logger GIT NameSilo 个人博客 长期记忆 TTS EXCEL Hungarian Jev Diagram UNIX Template 云服务器 v2ray GGML C++ Pandas Dataset YOLO WebCrawler 多线程 Logo VPN Bitcoin Permission Plotly Land CC Excel transformers Password Web TensorFlow 报税 diffusers Search Rebuttal BF16 HaggingFace XGBoost llama.cpp SQL 图形思考法 ChatGPT Random Heatmap QWEN torchinfo LLAMA Website Use GPT4 Miniforge Attention Tracking API PDF 腾讯云 BeautifulSoup 域名 Cloudreve Clash Base64 Vim News icon Ptyhon 论文 Streamlit Breakpoint uWSGI Bipartite OpenCV FastAPI CTC 递归学习法 git-lfs OpenAI CEIR Harness PyTorch 第一性原理 Baidu NLTK Zip Numpy OCR Tiktoken 关于博主 Conda 论文速读 AI Firewall Michelin Pickle XML Bin uwsgi Plate COCO Qwen2 SVR Google Paddle 顶会 JSON Color FP32 Mixtral 多进程 GPTQ UI Food NLP 证件照 SQLite Bert Jupyter InvalidArgumentError 阿里云 Django ResNet-50 v0.dev Anaconda Magnet Github Quantize SPIE Transformers SAM Vmess CAM 继承 FP64 版权 FP16 Paper Translation Augmentation Linux Hotel RGB 搞笑 RL LLM FlashAttention FP8 tqdm PDB Pytorch TSV BTC Python Crawler Math Distillation 音频 Input ModelScope Hilton 自我改进 CV Markdown Interview Datetime Safetensors VSCode DeepStream RAR LeetCode Docker hf IndexTTS2 mmap 签证 Animate VGG-16 Jetson 强化学习 Agent DeepSeek Gemma Proxy ms-swift git Tensor Data TensorRT 图标 Sklearn Shortcut Card Llama MD5 GoogLeNet WAN Ubuntu LaTeX Video Disk scipy PIP API网关 HuggingFace Qwen Image2Text PyCharm Quantization CLAP Qwen2.5 Domain Review Claude 净利润 Statistics Git CUDA Windows 飞书 算法题 printf tar LoRA Knowledge Nginx Freesound 财报 Algorithm Pillow 公式 CSV ONNX
站点统计

本站现有博文340篇,共被浏览1017863次

本站已经建立2718天!

热门文章
文章归档
回到顶部