EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
Bin PDF Jetson git-lfs Numpy Mixtral TensorRT Miniforge LLAMA HaggingFace Tensor Pillow tqdm ONNX DeepStream Bert Vim Domain Heatmap LaTeX Ubuntu transformers Permission Interview Qwen2 logger Gemma Freesound Qwen2.5 CAM 阿里云 Bitcoin Paper BTC NameSilo Cloudreve Pytorch Template TensorFlow Transformers Random PyCharm CV Web diffusers Data 第一性原理 GGML Vmess FP16 PDB AI Animate Django Python Excel BeautifulSoup VGG-16 LLM TSV Dataset CEIR Augmentation COCO Image2Text C++ 飞书 CSV 搞笑 Anaconda 财报 FP8 JSON hf Input Agent Clash WebCrawler OpenAI UI Conda LoRA Baidu FP64 Password Tiktoken RAR Hilton tar SVR git Jupyter YOLO v0.dev uwsgi Ptyhon SQL GPTQ Docker Safetensors Math Bipartite Qwen TTS 多进程 NLP v2ray Pandas InvalidArgumentError 云服务器 Llama FastAPI LeetCode Paddle 图形思考法 Video Github SAM Algorithm Diagram 净利润 CC UNIX scipy Hungarian Pickle 图标 Translation ChatGPT Tracking BF16 llama.cpp FlashAttention XML Website VPN Linux NLTK CLAP Crawler Card Claude Land GoogLeNet Food 音频 IndexTTS2 版权 Markdown 报税 GPT4 torchinfo OpenCV ModelScope Proxy WAN API Search CUDA Zip Color 腾讯云 SPIE Windows CTC Nginx MD5 SQLite Review Michelin 继承 News PyTorch Git PIP ResNet-50 icon QWEN Quantization 算法题 OCR Shortcut Attention Streamlit Rebuttal FP32 签证 关于博主 Use Distillation 域名 Quantize Plate Datetime RGB VSCode printf GIT 多线程 uWSGI Statistics Sklearn Knowledge Magnet mmap 递归学习法 顶会 Disk 证件照 Google Breakpoint Plotly Firewall Logo DeepSeek XGBoost EXCEL Hotel 公式 Base64 强化学习 HuggingFace
站点统计

本站现有博文323篇,共被浏览795709

本站已经建立2493天!

热门文章
文章归档
回到顶部