EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
OCR Qwen2.5 tar Math UNIX Datetime CSV transformers VGG-16 TensorFlow BF16 阿里云 Cloudreve Hilton FP8 Llama Jupyter Mixtral Translation Jetson 证件照 搞笑 Tiktoken SPIE YOLO git-lfs OpenCV LLM git FastAPI Data Django Color TTS Dataset Breakpoint Use Vim DeepSeek TensorRT Agent ResNet-50 Bin Heatmap Bert Website 云服务器 llama.cpp Augmentation printf Ptyhon Markdown Animate 论文 Search Tensor GIT Template BTC diffusers Gemma Plotly logger Image2Text Disk Distillation scipy Git Proxy Input WAN Base64 Miniforge uWSGI 图形思考法 NLTK CEIR API IndexTTS2 公式 Claude SAM v0.dev hf 飞书 QWEN 关于博主 CTC Magnet Google Ubuntu Attention XGBoost SQLite PyCharm v2ray CC LeetCode Land Logo LaTeX Pandas Zip Password MD5 Interview ONNX torchinfo Diagram FP16 强化学习 VPN 域名 BeautifulSoup Conda 算法题 CAM Hungarian 继承 Permission JSON Crawler Transformers Bitcoin Quantization FP64 PIP PyTorch tqdm UI C++ Numpy PDF 顶会 Video TSV Sklearn LoRA Michelin Freesound Random Shortcut Pytorch CLAP Tracking Python Card Docker 财报 Nginx Domain GGML mmap Quantize FP32 NLP 报税 Qwen2 Baidu GPT4 Food LLAMA WebCrawler HuggingFace GPTQ Linux SQL Pillow 腾讯云 Excel EXCEL Pickle Paper Windows 签证 Knowledge Plate 图标 ModelScope Bipartite uwsgi FlashAttention Firewall Rebuttal 音频 净利润 CV CUDA Github HaggingFace OpenAI Clash 论文速读 RGB Web GoogLeNet PDB COCO Streamlit Statistics VSCode Vmess SVR Algorithm NameSilo InvalidArgumentError Anaconda Hotel Paddle 多进程 版权 多线程 递归学习法 AI Safetensors RAR 第一性原理 News Review DeepStream icon ChatGPT Qwen XML
站点统计

本站现有博文327篇,共被浏览833206

本站已经建立2538天!

热门文章
文章归档
回到顶部