EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
C++ LLM Pickle FP8 NLP logger Plate Google CTC 签证 MD5 Michelin Qwen2 Interview News Tensor Vmess Animate Zip NLTK DeepStream Hotel 关于博主 Password uwsgi NameSilo Datetime Nginx UNIX WebCrawler FP16 QWEN diffusers IndexTTS2 CAM Jupyter Data XGBoost Cloudreve LLAMA 财报 VGG-16 Markdown llama.cpp Quantization Domain Hungarian TensorFlow Streamlit tar Jetson BF16 Git OpenCV Qwen Linux Attention SVR SQLite 证件照 Mixtral Proxy 第一性原理 Pandas ModelScope YOLO Sklearn PyTorch Plotly Hilton Magnet Claude Disk Excel BeautifulSoup torchinfo Pillow Bipartite Use 版权 Knowledge Windows ms-swift Food Agent Tiktoken Card UI Ptyhon Bert 云服务器 CEIR PDF mmap SPIE scipy 强化学习 Paddle Clash DeepSeek Input GPT4 CV PDB Github GIT Numpy OpenAI hf RGB TTS transformers JSON ResNet-50 Miniforge 论文速读 HuggingFace RL TensorRT WAN 报税 Baidu Augmentation 算法题 Freesound CSV 腾讯云 Permission FP64 图标 递归学习法 Algorithm XML Qwen2.5 printf 多进程 LoRA 音频 Video Docker ONNX tqdm TSV LaTeX Safetensors git ChatGPT Tracking 论文 公式 HaggingFace GoogLeNet Diagram Firewall GPTQ Transformers v2ray 净利润 SQL FP32 Llama RAR SAM 飞书 Base64 Math Land EXCEL PyCharm Rebuttal git-lfs FastAPI Bitcoin InvalidArgumentError Quantize Heatmap Vim 域名 Image2Text Shortcut Django BTC Web Dataset VPN GGML COCO Distillation icon 顶会 Conda Pytorch CC Breakpoint Gemma FlashAttention AI 继承 API OCR 阿里云 搞笑 CLAP Template Bin Color Website v0.dev Anaconda 多线程 Ubuntu Python Crawler Statistics uWSGI Search Review CUDA PIP LeetCode Random Logo Paper 图形思考法 VSCode Translation
站点统计

本站现有博文333篇,共被浏览922145

本站已经建立2628天!

热门文章
文章归档
回到顶部