EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
WebCrawler llama.cpp Hungarian 公式 Git RGB Jev 论文 Clash Web 飞书 git-lfs 净利润 Algorithm 音频 Gemma Domain FP32 阿里云 Breakpoint CEIR Use Linux Color Bert Bipartite Bitcoin VSCode Plotly PDF PIP Hotel Quantization tar v0.dev ResNet-50 LoRA UNIX API BeautifulSoup QWEN FP16 HaggingFace Knowledge Heatmap CSV Michelin 证件照 云服务器 News Github Vim Django 递归学习法 TSV 图形思考法 Pytorch LLAMA 多进程 SQL Conda Qwen2 transformers Proxy Interview DeepSeek SPIE Translation ONNX 报税 Template Pillow tqdm Card hf Freesound Pickle C++ Attention Quantize Baidu Excel ms-swift Website uWSGI FP8 Food Jupyter Permission Jetson CLAP UI FastAPI 财报 CV LaTeX OCR XGBoost 腾讯云 uwsgi 域名 NameSilo 签证 LLM LeetCode CUDA 第一性原理 Miniforge NLTK Logo 多线程 IndexTTS2 RAR NLP Zip PDB Paddle Statistics Docker Crawler VPN scipy v2ray HuggingFace API网关 Land BTC CC BF16 Tracking Tensor Windows FlashAttention 算法题 Pandas Input Bin 图标 Claude Base64 Tiktoken 关于博主 Shortcut Google Review SVR OpenAI Rebuttal GPT4 Search icon JSON printf TTS Markdown FP64 Image2Text logger Hilton 版权 Data CTC Mixtral Safetensors Datetime Magnet GoogLeNet VGG-16 Streamlit RL Disk 强化学习 TensorRT git Distillation Cloudreve Paper Random Transformers Ptyhon Math GGML Ubuntu OpenCV PyCharm AI SQLite COCO Python diffusers Video SAM DeepStream EXCEL Llama 继承 Sklearn GIT Firewall Dataset mmap Animate Diagram 搞笑 Anaconda Plate XML Password PyTorch CAM ModelScope GPTQ MD5 TensorFlow 论文速读 Nginx Qwen Agent torchinfo Numpy YOLO Augmentation Harness 顶会 Qwen2.5 ChatGPT InvalidArgumentError Vmess WAN
站点统计

本站现有博文337篇,共被浏览961435次

本站已经建立2673天!

热门文章
文章归档
回到顶部