EADST

ONNX Set Device ID with CUDA

ONNX Set the Device ID with CUDA

import onnxruntime as ort

model_path = ''

providers = [
    ('CUDAExecutionProvider', {
        'device_id': 0,
        'arena_extend_strategy': 'kNextPowerOfTwo',
        'gpu_mem_limit': 2 * 1024 * 1024 * 1024,
        'cudnn_conv_algo_search': 'EXHAUSTIVE',
        'do_copy_in_default_stream': True,
    }),
    'CPUExecutionProvider',
]

session = ort.InferenceSession(model_path, providers=providers)

Reference:

CUDA Execution Provider

相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
HuggingFace CV Attention FP32 Numpy git CUDA Cloudreve 证件照 ChatGPT Paper llama.cpp Web Disk RAR Bin XML MD5 Proxy Nginx Magnet Statistics BTC Translation DeepStream Docker transformers JSON BF16 Permission DeepSeek BeautifulSoup HaggingFace NameSilo Rebuttal Website AI 域名 Anaconda Pillow Image2Text EXCEL GPTQ Use Interview v2ray VGG-16 Bipartite UI Google Paddle Dataset WebCrawler Python PIP Freesound Tensor 关于博主 torchinfo PyCharm NLP Jetson Tiktoken SQLite 飞书 Hungarian ms-swift Template PyTorch 云服务器 Sklearn Zip Land Claude Math SPIE hf ResNet-50 Ptyhon Plate Vmess Plotly 财报 算法题 QWEN CLAP OCR GPT4 NLTK PDF Distillation Password PDB C++ Llama GGML Pandas TTS 公式 Algorithm SQL VPN 个人博客 Hilton uwsgi FlashAttention Qwen2.5 OpenAI git-lfs LeetCode Domain 论文速读 Markdown 递归学习法 Jev FP8 阿里云 报税 GoogLeNet Search 长期记忆 LLM Agent RL Git Pytorch Transformers XGBoost 自我改进 Heatmap tar ModelScope Card 净利润 Shortcut Color Jupyter Random Logo InvalidArgumentError Conda News 腾讯云 SAM Base64 音频 mmap FP64 Crawler Quantization 继承 顶会 SVR OpenCV v0.dev 图标 Harness LoRA 第一性原理 Streamlit CSV Django Data Gemma 论文 API网关 Tracking logger Bert COCO scipy Michelin 图形思考法 icon CC Github Video ONNX Pickle Breakpoint VSCode Qwen printf Mixtral Linux Firewall LaTeX diffusers CAM API Animate Baidu Diagram Ubuntu FP16 Food Review Miniforge Hotel uWSGI TensorFlow tqdm Safetensors LLAMA Clash IndexTTS2 Bitcoin Vim 多进程 GIT 多线程 FastAPI YOLO CTC 签证 Windows 搞笑 CEIR WAN Input TSV Augmentation Quantize Excel UNIX Knowledge Qwen2 强化学习 Datetime TensorRT 版权 RGB
站点统计

本站现有博文340篇,共被浏览1019363次

本站已经建立2719天!

热门文章
文章归档
回到顶部