EADST

Jetson Check GPU Memory Usage with C++

Jetson Check GPU Memory Usage with C++

#include < iostream>
#include < unistd.h>
#include "cuda.h"

int main()
{
    // show memory usage of GPU
    size_t free_byte ;
    size_t total_byte ;

    while (true )
    {
        cudaError_t cuda_status = cudaMemGetInfo( &free_byte, &total_byte ) ;

        if ( cudaSuccess != cuda_status ){
            std::cout << "Error: cudaMemGetInfo fails, " << cudaGetErrorString(cuda_status) << std::endl;
            exit(1);
        }

        double free_db = (double)free_byte ;
        double total_db = (double)total_byte ;
        double used_db = total_db - free_db ;

        std::cout << "GPU memory usage: used = " << used_db/1024.0/1024.0 << ", free = "
                  << free_db/1024.0/1024.0 << " MB, total = " << total_db/1024.0/1024.0 << " MB" << std::endl;
        sleep(1);
    }

    return 0;
}

Reference

Nvidia Forums

相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
Proxy Food DeepSeek UNIX COCO 签证 Quantize Linux printf FP8 ms-swift Attention Statistics Anaconda Tiktoken CAM 版权 论文速读 BF16 Distillation Rebuttal Plate Use Magnet API Data Numpy Color tar Docker FastAPI Plotly Google Conda 第一性原理 Baidu Land Password IndexTTS2 icon ChatGPT ModelScope TTS torchinfo Permission Paper UI 论文 OCR 图标 Math Vim Pickle RAR PyCharm FP32 Quantization Animate C++ HaggingFace Hilton CLAP PyTorch GPTQ 云服务器 公式 Domain EXCEL Michelin XGBoost WebCrawler Review LLAMA CC SQL Mixtral Llama Augmentation Qwen Heatmap RGB Windows 关于博主 Harness Bitcoin SVR NLP logger SPIE Translation Cloudreve HuggingFace LaTeX AI BeautifulSoup SQLite 阿里云 Input JSON Github Bipartite Firewall LeetCode RL Web Tensor Python Zip 搞笑 PIP Agent 音频 uwsgi Django GIT git uWSGI Disk llama.cpp 递归学习法 Datetime Interview Image2Text 自我改进 Bert Safetensors Clash Claude Video Pytorch Ubuntu Jetson QWEN 长期记忆 DeepStream GPT4 Pillow VSCode Jupyter Bin InvalidArgumentError Git transformers Shortcut PDB Crawler Hotel NLTK API网关 Template Jev 图形思考法 顶会 算法题 Qwen2.5 OpenCV YOLO FlashAttention mmap Website VGG-16 腾讯云 scipy TensorRT Base64 报税 多线程 v2ray diffusers FP16 财报 Markdown GGML WAN Knowledge v0.dev ResNet-50 TSV Tracking Gemma ONNX BTC Freesound 多进程 域名 Logo CEIR Algorithm Vmess Streamlit Random XML OpenAI Search Transformers Paddle git-lfs Breakpoint 个人博客 CV 净利润 TensorFlow Excel 继承 VPN 飞书 hf Dataset LoRA tqdm Sklearn NameSilo MD5 CSV 证件照 LLM Pandas GoogLeNet Miniforge 强化学习 News PDF Card Nginx CUDA CTC FP64 SAM Diagram Hungarian Qwen2 Ptyhon
站点统计

本站现有博文340篇,共被浏览1019291次

本站已经建立2719天!

热门文章
文章归档
回到顶部