EADST

Building llama.cpp

Building for CPU

The CPU build is straightforward and works on any system with a modern C++ compiler. Here's how to do it:

cmake -B build
cmake --build build --config Release

Building with CUDA

If you have an NVIDIA GPU, you can build llama.cpp with CUDA support for significantly faster inference:

cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release -j 32

-DGGML_CUDA=ON enables CUDA support

-j 32 enables parallel compilation with 32 threads to speed up the build process

Reference

Build llama.cpp locally

相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
printf Permission Domain ResNet-50 Streamlit Michelin Input CV Bitcoin Translation 云服务器 AI COCO Image2Text Miniforge Django SPIE Search Algorithm Distillation API Conda TTS FastAPI Heatmap Llama TensorFlow 图形思考法 Shortcut 净利润 WebCrawler Vmess 签证 SQL LeetCode Tiktoken Web FP8 Jev FP32 UNIX 个人博客 GIT 自我改进 Dataset 阿里云 Hilton CUDA Anaconda Quantization LoRA SAM Clash GoogLeNet Sklearn Pickle 版权 Cloudreve Magnet Land TensorRT Datetime Website Card Animate Google InvalidArgumentError Paddle Freesound PyCharm 证件照 论文 Diagram 搞笑 腾讯云 Qwen2.5 关于博主 mmap VPN torchinfo JSON BTC OCR Quantize DeepStream ms-swift News logger 多进程 Statistics llama.cpp Qwen2 Qwen 报税 CEIR Zip Agent CTC HaggingFace uWSGI BF16 Password CC EXCEL CLAP v0.dev Jetson NameSilo Python NLTK Pillow MD5 tqdm VSCode IndexTTS2 Harness 音频 CSV Tracking YOLO Hungarian FP64 Bin Template UI Markdown RL Ptyhon OpenAI Claude Bipartite Nginx Plotly 飞书 Transformers PIP Firewall XGBoost Excel Logo DeepSeek LaTeX BeautifulSoup uwsgi Jupyter TSV Random Crawler SQLite 公式 Safetensors git-lfs RAR C++ VGG-16 Bert hf 长期记忆 Video LLM 继承 Proxy FlashAttention Pytorch 图标 Tensor Git tar Plate Vim Mixtral Attention Review git OpenCV HuggingFace Math Numpy GPT4 GGML API网关 算法题 Ubuntu WAN FP16 Github QWEN Data Knowledge diffusers Disk 多线程 RGB Hotel Augmentation icon Docker Linux PyTorch Paper ONNX CAM 第一性原理 Food Breakpoint v2ray NLP 强化学习 Windows 顶会 Base64 PDF LLAMA 论文速读 SVR Pandas Color GPTQ PDB Rebuttal ChatGPT 财报 Interview 递归学习法 transformers Baidu Gemma XML 域名 Use ModelScope scipy
站点统计

本站现有博文340篇,共被浏览1018365次

本站已经建立2718天!

热门文章
文章归档
回到顶部