EADST

Save Hugging Face Model with One Bin

max_shard_size (int or str, optional, defaults to "10GB") — Only applicable for models. The maximum size for a checkpoint before being sharded. Checkpoints shard will then be each of size lower than this size. If expressed as a string, needs to be digits followed by a unit (like "5MB").

Based on the introduction, one bin model can be saved by changing the "max_shard_size".

LlamaForCausalLM.save_pretrained(base_model, output_dir, max_shard_size="100GB") # save one bin if the model is less than 100GB

Reference

PreTrainedModel

About Me
XD
Goals determine what you are going to be.
Category
标签云
HuggingFace 签证 Hungarian Distillation 域名 CLAP Random Rebuttal CC 云服务器 GPT4 Review Ubuntu Michelin GIT CUDA Web uwsgi VPN Hilton tar 飞书 Math 证件照 Quantize Permission 关于博主 Tensor Markdown BTC ModelScope 第一性原理 搞笑 Bitcoin Claude Windows Google Password Baidu Bipartite SAM BF16 DeepSeek llama.cpp Heatmap TSV Animate 净利润 算法题 LLM Qwen2 Django MD5 DeepStream Pytorch Template FP16 Plotly Input mmap Pickle Jev Vmess Qwen2.5 Knowledge COCO Algorithm Jupyter 论文速读 LoRA UNIX git-lfs Land Excel Logo Translation git Docker Nginx Paper Quantization Augmentation 多线程 XGBoost FastAPI GoogLeNet PDB SVR 财报 Website 个人博客 Mixtral RAR API网关 Tiktoken TensorFlow Jetson Transformers Magnet icon Miniforge Sklearn Linux 音频 VSCode logger Interview JSON v2ray Cloudreve 图标 Anaconda OCR Disk Git TTS torchinfo SQL CTC C++ 论文 Plate ms-swift FP32 Freesound ChatGPT PIP 版权 Search FP8 腾讯云 报税 API 强化学习 Vim Clash Github Agent Diagram EXCEL diffusers Statistics Proxy Base64 多进程 Datetime CSV Card Attention Image2Text CV printf Dataset Data Video 递归学习法 图形思考法 NameSilo Use VGG-16 RL Firewall Breakpoint Color Numpy InvalidArgumentError Shortcut OpenAI Llama Pandas Food Harness ONNX AI GPTQ 自我改进 PyTorch News RGB BeautifulSoup Conda Paddle GGML Hotel ResNet-50 顶会 FlashAttention Safetensors OpenCV FP64 NLTK SQLite CAM WAN v0.dev 继承 LeetCode Bert uWSGI Zip NLP IndexTTS2 SPIE Streamlit transformers QWEN Gemma WebCrawler hf HaggingFace Python 阿里云 Domain LaTeX Tracking PDF Crawler Qwen 公式 LLAMA PyCharm tqdm scipy 长期记忆 XML Pillow UI CEIR Bin YOLO Ptyhon TensorRT
站点统计

本站现有博文340篇,共被浏览1018369次

本站已经建立2718天!

热门文章
文章归档
回到顶部