EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2097

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Mixtral 音频 DeepStream Review git-lfs WebCrawler LLAMA 净利润 Use llama.cpp ModelScope Card Plate Shortcut ResNet-50 强化学习 transformers PyCharm Animate API Paddle Search Domain FP32 JSON Translation ChatGPT Python uwsgi Nginx Safetensors Llama Qwen2.5 RGB Qwen2 printf FastAPI CEIR Transformers Web UNIX CC GGML BTC Permission hf Django Vim GPT4 FP64 SQL Data v0.dev 多进程 ONNX 阿里云 CSV Math Github OpenAI Distillation logger CLAP PIP Streamlit 飞书 VPN 图标 Rebuttal FP16 Interview OpenCV Plotly OCR LLM Augmentation PDF Clash Michelin mmap PyTorch BeautifulSoup 递归学习法 scipy Tracking QWEN SPIE Pickle LaTeX SAM DeepSeek PDB WAN Image2Text 报税 Numpy GPTQ 算法题 Git 继承 icon Zip Attention Breakpoint Jetson Tiktoken v2ray HaggingFace UI Pandas HuggingFace 证件照 InvalidArgumentError 第一性原理 VGG-16 关于博主 NLP Datetime SQLite C++ Website TSV Anaconda Conda Quantization Excel Disk ms-swift git TTS Bipartite Bert 云服务器 签证 顶会 腾讯云 Logo Base64 Claude Food NameSilo uWSGI 域名 公式 LeetCode Agent Vmess VSCode FP8 tqdm Diagram FlashAttention Password Hilton Knowledge Gemma Markdown TensorFlow Docker XML Baidu diffusers Firewall Hotel Quantize tar Bin Random Video Qwen 多线程 GoogLeNet 版权 AI Hungarian CUDA XGBoost IndexTTS2 Template Color Tensor CAM Crawler Paper Pytorch MD5 RAR Windows Land Sklearn Google BF16 Proxy 财报 Magnet 论文速读 SVR Pillow YOLO News Jupyter CTC GIT Ptyhon Statistics TensorRT Bitcoin RL Dataset Algorithm COCO Input 论文 Linux 搞笑 NLTK torchinfo Miniforge Heatmap LoRA CV Freesound Cloudreve 图形思考法 EXCEL Ubuntu
站点统计

本站现有博文332篇,共被浏览875522次

本站已经建立2583天!

热门文章
文章归档
回到顶部