EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2207

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
PyTorch FP16 第一性原理 Qwen2.5 财报 多线程 Use printf Logo RL LLAMA Password Paddle Claude Input 净利润 阿里云 Sklearn Hungarian Bipartite Tracking CC v0.dev Pillow Github Image2Text Baidu llama.cpp Plotly Python Color C++ Template OCR Michelin NLTK Tiktoken CEIR Jetson 签证 Windows WAN DeepSeek XGBoost WebCrawler Algorithm Jupyter 算法题 Rebuttal hf transformers 飞书 Excel PDB RAR VPN Dataset Datetime 图形思考法 PDF LeetCode Distillation Plate Hotel tar GIT FP64 NLP FastAPI 继承 Attention Domain Firewall PyCharm 多进程 Video Animate Pytorch 论文 Transformers Search UI logger Shortcut ChatGPT Website Food Ubuntu Bert HuggingFace Gemma v2ray RGB scipy Interview Streamlit 公式 VSCode VGG-16 UNIX CAM Disk QWEN Quantization 关于博主 Cloudreve Vim Data Clash GPT4 Statistics LoRA ResNet-50 论文速读 diffusers Magnet torchinfo git Vmess 版权 Anaconda uWSGI Diagram Random Web Review 音频 Crawler OpenCV Llama TensorRT CSV GoogLeNet Augmentation Qwen2 Django 顶会 TTS CV 图标 TensorFlow 云服务器 Land Git Quantize 证件照 Base64 Mixtral mmap GPTQ Bin XML AI News ModelScope Markdown Pandas CTC ONNX Tensor DeepStream BF16 BeautifulSoup Translation InvalidArgumentError CLAP 腾讯云 报税 Heatmap Zip Ptyhon SPIE LaTeX 递归学习法 tqdm EXCEL git-lfs Agent IndexTTS2 YOLO Conda Card Qwen FlashAttention COCO 域名 搞笑 ms-swift 强化学习 Breakpoint Docker Math Google LLM Paper SAM SQL OpenAI Linux CUDA FP8 Numpy HaggingFace uwsgi TSV SVR icon Hilton Miniforge API JSON SQLite Proxy Knowledge GGML NameSilo PIP Permission Freesound BTC MD5 Pickle Nginx Bitcoin FP32 Safetensors
站点统计

本站现有博文333篇,共被浏览922193次

本站已经建立2628天!

热门文章
文章归档
回到顶部