EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1896

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Qwen2.5 TensorFlow ONNX Interview scipy BTC Attention NameSilo Template Input Mixtral Clash logger transformers v0.dev Nginx UNIX 多进程 YOLO Django Baidu Image2Text Agent DeepStream 多线程 Gemma Freesound NLTK 图标 Transformers Windows HaggingFace Base64 Qwen 关于博主 HuggingFace Hotel 云服务器 Color Firewall RAR FastAPI GIT RGB EXCEL Statistics TensorRT LoRA AI Quantize LeetCode SPIE Shortcut CC 飞书 Card Github mmap SVR CSV Breakpoint Bert Logo API Search OpenAI Bitcoin Jupyter LaTeX Heatmap Domain icon CEIR WAN Safetensors FP64 报税 UI VSCode SAM Bipartite Animate InvalidArgumentError XGBoost Review uwsgi ModelScope Cloudreve Math torchinfo PIP News Plotly 搞笑 腾讯云 Pickle uWSGI 图形思考法 Algorithm PyTorch NLP MD5 GoogLeNet Plate Bin Dataset Video Translation TTS CLAP Website 版权 hf Pandas Password Anaconda Quantization GGML Permission Docker PyCharm 继承 PDF Disk 强化学习 Google COCO Git VGG-16 FlashAttention XML Magnet Qwen2 PDB tar Conda LLAMA OCR Web Michelin printf 第一性原理 WebCrawler DeepSeek git Sklearn 域名 ChatGPT 递归学习法 Markdown LLM Pillow Hungarian Python 公式 JSON Ptyhon Distillation Data CTC Llama Vmess Tracking SQLite Pytorch CAM Hilton Knowledge CV Random BF16 Land Jetson 算法题 SQL Use Claude Tiktoken Proxy Food 阿里云 llama.cpp Linux tqdm CUDA diffusers VPN BeautifulSoup FP16 Excel 财报 OpenCV Streamlit Vim 净利润 Tensor IndexTTS2 签证 QWEN GPT4 Augmentation Numpy Zip Datetime 音频 Diagram git-lfs 顶会 FP32 GPTQ Paper 证件照 Ubuntu Crawler FP8 Rebuttal TSV v2ray C++ Miniforge Paddle ResNet-50
站点统计

本站现有博文323篇,共被浏览795365次

本站已经建立2493天!

热门文章
文章归档
回到顶部