EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1984

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
tqdm 多线程 Numpy git-lfs LoRA ONNX VGG-16 CTC 图标 scipy Ubuntu Excel Web Python Translation LaTeX Permission FP32 Color OCR UI Jupyter Input Logo Password Crawler Miniforge 论文 Qwen Cloudreve WAN Paper Windows Card Dataset Linux OpenCV 音频 CSV Pandas 版权 多进程 SPIE Transformers Image2Text Google GPT4 torchinfo Vim News Augmentation FastAPI VPN OpenAI Math SAM IndexTTS2 uwsgi Bipartite 继承 证件照 GPTQ GGML Streamlit LeetCode AI 公式 Llama Michelin 算法题 Rebuttal Disk NameSilo tar Base64 Use Review Plotly Distillation Hotel Template CV Vmess Domain LLAMA Anaconda Bitcoin Firewall Algorithm llama.cpp logger Pytorch 递归学习法 icon Quantization EXCEL 净利润 Paddle Breakpoint Data Heatmap Pickle API 飞书 Land HaggingFace 报税 Proxy TensorFlow COCO Freesound BF16 Clash BeautifulSoup DeepSeek WebCrawler hf NLP diffusers Jetson JSON XGBoost Baidu mmap Ptyhon 论文速读 Tracking InvalidArgumentError Qwen2 CLAP Zip Gemma PIP 阿里云 printf Sklearn 第一性原理 DeepStream Attention Knowledge Tiktoken C++ TensorRT PDF Quantize v0.dev Docker ResNet-50 Bin transformers Mixtral Animate RAR Search BTC Tensor 腾讯云 v2ray Plate git TSV NLTK Github Agent PyTorch Interview 强化学习 Pillow SVR uWSGI QWEN Diagram YOLO Conda GoogLeNet Hilton Bert TTS Website HuggingFace FP8 云服务器 FlashAttention Random ModelScope MD5 SQL Markdown PDB CUDA CC Qwen2.5 Food 顶会 Claude FP64 Statistics Hungarian CAM LLM Datetime Django UNIX 域名 Safetensors FP16 PyCharm 关于博主 图形思考法 RGB Shortcut 搞笑 签证 Magnet GIT VSCode 财报 SQLite ChatGPT Nginx CEIR Video XML Git
站点统计

本站现有博文327篇,共被浏览833280次

本站已经建立2538天!

热门文章
文章归档
回到顶部