EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2096

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
printf NLP tar Llama Video FP16 云服务器 HaggingFace Conda Baidu CLAP 报税 Qwen NLTK Streamlit Transformers MD5 Quantization icon XGBoost FP32 Permission GPT4 Food 多线程 Firewall Quantize News GPTQ BeautifulSoup Datetime Pickle logger 飞书 uwsgi 搞笑 Ubuntu 域名 Django LaTeX SAM C++ Tracking Augmentation FastAPI Dataset Github Data Anaconda Statistics SPIE Claude PIP RGB Attention RAR Proxy BTC Search Miniforge Shortcut Hotel Windows 音频 UNIX IndexTTS2 Linux Python Review TensorFlow Input 图标 Ptyhon Logo FP8 LeetCode llama.cpp Paper Docker Math PyTorch Disk VGG-16 Random GoogLeNet BF16 TSV CEIR PyCharm Web Git Breakpoint torchinfo CSV Bin 阿里云 PDF hf 递归学习法 transformers Image2Text Plotly TensorRT PDB Hungarian Jetson LLM Pillow Safetensors 顶会 WebCrawler scipy ONNX Interview CV 论文速读 Domain 论文 API Knowledge Pandas ModelScope OpenCV Numpy UI QWEN CAM v0.dev OpenAI Translation Rebuttal 继承 Clash Bert Website HuggingFace 版权 关于博主 EXCEL CUDA AI Algorithm FlashAttention Vmess Vim CTC SQL 算法题 Base64 v2ray Crawler CC Gemma Michelin FP64 Bitcoin Card 证件照 多进程 NameSilo uWSGI Pytorch Cloudreve mmap Plate Zip Qwen2 Heatmap Password XML LoRA Bipartite Distillation DeepSeek TTS Nginx git-lfs Use RL 签证 Template Diagram Color JSON SQLite 公式 Sklearn VSCode Mixtral COCO Freesound 财报 Tiktoken Hilton Qwen2.5 强化学习 Paddle Tensor 腾讯云 Excel SVR 净利润 Google DeepStream ChatGPT LLAMA Markdown Jupyter GIT WAN OCR VPN Land Magnet Animate 第一性原理 InvalidArgumentError ms-swift diffusers GGML Agent git YOLO 图形思考法 tqdm ResNet-50
站点统计

本站现有博文332篇,共被浏览875365次

本站已经建立2583天!

热门文章
文章归档
回到顶部