EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2286

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Video SQL Template logger PIP OpenAI Augmentation Disk Pandas VPN 证件照 Hilton ONNX Linux icon Harness Bitcoin NLTK TensorRT News Firewall Statistics Windows Attention Hotel Quantization Review C++ Paper SPIE HaggingFace 域名 Math LoRA WAN MD5 Qwen2.5 RGB Datetime Crawler Python Card Animate COCO UI printf 图形思考法 GPT4 LaTeX Diagram 算法题 Vmess Anaconda TensorFlow Jev Nginx TSV transformers Input Shortcut Land GGML Distillation Breakpoint 图标 LeetCode FP8 uWSGI Paddle ChatGPT Algorithm 搞笑 Conda Dataset CC 报税 FP16 Plate uwsgi 递归学习法 API Data hf BeautifulSoup Excel Website Jupyter FP32 Bin CAM Github 论文 Agent CV CUDA ResNet-50 腾讯云 Zip git API网关 Django GIT UNIX 多进程 云服务器 AI VGG-16 NameSilo Cloudreve 财报 RL Ubuntu Random LLM ms-swift 强化学习 DeepSeek InvalidArgumentError Miniforge Pytorch Numpy Bipartite EXCEL OpenCV Transformers Clash FastAPI XGBoost CTC Bert FP64 DeepStream Markdown PDF Search llama.cpp CLAP HuggingFace Claude tqdm Quantize Proxy 论文速读 torchinfo 净利润 PDB XML SVR CSV 顶会 BF16 第一性原理 ModelScope FlashAttention tar Docker PyCharm 公式 Tracking Google Freesound Gemma Tiktoken Git Jetson LLAMA SAM Sklearn SQLite 版权 Ptyhon Pickle Translation diffusers Qwen2 IndexTTS2 Base64 mmap NLP TTS Permission VSCode BTC Qwen PyTorch Color 关于博主 Use Tensor Interview v2ray Logo git-lfs Food 多线程 签证 OCR YOLO Domain Pillow Plotly Web Image2Text Knowledge Heatmap WebCrawler Michelin 继承 Streamlit v0.dev JSON Mixtral Password Baidu Rebuttal RAR Vim GoogLeNet 飞书 Magnet GPTQ 音频 QWEN 阿里云 scipy Safetensors Hungarian CEIR Llama
站点统计

本站现有博文337篇,共被浏览961751次

本站已经建立2673天!

热门文章
文章归档
回到顶部