Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs| 东毅居士

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2191

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Paper: SmoothQuant on arXiv
Code: SmoothQuant on GitHub
Organization: MIT

Highlight:

Hyper-parameter for Outliers: Implements a novel approach using a specific hyper-parameter to manage outliers effectively during the quantization process.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/229

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

下一篇
Setting Up v2rayNG with Tencent Cloud Silicon Valley Lighthouse

Category

标签云

XGBoost BF16 tar RGB 证件照 FP32 MD5 CEIR Statistics Tensor Ptyhon XML 算法题 Bin Quantize RL Bert Permission LLM 递归学习法 Windows TensorRT C++ Llama Gemma FP16 SPIE Linux Pillow GIT 搞笑 Sklearn Logo Land Excel Interview FP64 Search JSON Domain 飞书 Django Numpy FlashAttention diffusers Bipartite ONNX DeepSeek Heatmap GPT4 ms-swift Math SQLite llama.cpp Translation Image2Text Crawler 强化学习 Dataset FP8 Hilton Disk Tracking CSV v0.dev mmap Pickle Template 云服务器关于博主 Git Qwen HaggingFace BeautifulSoup 报税 Attention 图形思考法 Jupyter Website scipy uWSGI VSCode printf Baidu 多线程 Vim Conda EXCEL Proxy Safetensors API Augmentation Animate Cloudreve NLP Breakpoint Jetson Paper 净利润财报 Agent GoogLeNet Markdown Algorithm RAR Streamlit VGG-16 Michelin Google Pandas UI SVR 第一性原理 Mixtral Distillation QWEN AI 论文速读 Firewall LeetCode logger NameSilo Qwen2 Pytorch SQL CC Paddle 域名 YOLO git Clash COCO BTC WebCrawler Quantization 多进程 CLAP TSV TTS 论文 Base64 Docker Rebuttal NLTK Web ChatGPT ModelScope Magnet Password Video Tiktoken FastAPI Use GPTQ PyTorch git-lfs VPN PDF Nginx 顶会 Datetime 图标 OCR tqdm Github DeepStream Knowledge GGML CAM PyCharm ResNet-50 PIP torchinfo PDB LaTeX News Miniforge icon 版权 Anaconda hf Review Plotly 音频 WAN 签证继承公式 UNIX Color Plate Random LLAMA Card Hotel Input OpenAI uwsgi Qwen2.5 Food HuggingFace OpenCV Freesound InvalidArgumentError Vmess SAM 阿里云 Python transformers Diagram Shortcut TensorFlow IndexTTS2 Data Bitcoin Ubuntu Transformers Zip CTC Claude v2ray Hungarian CUDA CV 腾讯云 LoRA

站点统计

本站现有博文332篇,共被浏览875329次

本站已经建立2583天!

原 Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2191

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Highlight:

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs