EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：1949

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
腾讯云 VGG-16 LoRA 多进程 签证 Hilton HuggingFace Qwen2 PIP Anaconda tqdm Web 顶会 WebCrawler Streamlit WAN Website printf QWEN Nginx Bin Git HaggingFace Rebuttal Github InvalidArgumentError Quantize TTS Ptyhon GoogLeNet uWSGI Michelin Algorithm Quantization torchinfo Paper GGML Bipartite ModelScope Firewall SAM Hotel Password Tensor mmap Search SQLite 云服务器 COCO 图形思考法 RAR Diagram Augmentation IndexTTS2 git-lfs Breakpoint VSCode Freesound uwsgi transformers GPT4 报税 Llama Animate 第一性原理 BF16 Permission SPIE JSON OCR BTC Image2Text 强化学习 LLM logger Pandas Disk 公式 TensorRT Sklearn FP16 SVR Transformers Data Statistics Interview Vmess EXCEL LeetCode Claude Input Conda Agent Bert UI Tracking Logo XGBoost Jupyter CC PyCharm CUDA 域名 FP8 ChatGPT CV Plate Dataset GPTQ Numpy 论文速读 图标 Distillation RGB TensorFlow 递归学习法 Hungarian PyTorch CAM API Attention Windows llama.cpp Translation Markdown 阿里云 OpenAI git 飞书 Use NLTK Pytorch Gemma FlashAttention 证件照 Mixtral Clash Baidu PDF Template Cloudreve OpenCV SQL CTC Pillow 音频 Google Math Paddle Safetensors Shortcut Land hf MD5 DeepStream Review CLAP 继承 Domain UNIX FP64 NLP Card Qwen2.5 VPN CEIR ONNX 多线程 Crawler icon Jetson scipy v2ray tar Datetime Pickle Ubuntu diffusers Tiktoken NameSilo Miniforge Video Linux Python LaTeX 关于博主 DeepSeek Zip 财报 GIT CSV Proxy Django Excel FastAPI YOLO Vim FP32 AI Plotly 算法题 TSV Qwen Magnet News C++ BeautifulSoup PDB 版权 Knowledge Color Random ResNet-50 Bitcoin Heatmap 搞笑 v0.dev XML 论文 净利润 Base64 LLAMA Food Docker
站点统计

本站现有博文327篇,共被浏览833182次

本站已经建立2538天!

热门文章
文章归档
回到顶部