EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2169

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
GoogLeNet Tensor 第一性原理 Plate Gemma Search AI Transformers Quantize Ptyhon TSV mmap Distillation LLAMA Agent RL Vmess Tracking 净利润 Claude CEIR FastAPI DeepSeek Hotel Diagram ms-swift Card Conda EXCEL LeetCode 云服务器 tqdm Excel Numpy Base64 UNIX TensorRT llama.cpp PyTorch Heatmap Color CSV UI ResNet-50 Hilton Breakpoint Quantization Web SQLite VGG-16 COCO Github DeepStream logger Attention 论文速读 GGML Paddle LoRA Zip FP16 Django Logo Qwen2.5 News 版权 Jupyter uwsgi PyCharm ONNX Bipartite Qwen2 公式 Dataset CUDA VSCode Animate WebCrawler Pickle IndexTTS2 Shortcut GPT4 强化学习 Augmentation 继承 scipy OCR TTS C++ Bitcoin Streamlit 图标 Miniforge 论文 Interview 顶会 JSON Land LaTeX git-lfs Baidu Math 递归学习法 Password 多线程 Datetime Linux VPN Michelin Template 证件照 音频 Vim CAM FP32 Python Website Pandas Domain Disk QWEN Rebuttal Firewall InvalidArgumentError hf Input tar SPIE SQL CC WAN RGB 算法题 Food Random Proxy Llama Jetson Google Anaconda CTC 腾讯云 关于博主 PDF Algorithm Pytorch Sklearn Cloudreve Hungarian YOLO API Clash v2ray Knowledge torchinfo 签证 Windows Ubuntu Statistics SVR Bin printf FP8 Video RAR PDB Qwen Permission FlashAttention Docker 报税 Freesound MD5 BeautifulSoup BTC 图形思考法 OpenAI HaggingFace NLTK Image2Text transformers LLM Mixtral PIP GIT XGBoost NameSilo icon CLAP 财报 Crawler 多进程 飞书 diffusers Use Data SAM GPTQ BF16 Paper 阿里云 v0.dev CV ChatGPT Bert HuggingFace Magnet 域名 Markdown uWSGI Tiktoken Pillow Review git OpenCV 搞笑 Plotly Translation FP64 Nginx Safetensors NLP TensorFlow ModelScope Git XML
站点统计

本站现有博文333篇,共被浏览922435次

本站已经建立2628天!

热门文章
文章归档
回到顶部