EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2055

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
GoogLeNet 证件照 TensorFlow Ptyhon FP16 Safetensors Mixtral Claude Docker 签证 GGML printf GPT4 Domain ChatGPT Streamlit Attention MD5 v0.dev FlashAttention Google transformers NameSilo Vim WAN Zip Input UI CTC PyTorch Video HuggingFace Tracking WebCrawler OCR SAM LLM Dataset PDB Firewall logger XGBoost NLP SVR tqdm v2ray TensorRT Jupyter Hotel Clash LaTeX Pillow Hungarian RGB 云服务器 Qwen2.5 Bipartite Git PIP Quantize Crawler Agent 搞笑 PyCharm Breakpoint CC OpenAI Interview BF16 CV Transformers Paper PDF Distillation Sklearn Augmentation torchinfo FP8 Hilton 顶会 Pickle CUDA Cloudreve API Data Image2Text QWEN CEIR Plate FastAPI C++ GIT Knowledge Use Conda Translation Qwen Diagram Llama Permission 净利润 DeepSeek Heatmap Shortcut Tiktoken git-lfs Animate Algorithm FP64 ResNet-50 hf 飞书 llama.cpp CLAP 多进程 Magnet EXCEL 阿里云 Template tar Markdown Github Michelin Quantization Card News LoRA 关于博主 icon scipy SQLite Bitcoin Bert 第一性原理 VSCode Password DeepStream Python 公式 Web Plotly Disk IndexTTS2 Django Freesound Windows LLAMA 腾讯云 Miniforge VPN Vmess BeautifulSoup XML 图标 Math Base64 Land InvalidArgumentError Pandas Linux RL 强化学习 继承 YOLO OpenCV Website NLTK ms-swift CAM Random 音频 LeetCode FP32 Numpy Bin Anaconda Pytorch Proxy Tensor SPIE uwsgi Jetson Baidu SQL Datetime JSON Qwen2 版权 git 图形思考法 Gemma 论文 UNIX CSV 算法题 ONNX Ubuntu Excel mmap Food VGG-16 ModelScope Color Nginx 多线程 Logo 论文速读 diffusers Rebuttal RAR Search 域名 BTC COCO 递归学习法 TTS GPTQ Review 财报 报税 Statistics Paddle AI uWSGI TSV HaggingFace
站点统计

本站现有博文332篇,共被浏览875534次

本站已经建立2583天!

热门文章
文章归档
回到顶部