EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2262

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
PyTorch Qwen2 Rebuttal Statistics SQLite QWEN 飞书 OCR PDB Translation torchinfo MD5 tqdm ms-swift Pickle Freesound Distillation 阿里云 LaTeX GPT4 Clash Sklearn TSV Review 报税 Firewall Interview PIP LLM 图形思考法 Jupyter Plate Docker VSCode Vmess Harness Data Input PDF Nginx Bipartite 证件照 XML 域名 CV Augmentation logger Qwen mmap Streamlit UI API Web NameSilo DeepStream 多进程 Windows 搞笑 Logo Bitcoin Random API网关 FP8 CEIR Llama hf CC OpenAI SVR Paper JSON UNIX CSV Image2Text Quantization Google Django Proxy llama.cpp Miniforge 顶会 IndexTTS2 NLTK 签证 Zip Baidu Shortcut ModelScope diffusers SQL Heatmap AI Magnet SAM Animate CTC COCO Crawler LoRA News HuggingFace uwsgi CLAP Vim Template Card FP32 Claude icon Diagram BF16 云服务器 Permission ONNX git 递归学习法 第一性原理 VGG-16 Datetime Pandas Plotly tar TensorFlow Mixtral Dataset Tiktoken Hilton Excel GIT OpenCV Use RL Password Breakpoint ChatGPT BTC Linux Quantize v0.dev 论文速读 Knowledge Math Github 腾讯云 Ubuntu 论文 强化学习 多线程 Tensor Cloudreve Domain Land RGB Numpy 净利润 Food CAM Qwen2.5 Tracking GPTQ Michelin InvalidArgumentError YOLO PyCharm TensorRT 算法题 DeepSeek Git Disk CUDA LeetCode Anaconda Agent 关于博主 GoogLeNet LLAMA Paddle VPN Video Hotel printf transformers Search 版权 财报 uWSGI Python Bert SPIE Transformers GGML ResNet-50 HaggingFace Color Attention Conda FlashAttention NLP Algorithm EXCEL Website 公式 Base64 WAN Pillow RAR git-lfs FP64 FastAPI Bin 图标 FP16 Jev Hungarian Safetensors Ptyhon Gemma Markdown TTS BeautifulSoup C++ Jetson 音频 XGBoost v2ray scipy WebCrawler 继承 Pytorch
站点统计

本站现有博文337篇,共被浏览961705次

本站已经建立2673天!

热门文章
文章归档
回到顶部