EADST

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING

FP8位数解析

在 AI 模型越来越庞大的今天,我们面临的不仅是算力挑战,更有带宽、能耗和模型部署的瓶颈。正因如此,更高效的数值表示方式成为突破口,其中最受关注的就是 FP8(8位浮点数)格式。

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING

Quick Review: ZeroQuant-FP

ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats

Paper: https://arxiv.org/abs/2307.09782

Code: https://github.com/microsoft/DeepSpeed

Organization: Microsoft

CONTINUE READING
CONTINUE READING
About Me
XD
Goals determine what you are going to be.
Category
标签云
BeautifulSoup UNIX FlashAttention tqdm Ptyhon Review Markdown Hungarian TensorRT Jev TensorFlow CC TTS API网关 算法题 Use Password 云服务器 域名 OpenAI SQLite printf ms-swift Paper Excel FastAPI ModelScope Harness 音频 多线程 Llama AI 报税 Zip Magnet OCR Proxy Bert Claude Cloudreve YOLO Nginx TSV PyCharm Quantization Knowledge API QWEN EXCEL 版权 Github logger WAN BTC Pillow WebCrawler Website CEIR Crawler Paddle Qwen scipy Input GPTQ hf VSCode Algorithm LoRA 第一性原理 签证 Pickle Django PyTorch 多进程 Michelin PDF DeepStream Qwen2 Hotel NLTK Statistics 论文速读 财报 Logo Translation Ubuntu tar 阿里云 Math InvalidArgumentError Rebuttal Plotly VPN Bipartite uWSGI RAR 图形思考法 diffusers Bitcoin Base64 Dataset Template icon BF16 Datetime SAM 自我改进 XGBoost 腾讯云 Safetensors Pandas ResNet-50 torchinfo Quantize OpenCV Mixtral GPT4 Jupyter 公式 CTC Numpy Tracking CSV CV Pytorch MD5 Augmentation LLAMA Bin 飞书 Domain HaggingFace Anaconda Attention Miniforge IndexTTS2 图标 Search Land mmap HuggingFace Linux git-lfs SQL 强化学习 Gemma git 继承 transformers Image2Text Shortcut Agent NameSilo VGG-16 Firewall Breakpoint uwsgi Hilton Interview v0.dev CUDA Permission 关于博主 Tensor 证件照 Qwen2.5 FP64 Baidu GGML ChatGPT GoogLeNet 顶会 Diagram SVR Windows 搞笑 ONNX FP32 Conda PDB Sklearn llama.cpp Tiktoken 递归学习法 v2ray 净利润 Color News CLAP SPIE Git Freesound DeepSeek PIP NLP Python Web Animate Vmess Clash Plate C++ Heatmap Distillation LLM FP8 Food 长期记忆 Video GIT CAM RGB Random LaTeX Transformers Card COCO 论文 LeetCode Disk Jetson Data Docker XML FP16 JSON Google UI Streamlit RL Vim
站点统计

本站现有博文339篇,共被浏览993627次

本站已经建立2704天!

热门文章
文章归档
回到顶部