Share:
  • Title:vLLM Office Hours - FP8 Quantization Deep Dive - July 9, 2024
  • Duration: 56:09
  • Plays: 1.5K views
  • Published: 4 months ago
Download MP3
Download MP4


Simillar Videos

Who is Neural Magic?▶️ 3:11
Who Is Neural Magic? 1.5K views • 4 years ago
Deploy LLMs More Efficiently with vLLM and Neural Magic▶️ 33:21
Deploy Llms More Efficiently With Vllm And Neural Magic 1.5K views • 4 months ago
Neural Magic Demo▶️ 4:11
Neural Magic Demo 1.5K views • 4 years ago
The Benefits of Quantization: Research from Neural Magic▶️ 1:19
The Benefits Of Quantization: Research From Neural Magic 1.5K views • 1 month ago
Introduction to Sparsity in Deep Learning | Mark Kurtz | Neural Magic▶️ 34:58
Introduction To Sparsity In Deep Learning | Mark Kurtz | Neural Magic 1.5K views • 2 years ago