---
title: VPTQ demo
emoji: 🚀
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 4.36.1
app_file: app.py
pinned: true
license: mit
short_description: Vector Post-Training Quantization (VPTQ) Demo
---

An example chatbot using [VPTQ](https://github.com/microsoft/VPTQ), [hf.rst.immmunity](https://huggingface.co/spaces/VPTQ-community/).