Are Quants possible?

by deleted - opened Sep 2

Discussion

deleted

Sep 2

I attempted it myself with "GGUF My Repo" and was told it's not supported. Are creating Quants of this model possible?

RaushanTurganbay

Sep 3

I also tried to convert to GGUF these models, but seems like the conversion script doesn't support any image backbone other than CLIP. I tried to adapt the script but now it generates garbage. Would be nice if someone has a solution to this

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment