Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

15,936

Full-text search

Active filters: 4-bit

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 257 • 19

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 1.18k • 21

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 970 • 46

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3 • 4.94k • 15

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3 • 1.18k • 18

Duxiaoman-DI/XuanYuan2-70B-Chat-4bit

Text Generation • Updated Mar 8 • 34 • 2

alexandreteles/bonito-v1-awq

Text2Text Generation • Updated Mar 16 • 201 • 2

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2 • 949 • 13

mlabonne/Jambatypus-v0.1

Text Generation • Updated Apr 4 • 21 • 37

ikeno-ada/madlad400-3b-mt-bitsandbytes-4bit

Translation • Updated Apr 3 • 150 • 1

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 1.18k • 118

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 6.35k • 163

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated about 15 hours ago • 199k • 179

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 85.7k • 128

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 12.4k • 66

TechxGenus/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Apr 19 • 1.03k • 5

dattaraj/Gemma-2b-it-mental-health

Text Generation • Updated Apr 22 • 103 • 1

kaitchup/Phi-3-mini-4k-instruct-gptq-4bit

Text Generation • Updated Apr 25 • 1.55k • 2

ecastera/eva-dolphin-llama3-8b-spanish

Text Generation • Updated Jun 14 • 51 • 3

KillerShoaib/llama-3-8b-bangla-4bit

Text Generation • Updated May 10 • 109 • 2

RichardErkhov/knkarthick_-_MEETING_SUMMARY-4bits

Text Generation • Updated May 9 • 12 • 1

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated Sep 11 • 124 • 1

blockblockblock/Dark-Miqu-70B-bpw4-exl2

Text Generation • Updated May 11 • 11 • 2

dwb2023/phi-3-vision-128k-instruct-quantized

Text Generation • Updated May 21 • 206 • 4

hdadlani/Llama-3-128k-70B-Instruct-awq

Text Generation • Updated May 29 • 3 • 1

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated May 29 • 3.87k • 18

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1 • 130 • 22

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated Sep 3 • 2.06k • 3

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 925 • 18

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_4.0bpw

Text Generation • Updated Jun 15 • 80 • 1