Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,543

Full-text search

Active filters: awq

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ

Text Generation • Updated Jan 16 • 651 • 22

TheBloke/CodeLlama-70B-Instruct-AWQ

Text Generation • Updated Jan 30 • 136 • 13

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 2.41k • 20

alexandreteles/bonito-v1-awq

Text2Text Generation • Updated Mar 16 • 201 • 2

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 12.4k • 66

hdadlani/Llama-3-128k-70B-Instruct-awq

Text Generation • Updated May 29 • 3 • 1

anyisalin/L3-70B-Euryale-v2.1-AWQ

Text Generation • Updated Jun 18 • 132 • 3

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26 • 2.26k • 3

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4 • 249 • 1

solidrust/Phi-3-mini-128k-instruct-AWQ

Text Generation • Updated Sep 3 • 424 • 1

DrSri/GLM-4-9b-Quantized-AWQ

Text Generation • Updated Jul 17 • 6 • 1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 449k • 59

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated 25 days ago • 185k • 7

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated 12 days ago • 1.96k • 9

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 226 • 2

solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Text Generation • Updated Sep 3 • 273 • 3

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 1.3k • 2

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 336 • 3

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 6.2k • 14

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2 • 74 • 3

solidrust/gemma-2-9b-it-AWQ

Text Generation • Updated Sep 3 • 1.18k • 2

solidrust/Hermes-3-Llama-3.1-8B-AWQ

Text Generation • Updated Sep 3 • 1.07k • 3

solidrust/Llama-3.1-8B-Lexi-Uncensored-V2-AWQ

Text Generation • Updated Sep 3 • 103 • 1

stelterlab/Yi-Coder-9B-Chat-AWQ

Text Generation • Updated Sep 8 • 30 • 3

jfiekdjdk/glm-4-9b-chat-awq

Updated Sep 15 • 13 • 1

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated 13 days ago • 38.8k • 8

solidrust/LLama-3.1-8B-Matrix-AWQ

Text Generation • Updated Sep 19 • 41 • 1

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated 13 days ago • 3.63k • 5

AMead10/Llama-3.2-1B-Instruct-AWQ

Text Generation • Updated 27 days ago • 1.55k • 2

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated 26 days ago • 644 • 1