Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

7,596

Full-text search

Active filters: llama-cpp

openerotica/writing-roleplay-20k-context-nemo-12b-v1.0-gguf

Updated 7 days ago • 3.22k • 12

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26 • 9.67k • 38

win10/Pixtral-12B-2409-hf-text-only-Q8_0-GGUF

Text Generation • Updated Sep 20 • 702 • 5

byroneverson/LongWriter-glm4-9b-abliterated-gguf

Text Generation • Updated 3 days ago • 61 • 3

byroneverson/gemma-2-27b-it-abliterated-gguf

Text Generation • Updated Sep 9 • 590 • 12

Karsh-CAI/Qwen2.5-32B-AGI-Q4_K_M-GGUF

Updated Sep 21 • 4.22k • 18

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 27 days ago • 67.3k • 37

pcuenq/Qwen2.5-0.5B-Instruct-with-new-merges-serialization-Q8_0-GGUF

Text Generation • Updated 22 days ago • 50 • 2

aashish1904/Ministral-8B-Instruct-2410-HF-Q2_K-GGUF

Updated 2 days ago • 22 • 2

DavidAU/StoryWeaver-7b-Instruct-v0.1-Q6_K-GGUF

Updated Apr 10 • 16 • 1

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 2.37k • 11

DavidAU/BigYi-15.75B-200k-Q6_K-GGUF

Updated Apr 14 • 21 • 1

DavidAU/Yarn-Mistral-7b-128k-DPO-Q6_K-GGUF

Updated Apr 17 • 17 • 1

hus960/Llama-3-8b.UNLEASHED-Q4_K_M-GGUF

Text Generation • Updated Apr 23 • 31 • 2

DavidAU/Meta-Llama-3-8B-Instruct-64k-Q8_0-GGUF

Text Generation • Updated Apr 25 • 14 • 1

DavidAU/LWM-Text-Chat-1M-Q8_0-GGUF

Updated Apr 29 • 18 • 1

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 417 • 50

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 1.43k • 49

Lanerdog/Llama-3-8B-Instruct-Gradient-1048k-Q5_K_M-GGUF

Text Generation • Updated May 21 • 2 • 1

Ayyystin/TinyDolphin-2.8-1.1b-Q4_0-GGUF

Updated Jun 7 • 81 • 1

Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B-GGUF

Updated Jun 17 • 23 • 3

sunzx0810/gte-Qwen2-7B-instruct-Q5_K_M-GGUF

Sentence Similarity • Updated Jun 25 • 157 • 6

joaquinito2073/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Jul 1 • 24 • 1

huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF

Updated Jul 3 • 13 • 2

v000000/SwallowMaid-8B-L3-SPPO-abliterated-Q8_0-GGUF

Updated Jul 11 • 110 • 2

mtsdurica/madlad400-3b-mt-Q4_K_M-GGUF

Translation • Updated Jul 13 • 269 • 3

tspersian/mT5_base_translation_English_to_Persian-Farsi-Q4_K_M-GGUF

Translation • Updated Jul 14 • 65 • 1

iG8R/t5_translate_en_ru_zh_large_1024_v2-Q8_0-GGUF

Translation • Updated Jul 26 • 77 • 2

djuna/jina-embeddings-v2-base-code-Q5_K_M-GGUF

Feature Extraction • Updated Jul 28 • 49 • 1

SteelQuants/G2-DA-Nyxora-27b-V2-Q5_K_M-GGUF

Updated Jul 30 • 33 • 2