-
-
-
-
-
-
Inference status
Active filters:
4-bit
TheBloke/Yarn-Mistral-7B-128k-AWQ
Text Generation
•
Updated
•
1.08k
•
71
TheBloke/OpenHermes-2.5-Mistral-7B-AWQ
Text Generation
•
Updated
•
7.12k
•
21
TheBloke/deepseek-coder-6.7B-instruct-AWQ
Text Generation
•
Updated
•
2.99k
•
15
TheBloke/deepseek-coder-6.7B-base-AWQ
Text Generation
•
Updated
•
14.2k
•
8
TheBloke/Synatra-7B-v0.3-RP-GPTQ
Text Generation
•
Updated
•
22
•
7
TheBloke/Qwen-7B-Chat-AWQ
Text Generation
•
Updated
•
38
•
8
01-ai/Yi-6B-Chat-4bits
Text Generation
•
Updated
•
623
•
20
TheBloke/Synatra-RP-Orca-2-7B-v0.1-GPTQ
Text Generation
•
Updated
•
29
•
2
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
Updated
•
203k
•
49
ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
•
18.4k
•
15
TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ
Text Generation
•
Updated
•
172
•
99
TheBloke/DaringMaid-20B-GPTQ
Text Generation
•
Updated
•
66
•
5
TheBloke/Llama-2-7B-ft-instruct-es-GPTQ
Text Generation
•
Updated
•
87
•
2
casperhansen/mixtral-instruct-awq
Text Generation
•
Updated
•
43.6k
•
43
ybelkada/Mixtral-8x7B-Instruct-v0.1-bnb-4bit
Text Generation
•
Updated
•
796
•
59
unsloth/codellama-34b-bnb-4bit
Text Generation
•
Updated
•
510
•
3
TheBloke/dolphin-2.6-mistral-7B-AWQ
Text Generation
•
Updated
•
306
•
8
TheBloke/dolphin-2.6-mistral-7B-dpo-laser-AWQ
Text Generation
•
Updated
•
65
•
10
TheBloke/openchat-3.5-0106-GPTQ
Text Generation
•
Updated
•
222
•
7
TheBloke/phi-2-electrical-engineering-GPTQ
Text Generation
•
Updated
•
34
•
7
LuongNam/Vistral-7B-Chat-AWQ
Text Generation
•
Updated
•
11
•
2
TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ
Text Generation
•
Updated
•
651
•
22
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
Updated
•
9.5k
•
31
TheBloke/Everyone-Coder-33B-Base-GPTQ
Text Generation
•
Updated
•
15
•
3
TheBloke/CodeLlama-70B-Instruct-AWQ
Text Generation
•
Updated
•
136
•
13
TheBloke/CodeLlama-70B-Instruct-GPTQ
Text Generation
•
Updated
•
1.36k
•
12
TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ
Updated
•
2.41k
•
20
TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ
Updated
•
840
•
52
roshanrai1304/llama_2_finetune_on_real_estate_data
Text Generation
•
Updated
•
118
•
1
Qwen/Qwen1.5-7B-Chat-GPTQ-Int4
Text Generation
•
Updated
•
257
•
19