Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
34b-beta-GGUF
like
3
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
conversational
Inference Endpoints
text-generation-inference
License:
gpl-3.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
5f538bb
34b-beta-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
62732b100c4cb1b550076ac0591e013cce5d537acd944efc73c42ca5edb8bf6a
5f538bb
verified
8 months ago
.gitattributes
1.92 kB
62732b100c4cb1b550076ac0591e013cce5d537acd944efc73c42ca5edb8bf6a
8 months ago
34b-beta.Q2_K.gguf
12.8 GB
LFS
5bd91a1a878849603d037123a5ce65d520d96b4b17070d366de2c44589930a30
8 months ago
34b-beta.Q3_K_L.gguf
18.1 GB
LFS
25092468acda758c1fe36dc5d86ab522a9f0f828156d7819e24e1e6b91744566
8 months ago
34b-beta.Q3_K_M.gguf
16.7 GB
LFS
c36042c5762b6115df03b492c3862924fcc49df7bf67ba856bb89089c1211bd6
8 months ago
34b-beta.Q3_K_S.gguf
15 GB
LFS
10e82f0bcf55f54bdd1e7b008a2219fe01c415696598e8582728fc7ce05f87c4
8 months ago
34b-beta.Q4_K_M.gguf
20.7 GB
LFS
f68d117d8de274472fb560d5a5b0ecf3bf141b45d0750d5555d130f987f83e4c
8 months ago
34b-beta.Q4_K_S.gguf
19.6 GB
LFS
a23dde2e7bd0e48ea12f07b8f7fdd17bf87004b0d00c1cc45146850ea5205eb4
8 months ago
34b-beta.Q5_K_M.gguf
24.3 GB
LFS
62732b100c4cb1b550076ac0591e013cce5d537acd944efc73c42ca5edb8bf6a
8 months ago
