Hugging Face's logo

Lewdiculous
/
Layris_9B-GGUF-IQ-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
roleplay
Model card Files Community
2
Lewdiculous commited on
Commit
bebcce7
•
1 Parent(s): 85f2d09

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Layris_9B-Q5_K_M-imat.gguf +3 -0
  3. Layris_9B-Q5_K_S-imat.gguf +3 -0
  4. Layris_9B-Q6_K-imat.gguf +3 -0
.gitattributes CHANGED
@@ -37,3 +37,6 @@ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  Layris_9B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
  Layris_9B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Layris_9B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
37
  Layris_9B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
  Layris_9B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Layris_9B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Layris_9B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Layris_9B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Layris_9B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
Layris_9B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d567b5515417793b688ee8b513ec630e897ce21481798a487d78e1952fccb437
3
+ size 6364669888
Layris_9B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be468ad7b725eb954392d5e52c4b01df740c9e055d85898ce9313a12dae88e23
3
+ size 6197553088
Layris_9B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ed8dcb2fb8c9861f4a9d5fd1dadb4489852cbd1a0fb364e05f15e818fd10d87
3
+ size 7373637568