Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

DisOOM
/

Faro-Yi-9B-200k-GGUF

Text Generation

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Faro-Yi-9B-200k-GGUF

1 contributor

History: 12 commits

DisOOM's picture

Update README.md

2c65e7a verified 7 months ago

.gitattributes

1.94 kB

Rename ggml-model-f16.gguf to Fi-9B-f16.gguf 7 months ago
Fi-9B-Q2_K.gguf

3.35 GB
LFS

Upload Fi-9B-Q2_K.gguf 7 months ago
Fi-9B-Q3_K_M.gguf

4.32 GB
LFS

Upload Fi-9B-Q3_K_M.gguf 7 months ago
Fi-9B-Q4_K_M.gguf

5.33 GB
LFS

Upload Fi-9B-Q4_K_M.gguf 7 months ago
Fi-9B-Q5_K_M.gguf

6.26 GB
LFS

Upload Fi-9B-Q5_K_M.gguf 7 months ago
Fi-9B-Q6_K.gguf

7.25 GB
LFS

Upload Fi-9B-Q6_K.gguf 7 months ago
Fi-9B-Q8_0.gguf

9.38 GB
LFS

Upload Fi-9B-Q8_0.gguf 7 months ago
Fi-9B-f16.gguf

17.7 GB
LFS

Rename ggml-model-f16.gguf to Fi-9B-f16.gguf 7 months ago
README.md

392 Bytes

Update README.md 7 months ago