npc0
/

DISC-MedLLM-ggml

Text Generation

Model card Files Files and versions Community

npc0 commited on Nov 1, 2023

Commit

bcf7256

•

1 Parent(s): dbaa40a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ The weights are converted to GGML format using [baichuan13b.cpp](https://github.
 |ggml-model-q4_1.bin | q4_1 | 8.36 GB |
 |ggml-model-q5_0.bin | q5_0 | 9.17 GB |
 |ggml-model-q5_1.bin | q5_1 | 9.97 GB |
-<!-- |ggml-model-q8_0.bin | q8_0 | ?.?? GB | -->
 ## How to inference
 1. [Compile baichuan13b](https://github.com/ouwei2013/baichuan13b.cpp#build), a main executable `baichuan13b/build/bin/main` and a server `baichuan13b/build/bin/server` will be generated.

 |ggml-model-q4_1.bin | q4_1 | 8.36 GB |
 |ggml-model-q5_0.bin | q5_0 | 9.17 GB |
 |ggml-model-q5_1.bin | q5_1 | 9.97 GB |
+|ggml-model-q8_0.bin | q8_0 | 14 GB |
 ## How to inference
 1. [Compile baichuan13b](https://github.com/ouwei2013/baichuan13b.cpp#build), a main executable `baichuan13b/build/bin/main` and a server `baichuan13b/build/bin/server` will be generated.