koesn commited on
Commit
d47a466
1 Parent(s): 02d68ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -9,15 +9,15 @@ This repo contains GGUF format model files for Garrulus-7B.
9
  ## Files Provided
10
  | Name | Quant | Bits | File Size | Remark |
11
  | ------------------------ | ------- | ---- | --------- | -------------------------------- |
12
- | garrulus-7b.IQ3_XXS.gguf | IQ3_XXS | 3 | 2.82 GB | 3.06 bpw quantization |
13
- | garrulus-7b.IQ3_S.gguf | IQ3_S | 3 | 2.96 GB | 3.44 bpw quantization |
14
- | garrulus-7b.IQ3_M.gguf | IQ3_M | 3 | 3.06 GB | 3.66 bpw quantization mix |
15
- | garrulus-7b.Q4_0.gguf | IQ4_NL | 4 | 3.87 GB | 4.25 bpw non-linear quantization |
16
- | garrulus-7b.IQ4_NL.gguf | IQ4_NL | 4 | 3.87 GB | 4.25 bpw non-linear quantization |
17
- | garrulus-7b.Q4_K_M.gguf | Q4_K_M | 4 | 4.07 GB | 3.80G, +0.0532 ppl |
18
- | garrulus-7b.Q5_K_M.gguf | Q5_K_M | 5 | 4.78 GB | 4.45G, +0.0122 ppl |
19
- | garrulus-7b.Q6_K.gguf | Q6_K | 6 | 5.53 GB | 5.15G, +0.0008 ppl |
20
- | garrulus-7b.Q8_0.gguf | Q8_0 | 8 | 7.17 GB | 6.70G, +0.0004 ppl |
21
 
22
  ## Parameters
23
  | path | type | architecture | rope_theta | sliding_win | max_pos_embed |
 
9
  ## Files Provided
10
  | Name | Quant | Bits | File Size | Remark |
11
  | ------------------------ | ------- | ---- | --------- | -------------------------------- |
12
+ | garrulus-7b.IQ3_XXS.gguf | IQ3_XXS | 3 | 3.02 GB | 3.06 bpw quantization |
13
+ | garrulus-7b.IQ3_S.gguf | IQ3_S | 3 | 3.18 GB | 3.44 bpw quantization |
14
+ | garrulus-7b.IQ3_M.gguf | IQ3_M | 3 | 3.28 GB | 3.66 bpw quantization mix |
15
+ | garrulus-7b.Q4_0.gguf | IQ4_NL | 4 | 4.11 GB | 4.25 bpw non-linear quantization |
16
+ | garrulus-7b.IQ4_NL.gguf | IQ4_NL | 4 | 4.16 GB | 4.25 bpw non-linear quantization |
17
+ | garrulus-7b.Q4_K_M.gguf | Q4_K_M | 4 | 4.37 GB | 3.80G, +0.0532 ppl |
18
+ | garrulus-7b.Q5_K_M.gguf | Q5_K_M | 5 | 5.13 GB | 4.45G, +0.0122 ppl |
19
+ | garrulus-7b.Q6_K.gguf | Q6_K | 6 | 5.94 GB | 5.15G, +0.0008 ppl |
20
+ | garrulus-7b.Q8_0.gguf | Q8_0 | 8 | 7.70 GB | 6.70G, +0.0004 ppl |
21
 
22
  ## Parameters
23
  | path | type | architecture | rope_theta | sliding_win | max_pos_embed |