SicariusSicariiStuff
commited on
Commit
•
e5bc00a
1
Parent(s):
d8e8a2a
Update README.md
Browse files
README.md
CHANGED
@@ -30,7 +30,7 @@ language:
|
|
30 |
|
31 |
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B)
|
32 |
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_iMatrix)
|
33 |
-
- EXL2: [
|
34 |
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_FP8)
|
35 |
- Mobile (ARM): [Q4_0_X_X](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_ARM)
|
36 |
|
|
|
30 |
|
31 |
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B)
|
32 |
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_iMatrix)
|
33 |
+
- EXL2: [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-8.0bpw)
|
34 |
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_FP8)
|
35 |
- Mobile (ARM): [Q4_0_X_X](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_ARM)
|
36 |
|