SicariusSicariiStuff
commited on
Commit
•
556fdcd
1
Parent(s):
65671bb
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,13 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
---
|
4 |
+
|
5 |
+
|
6 |
+
|
7 |
+
## Impish_LLAMA_3B is available at the following quantizations:
|
8 |
+
|
9 |
+
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B)
|
10 |
+
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_iMatrix)
|
11 |
+
- EXL2: [3.0 bpw](3333333) | [4.0 bpw](44444) | [5.0 bpw](5555555) | [6.0 bpw](6666666) | [7.0 bpw](7777777) | [8.0 bpw](888888)
|
12 |
+
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_FP8)
|
13 |
+
- Mobile (ARM): [Q4_0_X_X](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_ARM)
|