Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
---
|
| 5 |
+
This is a GPTQ quantized version of [LLaMA2-13B-Holomax](https://huggingface.co/KoboldAI/LLaMA2-13B-Holomax)
|
| 6 |
+
|
| 7 |
+
Please refer to the original creator for more information.
|
| 8 |
+
|
| 9 |
+
Branches:
|
| 10 |
+
|
| 11 |
+
- main: 4 bits, groupsize 128, act order false
|
| 12 |
+
- 4bit-128g-actorder: 4 bits, groupsize 128, act order true
|
| 13 |
+
- 4bit-32g-actorder: 4 bits, groupsize 32, act order true
|