File size: 5,852 Bytes
556fdcd b3abb8e 556fdcd b3abb8e ca9518b b3abb8e 556fdcd f7d7f29 d8e8a2a fb2b952 ab8307d 1e15d8a 6d745f7 8360ff0 6d745f7 8360ff0 6d745f7 8360ff0 72703d3 6d745f7 f1c17b8 6aa0083 f1c17b8 800c6ff f1c17b8 38dd9d6 f1c17b8 38dd9d6 f1c17b8 38dd9d6 556fdcd e5bc00a 556fdcd 3870ec9 6d745f7 a2a602b 6d745f7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 |
---
license: apache-2.0
language:
- en
---
<div align="center">
<b style="font-size: 40px;">Impish_LLAMA_3B</b>
</div>
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B/resolve/main/Images/Impish_LLAMA_3B.png" alt="Dusk Impish_LLAMA_3B" style="width: 70%; min-width: 500px; display: block; margin: auto;">
"With that naughty impish grin of hers, so damn sly it could have ensnared the devil himself, and that impish glare in her eyes, sharper than of a succubus fang, she chuckled impishly with such mischief that even the moon might’ve blushed. I needed no witch's hex to divine her nature—she was, without a doubt, a naughty little imp indeed."
### Reviews:
<details>
<summary><b>Review_1</b></summary>
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B/resolve/main/Images/1st_review.png" alt="Review_1" style="width: 100%; min-width: 700px; display: block; margin: left;">
</details>
<details>
<summary><b>Review_2</b></summary>
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B/resolve/main/Images/2nd_review.png" alt="Review_1" style="width: 100%; min-width: 700px; display: block; margin: left;">
</details>
## Model Details
- Intended use: **Role-Play**, General tasks.
- Censorship level: <b>Medium - Low</b>
- 5.5 / 10 (10 completely uncensored)
- UGI score:
<img src="https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B/resolve/main/Images/Impish_LLAMA_3B_UGI.png" alt="UGI Score" style="width: 100%; min-width: 700px; display: block;">
"I want some legit RP models of LLAMA 3.2 3B, we got phones!"
"So make one."
"K."
This model was trained on ~25M tokens, in **3 phases**, the first and longest phase was an FFT to teach the model new stuff, and to confuse the shit out of it too, so it would be **a little bit less inclined to use GPTisms**.
It worked pretty well. In fact, the model was so damn thoroughly confused, that the little devil didn't even make any sense at all, but the knowledge was there.
In the next phase, a DEEP QLORA of **R = 512** was used on a new dataset, to... unconfuse it. A completely different dataset was used to avoid overfitting.
Finally, another somewhat deep QLORA of **R = 128** was used to tie it all together in a coherent way, and connect all the dots, and this was also with a different dataset as well.
The results are **sometimes** surprisingly good, it even managed to fool some people into thinking it's a MUCH larger model, and sometimes... sometimes it behaves just like you would expect a 3B model to...
Fun fact: the model was uploaded while there were 200 ICBMs headed my way, just flying there in the sky.
I lived, so expect more models in the future!
## Impish_LLAMA_3B is available at the following quantizations:
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B)
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_iMatrix)
- EXL2: [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-8.0bpw)
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_FP8)
- Mobile (ARM): [Q4_0_X_X](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_ARM)
# Model instruction template: Llama-3-Instruct
```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{output}<|eot_id|>
```
**Recommended generation Presets:**
<details>
<summary><b>Midnight Enigma</b></summary>
max_new_tokens: 512
temperature: 0.98
top_p: 0.37
top_k: 100
typical_p: 1
min_p: 0
repetition_penalty: 1.18
do_sample: True
</details>
<details>
<summary><b>min_p</b></summary>
max_new_tokens: 512
temperature: 1
top_p: 1
top_k: 0
typical_p: 1
min_p: 0.05
repetition_penalty: 1
do_sample: True
</details>
<details>
<summary><b>Divine Intellect</b></summary>
max_new_tokens: 512
temperature: 1.31
top_p: 0.14
top_k: 49
typical_p: 1
min_p: 0
repetition_penalty: 1.17
do_sample: True
</details>
<details>
<summary><b>simple-1</b></summary>
max_new_tokens: 512
temperature: 0.7
top_p: 0.9
top_k: 20
typical_p: 1
min_p: 0
repetition_penalty: 1.15
do_sample: True
</details>
### Support
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">
- [My Ko-fi page](https://ko-fi.com/sicarius) ALL donations will go for research resources and compute, every bit is appreciated 🙏🏻
## Benchmarks
| Metric |Value|
|-------------------|----:|
|Avg. |17.60|
|IFEval (0-Shot) |46.30|
|BBH (3-Shot) |16.99|
|MATH Lvl 5 (4-Shot)|10.12|
|GPQA (0-shot) | 5.03|
|MuSR (0-shot) | 5.61|
|MMLU-PRO (5-shot) |21.57|
## Other stuff
- [Blog and updates](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.
- [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector.
- [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all. |