SicariusSicariiStuff commited on
Commit
3870ec9
1 Parent(s): 556fdcd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +102 -1
README.md CHANGED
@@ -10,4 +10,105 @@ license: apache-2.0
10
  - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_iMatrix)
11
  - EXL2: [3.0 bpw](3333333) | [4.0 bpw](44444) | [5.0 bpw](5555555) | [6.0 bpw](6666666) | [7.0 bpw](7777777) | [8.0 bpw](888888)
12
  - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_FP8)
13
- - Mobile (ARM): [Q4_0_X_X](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_ARM)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_iMatrix)
11
  - EXL2: [3.0 bpw](3333333) | [4.0 bpw](44444) | [5.0 bpw](5555555) | [6.0 bpw](6666666) | [7.0 bpw](7777777) | [8.0 bpw](888888)
12
  - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_FP8)
13
+ - Mobile (ARM): [Q4_0_X_X](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_ARM)
14
+
15
+
16
+
17
+
18
+
19
+
20
+ # Model instruction template: Llama-3-Instruct
21
+
22
+ ```
23
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
24
+
25
+ {system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
26
+
27
+ {input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
28
+
29
+ {output}<|eot_id|>
30
+ ```
31
+
32
+ **Recommended generation Presets:**
33
+
34
+ <details>
35
+ <summary><b>Midnight Enigma</b></summary>
36
+ max_new_tokens: 512
37
+
38
+ temperature: 0.98
39
+
40
+ top_p: 0.37
41
+
42
+ top_k: 100
43
+
44
+ typical_p: 1
45
+
46
+ min_p: 0
47
+
48
+ repetition_penalty: 1.18
49
+
50
+ do_sample: True
51
+
52
+ </details>
53
+
54
+ <details>
55
+ <summary><b>min_p</b></summary>
56
+ max_new_tokens: 512
57
+
58
+ temperature: 1
59
+
60
+ top_p: 1
61
+
62
+ top_k: 0
63
+
64
+ typical_p: 1
65
+
66
+ min_p: 0.05
67
+
68
+ repetition_penalty: 1
69
+
70
+ do_sample: True
71
+
72
+ </details>
73
+
74
+ <details>
75
+ <summary><b>Divine Intellect</b></summary>
76
+ max_new_tokens: 512
77
+
78
+ temperature: 1.31
79
+
80
+ top_p: 0.14
81
+
82
+ top_k: 49
83
+
84
+ typical_p: 1
85
+
86
+ min_p: 0
87
+
88
+ repetition_penalty: 1.17
89
+
90
+ do_sample: True
91
+
92
+ </details>
93
+
94
+ <details>
95
+ <summary><b>simple-1</b></summary>
96
+ max_new_tokens: 512
97
+
98
+ temperature: 0.7
99
+
100
+ top_p: 0.9
101
+
102
+ top_k: 20
103
+
104
+ typical_p: 1
105
+
106
+ min_p: 0
107
+
108
+ repetition_penalty: 1.15
109
+
110
+ do_sample: True
111
+
112
+ </details>
113
+
114
+ # Model Details