Update README.md
Browse files
README.md
CHANGED
@@ -41,7 +41,7 @@ Model is created for research purposes, it can and will hallucinate, use with ca
|
|
41 |
## Usage
|
42 |
|
43 |
```bash
|
44 |
-
pip install transformers==4.45.0
|
45 |
```
|
46 |
```python
|
47 |
import torch
|
@@ -64,9 +64,20 @@ prompt = pipe.tokenizer.apply_chat_template(
|
|
64 |
res = pipe(
|
65 |
prompt,
|
66 |
max_new_tokens=256,
|
|
|
|
|
67 |
)
|
68 |
print(res[0]["generated_text"])
|
69 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
70 |
```
|
71 |
|
72 |
Thanks to mradermacher, You can find the GGUF quantized versions of earlier 1.8B Zehir nano at: mradermacher/PixieZehirNano-GGUF
|
|
|
41 |
## Usage
|
42 |
|
43 |
```bash
|
44 |
+
!pip install transformers==4.45.0
|
45 |
```
|
46 |
```python
|
47 |
import torch
|
|
|
64 |
res = pipe(
|
65 |
prompt,
|
66 |
max_new_tokens=256,
|
67 |
+
temperature=0.7,
|
68 |
+
do_sample=True,
|
69 |
)
|
70 |
print(res[0]["generated_text"])
|
71 |
+
```
|
72 |
+
```markdown
|
73 |
+
Cutting Knowledge Date: December 2023
|
74 |
+
Today Date: 30 Sep 2024
|
75 |
+
|
76 |
+
<|eot_id|><|start_header_id|>user<|end_header_id|>
|
77 |
+
|
78 |
+
Write a haiku.<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
79 |
+
|
80 |
+
Crescent moon's soft glow, A path unwinds beneath, Dreams and reality blur
|
81 |
```
|
82 |
|
83 |
Thanks to mradermacher, You can find the GGUF quantized versions of earlier 1.8B Zehir nano at: mradermacher/PixieZehirNano-GGUF
|