File size: 1,707 Bytes
3ee9864
 
 
01df0e0
17fefd3
01df0e0
17fefd3
01df0e0
17fefd3
01df0e0
17fefd3
d3635fc
 
7fcdcda
eea6f54
7fcdcda
3ee9864
 
 
 
eea6f54
0f6208c
eea6f54
 
 
1d2fb2b
d3635fc
3ee9864
 
 
 
17fefd3
eea6f54
d3635fc
3ee9864
 
 
 
 
 
1d2fb2b
 
 
88f89ee
1d2fb2b
 
 
 
 
 
fa2db83
1d2fb2b
 
 
17fefd3
1d2fb2b
eea6f54
1d2fb2b
 
 
 
 
 
 
 
 
88f89ee
 
1d2fb2b
 
88f89ee
 
 
 
 
 
 
 
 
 
c912961
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
---
language:
- en
- de
- fr
- it
- fa
- pt
- hi
- es
- th
- ja
- ko
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
---

# Model Card for Model ID

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6320e992beec1969845be447/25pTrbjySoblu8cuiHASu.png)
  
  Introducing Pixie Zehir Nano.

  Excelling in writing.
  
  A fine tune of LLAMA 3.2 3B on HQ DATA™ from Pixie Zehir.

## Model Details

- **Developed by:** [Maani x BLNKBLK]
- **Language(s) (NLP):** [English, Spanish, French, Persian, Hindi, Thai]
- **License:** [Apache 2.0]
- **Finetuned from model :** [meta-llama/Llama-3.2-3B-Instruct]


## Agreements

Model is created for research purposes, it can and will hallucinate, use with caution.

## Usage

```bash
!pip install transformers==4.45.0
```
```python
import torch
from transformers import pipeline
pipe = pipeline(
    "text-generation",
    model="Maani/PixieZehirNano",
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

messages = [
    {"role": "user", "content": "Write a haiku."},
]
prompt = pipe.tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
)
res = pipe(
    prompt,
    max_new_tokens=256,
    temperature=0.7,
    do_sample=True,
)
print(res[0]["generated_text"])
```
```markdown
Cutting Knowledge Date: December 2023
Today Date: 30 Sep 2024

<|eot_id|><|start_header_id|>user<|end_header_id|>

Write a haiku.<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Crescent moon's soft glow, A path unwinds beneath, Dreams and reality blur
```

Thanks to mradermacher, You can find the GGUF quantized versions of earlier 1.8B Zehir nano at: mradermacher/PixieZehirNano-GGUF