| license: apache-2.0 | |
| language: | |
| - ko | |
| # KULLM project | |
| - base model: Upstage/SOLAR-10.7B-Instruct-v1.0 | |
| ## datasets | |
| - KULLM dataset | |
| - hand-crafted instruction data | |
| ## Implementation Code | |
| ```python | |
| from transformers import ( | |
| AutoModelForCausalLM, | |
| AutoTokenizer | |
| ) | |
| import torch | |
| repo = "heavytail/kullm-solar-S" | |
| model = AutoModelForCausalLM.from_pretrained( | |
| repo, | |
| torch_dtype=torch.float16, | |
| device_map='auto' | |
| ) | |
| tokenizer = AutoTokenizer.from_pretrained(repo) | |
| ``` | |
| Initial upload: 2024/01/28 21:00 |