TeeZee
/

Orca-2-13b_flat

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

TeeZee commited on Feb 19

Commit

7eb5756

•

1 Parent(s): 27318f5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -4,7 +4,7 @@ license_name: microsoft
 license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
 ---
-Lost of good models use Orca for their merges, however vanilla Orca has vocabulary size of 32003,
 3 last tokens are ChatML tokens and a PAD token. This causes errors during a merge with models with standard 32000 vocabulary size.
 I've removed those tokens from volabulary and resized model embeddings to mach 32000 standard size. So this model is ready to be used

 license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
 ---
+Lots of good models use Orca for their merges, however vanilla Orca has vocabulary size of 32003,
 3 last tokens are ChatML tokens and a PAD token. This causes errors during a merge with models with standard 32000 vocabulary size.
 I've removed those tokens from volabulary and resized model embeddings to mach 32000 standard size. So this model is ready to be used