fuyu-8b / special_tokens_map.json
pcuenq's picture
pcuenq HF staff
Upload processor (#4)
8a9d74e
raw
history blame
156 Bytes
{
"additional_special_tokens": [
"<unk>",
"|ENDOFTEXT|"
],
"bos_token": "|ENDOFTEXT|",
"eos_token": "|ENDOFTEXT|",
"unk_token": "<unk>"
}