busayor / special_tokens_map.json
Busayor's picture
Upload tokenizer
c906f77 verified
raw
history blame contribute delete
47 Bytes
{
"pad_token": "|",
"unk_token": "<unk>"
}