mypetdog / tokenizer

Commit History

Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json
d94dfa0
verified

csridhar commited on

Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json
314fe26
verified

csridhar commited on

Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json
4757776
verified

csridhar commited on

Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt
d446e0c
verified

csridhar commited on

Upload 5 files
518c091
verified

csridhar commited on