Transformers update warning
#37
by
BBLL3456
- opened
Hi, Thanks a lot for the app. I had the following warning while loading:
"Loading the tokenizer from the special_tokens_map.json and the added_tokens.json will be removed in transformers 5, it is kept for forward compatibility, but it is recommended to update your tokenizer_config.json by uploading it again. You will see the new added_tokens_decoder attribute that will store the relevant information.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained."
Appreciate if you could look into this. Thanks in advance.
BBLL3456
changed discussion status to
closed