Upload vocab.txt

by helonky - opened Jul 5, 2022

←

vocab.txt has 39999 words doesn't match vocab_size 40000.
Found that '，' hides after '' in line 106.

Owner Jul 5, 2022

Thanks for find my bug！
Bug the token embeddings has trained by the order of token in vocab.txt，it can't be revised...
Sadlly

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment