tokenizer:vocabulary-size

(tokenizer:vocabulary-size tk)

The number of ids the vocabulary defines -- the length of the tokens sequence tokenizer:make-bpe was given, special tokens included. This is the number a model's classifier head has to agree with.