Since we can now load a tokenizer directly based on the name of a Huggingface tokenizer, the old class is no longer needed and should be removed. Along with the class, we can also clean up the tests
Since we can now load a tokenizer directly based on the name of a Huggingface tokenizer, the old class is no longer needed and should be removed.
Along with the class, we can also clean up the tests