Cannot load tokenizer for llama2

saireddy
Wed, 20 Mar 2024 14:14:02 +0000

tokenizer = AutoTokenizer.from_pretrained(model_id, token=access_token)
access_token can be generated from huggingface UI