Hi @candowu, thanks for raising this issue. This is arising, because the tokenizer in the config on the hub points to LLaMATokenizer. However, the tokenizer in the library is LlamaTokenizer.

This is likely due to the configuration files being created before the final PR was merged in.

Change the LLaMATokenizer in tokenizer_config.json into lowercase LlamaTokenizer and it works like a charm.

Hi @candowu, thanks for raising this issue. This is arising, because the tokenizer in the config on the hub points to LLaMATokenizer. However, the tokenizer in the library is LlamaTokenizer.

This is likely due to the configuration files being created before the final PR was merged in.

@yhifny Are you able to import the tokenizer directly using from transformers import LlamaTokenizer ?

If not, can you make sure that you are working from the development branch in your environment using: pip install git+https://github.com/huggingface/transformers

more details here.

For anybody interested I was able to load an earlier saved model with the same issue using my fork with the capitalization restored. That being said for future it’s probably better to try find or save a new model with the new naming.

As the error message probably mentions, you need to install sentencepiece: pip install sentencepiece.

I cloned the repo and changed the tokenizer in the config file to LlamaTokenizer but I got ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

in my code, transformer==4.30.0 can fix it

Hi @candowu, thanks for raising this issue. This is arising, because the tokenizer in the config on the hub points to LLaMATokenizer. However, the tokenizer in the library is LlamaTokenizer. This is likely due to the configuration files being created before the final PR was merged in.

Change the LLaMATokenizer in tokenizer_config.json into lowercase LlamaTokenizer and it works like a charm.

I assume this is applied to the llama-7b cloned repo from HuggingFace right? How can I instantiate the model and the tokenizer after doing that please?

You should just using that checkpoint. The maintainers of that repo have made it clear that they are not interested in being compatible with Transformers by ignoring the 62 PRs trying to fix their checkpoints. The huggyllama checkpoints are confirmed to work if you are looking for an alternative (but you should still request the weights to Meta following their official form).

There are now 903 checkpoints for llama on the Hub and only the 4 from decapoda-research do not work since they created them before the PR for Llama was merged into Transformers. We won’t break the code for the other 899 checkpoints.

I face the same issue

I can import the LlamaTokenizer class, but getting error that from_pretrained method is None. Anyone else having this issue?

Install this library pip install -U transformers

            if( "LLaMATokenizer" == tokenizer_class_candidate ):  ## add these 2 line to solve it.
                tokenizer_class_candidate = 'LlamaTokenizer'  
            tokenizer_class = tokenizer_class_from_name(tokenizer_class_candidate)

Working now. I swear I had sentencepiece, but probably forgot to reset the runtime 🤦 My bad!

Please. Im facing the same issue. Can anyone help ? I tried all the above methods.

Hi @candowu, thanks for raising this issue. This is arising, because the tokenizer in the config on the hub points to LLaMATokenizer. However, the tokenizer in the library is LlamaTokenizer. This is likely due to the configuration files being created before the final PR was merged in.

Change the LLaMATokenizer in tokenizer_config.json into lowercase LlamaTokenizer and it works like a charm.

Can you please enlighten me on how this could be achieved please? I’m new to this

Will this problem be fixed by updating to newest version of transformers, or must we modify the config file manually each time?

Hi

I installed from source

git clone https://github.com/huggingface/transformers.git cd transformers pip install -e .

pip list show:

transformers 4.29.0.dev0 D:\myfolder\transformers

but I still have

ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

hey, try this rep pip install git+https://github.com/mbehm/transformers, maybe it can work

Please. Im facing the same issue. Can anyone help ? I tried all the above methods.

I had the same issue and it was solved by: pip uninstall transformers pip install transformers

Hi

I installed from source

git clone https://github.com/huggingface/transformers.git cd transformers pip install -e .

pip list show:

transformers 4.29.0.dev0 D:\myfolder\transformers

but I still have

ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

You can open the documentation at the install page.

You can try this for a ather crazy way to find out what is the right casing for the module:

import transformers

from itertools import product
import importlib

def find_variable_case(s, max_tries=1000):
  var_permutations = list(map("".join, product(*zip(s.upper(), s.lower()))))
  # Intuitively, any camel casing should minimize the no. of upper chars.
  # From https://stackoverflow.com/a/58789587/610569
  var_permutations.sort(key=lambda ss: (sum(map(str.isupper, ss)), len(ss)))
  for i, v in enumerate(var_permutations):
    if i > max_tries:
      return
    try:
      dir(transformers).index(v)
      return v
    except:
      continue


v = find_variable_case('LLaMatokenizer')
exec(f"from transformers import {v}")
vars()[v]

[out]:

transformers.utils.dummy_sentencepiece_objects.LlamaTokenizer

Thank you so much for this! Works! That’s amazing!

same error on model codellama/CodeLlama-13b-hf can onyone post a valid json config here ?

@ndvbd you should be able to use AutoTokenizer with any tokenizers on the hub. If you have an issue and want us to help you, we really need a small reproducer, and the full traceback.

For anyone still getting the same error:

• make sure you are using the correct version of transformers. print(transformers.__version__)
• if you are working on a notebook cc @youshikyou make sure to restart the kernel after you have installed the packages, to make sure the changes are taken into account.
• make sure the repository you are loading from (for example meta-llama/Llama-2-7b-hg) has the correct LlamaTokenizer class if you are using AutoModel.

If you have a different issue, make sure to open a new issue and ping me 🤗

@MasterLivens hi, i am currently using colab, which file should i add this code?

You need to install the library from source to be able to use the LLaMA model.

you are a life saver. There docs on the site should be updated for this reference.