Qwen/Qwen1.5-7B-Chat RuntimeError: The serialized model is larger than the 2GiB ORTModelForCausalLM

[SantoshHF]

@regisss I tried the steps as in

Optimum Failed download of jina-embeddings-v2-base-es

Hi @Benitoski! If you just want to use an existing ONNX checkpoint in jina-embeddings-v2-base-es, you can simply load it with: from optimum.onnxruntime import ORTModelForMaskedLM model = ORTModelForMaskedLM.from_pretrained("jinaai/jina-embeddings-v2-base-es", file_name="onnx/model.onnx") The command you ran actually exports the model from the PyTorch checkpoint.