PEFT How to use alexshengzhili/llava-lora-dpo-1227lrvtail2000_sft-self-sampled-beta-0.5-lr-5e-5-avg-False-epoch-2 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("/home/ubuntu/LLaVA/checkpoints/llava-v1.5-13b-steer-lora-helpsteerformat-interleaf-lrv3067llava3067-likert-1222_interleavedgpt4v_responseonly-pure-merged")
model = PeftModel.from_pretrained(base_model, "alexshengzhili/llava-lora-dpo-1227lrvtail2000_sft-self-sampled-beta-0.5-lr-5e-5-avg-False-epoch-2") 
