Some weights of the model checkpoint at ../DNABERT-2-117M/ were not used when initializing BertModel
#2
by Yudy95 - opened
Hi Zhihan,
When I load the model, it raises the following warnings. Is it in expectation?
Thanks for your help
Hey,
This is not expected. As shown in the warning, most of the weights are randomly initialized instead of been loaded. This is because the model I uploaded has different parameter name as the original BERT model. So please let the model with:
model = AutoModel.from_pretrained("zhihan1996/DNABERT-2-117M", trust_remote_code=True)
zhihan1996 changed discussion status to closed