General question about large model loading

muellerzr
Tue, 13 Jun 2023 12:45:37 +0000

ykacer:

is it because the first model is a two-sharded model?

Yes, as we need the model sharded to load only a chunk of it in.