Error hosting endpoint when deploying model

philschmid
Mon, 11 Sep 2023 08:39:01 +0000

You cannot deploy 70B on g5.2xlarge instance, see: Deploy Llama 2 7B/13B/70B on Amazon SageMaker