Deploying open llm - google/flan-t5-large model on AWS inferentia2

divyaswamy87
Thu, 14 Sep 2023 17:09:07 +0000

Hi,
I am trying to deploy open llm - google/flan-t5-large model on AWS inferentia2. Can anyone help me with resources on how to deploy LLM on Inferentia 2. I have seen some doc on Llambda nothing on FLAN-T5

Thank you

Read full topic