Help with custom handler.py for model inference endpoint

dgunzy
Thu, 22 Feb 2024 22:19:14 +0000

Hey Everyone!
I am having an issue where the custom endpoint I am creating on Hugging Face does not reflect the handler.py file that I have uploaded.

huggingface.co

dgunzy/capstone-t5-flan-summerizer at main

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

This is my model, and I have put the handler.py in the project root. When I create a new inference endpoint the documentation suggests ( Create custom Inference Handler ) that it will be detected and used, but I am not having any success. I am very new to this so any other suggestions are appreciated!

Read full topic