I have model which I want to evaluate how and where can i do this . like I want to use some visual ques answering and some math benchmarks also. thanks for help in advance

Like this? [image] How can I evaluate a fine tuned LLM? Intermediate Hi there! I am curious about how fine tuned large language models are evaluated? I mean, I fine tuned a model for specific task like a question-answer chatbot for my business but how can I decide to my la…

Ohh but how dp people evaluate their models on standard benchmarks like MMLU, docVQA, etc. which we see in model releases and papers.

You could probably run each benchmark individually, but if you’re thinking about comparing it to other models, it might be more reliable and easier to ask the model to evaluate the leaderboard. [image] What's going on with the Open LLM Leaderboard? We’re on a journey to advance and democ…

I’m New to huggingface.co . I know this wrong area where I’m posting this but there’s no one to answer my question, I hope you guys will tolerate me. I’m running facefusion… and had processed a video which is saved in "/tmp " But I don’t know how to access that directory any help? The video was st…

Here. I don’t understand the situation well. There are multiple Face Fusions… [image] How to access /tmp files Beginners I’m running facefusion… and had processed a video which is saved in "/tmp " But I don’t know how to access that directory any help?

try this: [image] GitHub - EleutherAI/lm-evaluation-harness: A framework for few-shot evaluation of language... A framework for few-shot evaluation of language models.

Evaluating my own model

Intermediate

John6666 February 21, 2025, 10:16am 6

Here. I don’t understand the situation well. There are multiple Face Fusions…

Topic		Replies	Views
How to Evaluate Fine-Tuned LLMs? Models	3	298	November 27, 2025
How can I evaluate a fine tuned LLM? Intermediate	4	2619	January 7, 2025
Open-LLM-Leaderboard for dummies Intermediate	3	499	December 30, 2024
Evaluate fine-tuned LLM for question answering Beginners	1	145	May 2, 2025
Reasoning LLM Benchmarking 🤗Transformers	2	4033	March 24, 2025

Evaluating my own model

Related topics