How it is possible to set up evaluation metrics? #2336
-
|
Hi, I am using Axolotl to train my model but I wanted to evaluate my models on some metrics that do not seem to be included in the supported ones. Is it possible to define some custom callbacks for the evaluation? |
Beta Was this translation helpful? Give feedback.
Answered by
NanoCode012
Feb 17, 2025
Replies: 1 comment
-
|
Yes, you could add your custom callback within say, |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
Lopez-Antonio
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Yes, you could add your custom callback within say,
src/axolotl/utils/callbacks/__init__.py, and hack it intosrc/axolotl/core/trainer_builder.py'sget_callbackfn.