You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add option to skip the default postprocess method of huggingface server, as users may want to postprocess the raw prediction results their own way, which may not be possible right now.
For example, let's take the sequence_classification task:
Currently, the postprocess makes it output only the predicted idx (i.e. 0, or 1). So let's say if a user wants to get the probabilities of each idx (i.e. {0: 0.61, 1: 0.39}), it is not possible even if they implement their own postprocess, because the default postprocess will run first.
Anything else you would like to add:
Links to the design documents:
[Optional, start with the short-form RFC template to outline your ideas and get early feedback.]
[Required, use the longer-form design doc template to specify and discuss your design in more detail]
The text was updated successfully, but these errors were encountered:
/kind feature
Describe the solution you'd like
Add option to skip the default
postprocess
method of huggingface server, as users may want to postprocess the raw prediction results their own way, which may not be possible right now.For example, let's take the
sequence_classification
task:kserve/python/huggingfaceserver/huggingfaceserver/model.py
Lines 352 to 358 in f678243
Currently, the
postprocess
makes it output only the predicted idx (i.e.0
, or1
). So let's say if a user wants to get the probabilities of each idx (i.e.{0: 0.61, 1: 0.39}
), it is not possible even if they implement their ownpostprocess
, because the defaultpostprocess
will run first.Anything else you would like to add:
Links to the design documents:
[Optional, start with the short-form RFC template to outline your ideas and get early feedback.]
[Required, use the longer-form design doc template to specify and discuss your design in more detail]
The text was updated successfully, but these errors were encountered: