You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You would specify a special humanScorer() in the scores array passed to evalite()
In the UI, you could mark the result with a tick or cross
This would be saved to a local JSON file, keyed under the eval name, input, expected and output. (this means that if the input, expected or output changes, the human score would be invalidated)
The UI would then retrieve this JSON information where needed to display the scores.
The text was updated successfully, but these errors were encountered:
The idea is:
humanScorer()
in thescores
array passed toevalite()
The text was updated successfully, but these errors were encountered: