Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
1,808 workflow runs
1,808 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Fix issue with encodings for together models. (#483) Quality #1985: Commit 2073a29 pushed by clefourrier
January 7, 2025 08:23 2m 4s main
main
January 7, 2025 08:23 2m 4s
Implemented the possibility to load predictions from details files and continue evaluating from there Quality #1984: Pull request #488 synchronize by JoelNiklaus
January 7, 2025 06:11 3m 42s JoelNiklaus:load-details
JoelNiklaus:load-details
January 7, 2025 06:11 3m 42s
Add swiss legal evals as new community tasks Quality #1983: Pull request #389 synchronize by JoelNiklaus
January 7, 2025 04:30 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 7, 2025 04:30 Action required
Added cache for openai models. Quality #1982: Pull request #435 synchronize by JoelNiklaus
January 7, 2025 04:30 Action required JoelNiklaus:add-openai-cache
JoelNiklaus:add-openai-cache
January 7, 2025 04:30 Action required
Added custom model inference. Quality #1981: Pull request #437 synchronize by JoelNiklaus
January 7, 2025 04:29 Action required JoelNiklaus:add-custom-model
JoelNiklaus:add-custom-model
January 7, 2025 04:29 Action required
Fix issue with encodings for together models. Quality #1980: Pull request #483 synchronize by JoelNiklaus
January 7, 2025 04:26 2m 14s JoelNiklaus:fix-encoding-issue
JoelNiklaus:fix-encoding-issue
January 7, 2025 04:26 2m 14s
Made litellm judge backend more robust. Quality #1979: Pull request #485 synchronize by JoelNiklaus
January 7, 2025 04:26 2m 7s JoelNiklaus:fix-litellm-judge
JoelNiklaus:fix-litellm-judge
January 7, 2025 04:26 2m 7s
feat: add asian language support to CorpusLevelTranslationMetric Quality #1976: Pull request #479 synchronize by ryan-minato
January 7, 2025 00:25 2m 6s ryan-minato:feat/asian-lang-translate-metic
ryan-minato:feat/asian-lang-translate-metic
January 7, 2025 00:25 2m 6s
Update README.md (#486) Quality #1975: Commit f6fee3a pushed by clefourrier
January 6, 2025 12:45 2m 7s main
main
January 6, 2025 12:45 2m 7s
fix doc links in readme Quality #1974: Pull request #486 opened by NathanHB
January 6, 2025 11:31 2m 5s NathanHB-patch-1
NathanHB-patch-1
January 6, 2025 11:31 2m 5s
Add swiss legal evals as new community tasks Quality #1970: Pull request #389 synchronize by JoelNiklaus
January 4, 2025 10:18 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 4, 2025 10:18 Action required
Tiny improvements to endpoint_model.py, base_model.py,... (#219) Quality #1969: Commit 452e031 pushed by clefourrier
January 3, 2025 17:22 2m 6s main
main
January 3, 2025 17:22 2m 6s
Tiny improvements to endpoint_model.py, base_model.py,... Quality #1968: Pull request #219 synchronize by sadra-barikbin
January 3, 2025 15:33 2m 7s sadra-barikbin:small-improvement-in-models
sadra-barikbin:small-improvement-in-models
January 3, 2025 15:33 2m 7s
Fix T_co import bug Quality #1967: Pull request #484 opened by gucci-j
January 3, 2025 15:03 2m 8s gucci-j:fix-tco
gucci-j:fix-tco
January 3, 2025 15:03 2m 8s
Release: v0.7.0 Quality #1966: Commit 657978d pushed by NathanHB
January 3, 2025 14:02 2m 18s v0.7-release
v0.7-release
January 3, 2025 14:02 2m 18s
Add swiss legal evals as new community tasks Quality #1965: Pull request #389 synchronize by JoelNiklaus
January 3, 2025 11:55 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 3, 2025 11:55 Action required
Add swiss legal evals as new community tasks Quality #1964: Pull request #389 synchronize by JoelNiklaus
January 3, 2025 11:11 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 3, 2025 11:11 Action required
Fix issue with encodings for together models. Quality #1963: Pull request #483 opened by JoelNiklaus
January 3, 2025 10:47 2m 2s JoelNiklaus:fix-encoding-issue
JoelNiklaus:fix-encoding-issue
January 3, 2025 10:47 2m 2s
Add swiss legal evals as new community tasks Quality #1962: Pull request #389 synchronize by JoelNiklaus
January 2, 2025 16:41 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 2, 2025 16:41 Action required
Release: v0.7.0 Quality #1961: Commit e8a9058 pushed by NathanHB
January 2, 2025 16:12 2m 5s v0.7-release
v0.7-release
January 2, 2025 16:12 2m 5s
Homogeneize generation params (#428) Quality #1960: Commit 5a28b22 pushed by NathanHB
January 2, 2025 15:38 2m 8s v0.7-release
v0.7-release
January 2, 2025 15:38 2m 8s
Added custom model inference. Quality #1959: Pull request #437 synchronize by clefourrier
January 2, 2025 14:53 Action required JoelNiklaus:add-custom-model
JoelNiklaus:add-custom-model
January 2, 2025 14:53 Action required
Homogeneize generation params (#428) Quality #1958: Commit 5a28b22 pushed by clefourrier
January 2, 2025 14:40 2m 15s main
main
January 2, 2025 14:40 2m 15s
Add swiss legal evals as new community tasks Quality #1957: Pull request #389 synchronize by JoelNiklaus
January 2, 2025 13:40 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 2, 2025 13:40 Action required
Add swiss legal evals as new community tasks Quality #1956: Pull request #389 synchronize by JoelNiklaus
January 2, 2025 13:21 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 2, 2025 13:21 Action required