Skip to content

Issues: JohnSnowLabs/langtest

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

70 Open 341 Closed
70 Open 341 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Blogpost on Leaderboard for Benchmarking models in locally
#1037 opened May 20, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Blogpost on Benchmarking Medical Datasets
#1036 opened May 20, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Blogpost for LLM Evaluation with Prometheus 2
#1035 opened May 20, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Templates for Chat Models for HuggingFace
#1034 opened May 17, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Add Support for Multi-Model with Multi-Dataset current release
#1033 opened May 17, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Include 'Better Safe Than Sorry' Dataset in Healthcare Test current release
#1026 opened May 13, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Improve the logging and it's functionalities current release
#1017 opened Apr 25, 2024 by chakravarthik27 2.3.0
@chakravarthik27
Exploring LLM2LLM for Data Augmentation
#1002 opened Apr 1, 2024 by chakravarthik27
Rate Limit feature for Azure/OpenAI results generation current release 💡Enhancements Something can be improved
#988 opened Feb 27, 2024 by Jeff-ZYX
1
implementation of a leaderboard for different quantizations (gguf 4 vs 6 vs etc bits)
#987 opened Feb 26, 2024 by chakravarthik27
Enhancing Data Quality Testing for Langtest ⭐ Feature Indicates new feature requests
#982 opened Feb 19, 2024 by RakshitKhajuria
Explore litellm
#978 opened Feb 6, 2024 by ArshaanNazir
Do Embedding Benchamark for different datasets
#973 opened Feb 2, 2024 by ArshaanNazir
Explore AI-Secure ⏭️ Next Release Issues or Request for the next release
#971 opened Jan 31, 2024 by ArshaanNazir
Explore Together AI embedding models ⏭️ Next Release Issues or Request for the next release
#968 opened Jan 30, 2024 by dcecchini
Try different Prompting Techniques like few shot, ER , COT etc
#959 opened Jan 15, 2024 by ArshaanNazir
1
Explore Galileo's hallucination index ⏭️ Next Release Issues or Request for the next release
#957 opened Jan 11, 2024 by dcecchini
Add tests for De-Identification ⏭️ Next Release Issues or Request for the next release
#954 opened Jan 4, 2024 by dcecchini
@chakravarthik27 @ArshaanNazir
1
Add Word Embedding (with Pooling) to benchmark ⏭️ Next Release Issues or Request for the next release
#950 opened Jan 2, 2024 by dcecchini
Preparing Embeddings Benchmarks (LangTest)
#947 opened Dec 27, 2023 by ArshaanNazir
@chakravarthik27 @ArshaanNazir
9
Preparing LLM Benchmark Table ( LangTest)
#946 opened Dec 27, 2023 by ArshaanNazir
@ArshaanNazir
9
Explore Cognitive biases in LLMs ⏭️ Next Release Issues or Request for the next release
#944 opened Dec 26, 2023 by ArshaanNazir
@RakshitKhajuria
Explore Context Length Parameter ⏭️ Next Release Issues or Request for the next release
#933 opened Dec 20, 2023 by ArshaanNazir
Explore MS promptbench ⏭️ Next Release Issues or Request for the next release
#931 opened Dec 18, 2023 by dcecchini
Add cross-encoder models for embedding similarities (new metric) ⏭️ Next Release Issues or Request for the next release
#921 opened Dec 8, 2023 by dcecchini
ProTip! Mix and match filters to narrow down what you’re looking for.