Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

289 Open 723 Closed
289 Open 723 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

default_transforms() Missing cosine_similarity Transform for Docs with Token Count 101–500 bug Something isn't working module-testsetgen Module testset generation
#1932 opened Feb 20, 2025 by rgrizzo-linksmt
1
Unable to get scores for all the examples in the DataFrame. Instead getting the combined score for the Whole dataframe.Need help to get the individual scores as well. answered 🤖 The question has been answered. Will be closed automatically if no new comments bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1931 opened Feb 20, 2025 by Rohith-pamidimarri
2
How can I delete the record on dashboard question Further information is requested
#1930 opened Feb 19, 2025 by andwizard
4
problem with answer_relevance - all time NAN for local llm bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1928 opened Feb 18, 2025 by spynet-us
Issues with await for language adapt bug Something isn't working module-testsetgen Module testset generation
#1925 opened Feb 14, 2025 by shawn-maxiao
1
How to use TongYi's text-embedding-v1 embeddings model question Further information is requested
#1922 opened Feb 14, 2025 by LillyChen
3
Use compression when saving knowledge graphs enhancement New feature or request module-testsetgen Module testset generation
#1916 opened Feb 11, 2025 by lryan599
1
Wrong cache hits for LlamaIndexEmbeddingsWrapper bug Something isn't working
#1915 opened Feb 11, 2025 by triedel42
The metric NoiseSensitivity always timeout bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1914 opened Feb 11, 2025 by hsx1612727380
Changing instruction language yields upload error bug Something isn't working question Further information is requested
#1912 opened Feb 10, 2025 by emseoyk
1 task done
@jjmachan
2
Context Precision Calculation module-metrics this is part of metrics module question Further information is requested
#1905 opened Feb 5, 2025 by ishachinniah-hds
2
StatementGeneratorPrompt's instruction mentions "statements", but these are not part of inputs anymore bug Something isn't working module-metrics this is part of metrics module
#1904 opened Feb 5, 2025 by diegodebrito
1
Generator Testset Portuguese Support module-testsetgen Module testset generation question Further information is requested
#1902 opened Feb 5, 2025 by jpfcabral
1
ModuleNotFoundError: No module named 'ragas.testset.evolutions' bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1897 opened Feb 2, 2025 by sahlebrahim
4
Discord invite links are invalid bug Something isn't working
#1896 opened Feb 1, 2025 by carlosgsouza
@jjmachan
3
does it support deepseek question Further information is requested
#1895 opened Feb 1, 2025 by landhu
2
Incorrect calculation at ToolCallAccuracy bug Something isn't working module-metrics this is part of metrics module
#1893 opened Feb 1, 2025 by licux
2
Response Relevancy: TypeError: object of type 'StringPromptValue' has no len() answered 🤖 The question has been answered. Will be closed automatically if no new comments bug Something isn't working module-metrics this is part of metrics module
#1892 opened Jan 30, 2025 by ishachinniah-hds
@jjmachan
9
Instability in answer relevance score bug Something isn't working question Further information is requested
#1889 opened Jan 30, 2025 by laughinghugs
@jjmachan
1
difference between retrieved contexts and reference contexts question Further information is requested
#1882 opened Jan 26, 2025 by Sara-Hossny
3
Traces in evaluation result are only saving the last prompt per trace name bug Something isn't working module-metrics this is part of metrics module
#1871 opened Jan 22, 2025 by VladTabakovCortea
1
@jjmachan
6
Error while executing the code example in the Migration Guide Documentation bug Something isn't working module-metrics this is part of metrics module
#1866 opened Jan 22, 2025 by GenAI-Rocky
1
How can I evaluate image retrieval? question Further information is requested
#1859 opened Jan 21, 2025 by simjak
2
How can I evaluate Ollama models such as Llama 3.3 using RAGAS? question Further information is requested
#1857 opened Jan 20, 2025 by HaniaMo
4
Prompt ${xx_prompt} failed to parse output: The output parser failed to parse the output including retries. bug Something isn't working question Further information is requested
#1856 opened Jan 20, 2025 by hsx1612727380
1
ProTip! Add no:assignee to see everything that’s not assigned.