Skip to content

Issues: explodinggradients/ragas

[R-263] Roadmap - v0.2
#1009 opened Jun 5, 2024 by jjmachan
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

94 Open 441 Closed
94 Open 441 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Non-ASCII characters in faithfulness metric bug Something isn't working
#1022 opened Jun 10, 2024 by mckbrchill
1
run_config missing bug Something isn't working module-metrics this is part of metrics module
#1021 opened Jun 7, 2024 by Mtuthuko
AttributeError: 'LangchainLLMWrapper' object has no attribute 'agenerate_prompt'. Did you mean: 'agenerate_text'? using llm and embeddings from Huggingface bug Something isn't working module-testsetgen Module testset generation
#1020 opened Jun 7, 2024 by Manel-Hik
RagasOutputParser exception handler should work synchronously when is_async=False enhancement New feature or request
#1019 opened Jun 6, 2024 by BaptisteBtx
[R-271] Tools to estimate cost of evaluation and testset generations
#1018 opened Jun 6, 2024 by jjmachan
[R-270] Synthetic test data generation module-testsetgen Module testset generation
#1016 opened Jun 5, 2024 by jjmachan
[R-269] Saving and tracking Ragas results
#1015 opened Jun 5, 2024 by jjmachan
[R-268] Synthetic test data generation
#1014 opened Jun 5, 2024 by jjmachan
[R-267] Saving and tracking Ragas results
#1013 opened Jun 5, 2024 by jjmachan
[R-266] New interface for LLMs
#1012 opened Jun 5, 2024 by jjmachan
[R-265] Ragas API and docker image
#1011 opened Jun 5, 2024 by jjmachan
[R-264] Metrics module-metrics this is part of metrics module
#1010 opened Jun 5, 2024 by jjmachan
[R-263] Roadmap - v0.2 enhancement New feature or request
#1009 opened Jun 5, 2024 by jjmachan
25 tasks
3
Synthetic Dataset Generation fail due to "ValueError: 'a' cannot be empty unless no samples are taken" bug Something isn't working module-testsetgen Module testset generation
#1006 opened Jun 4, 2024 by antoninoLorenzo
I think it is a good idea that put all evaluate prompt templates into together. question Further information is requested
#1005 opened Jun 3, 2024 by hwfancyz7k
JSON parser as association enhancement New feature or request
#1004 opened Jun 3, 2024 by wuodar
TestsetGenerator.from_langchain Generating failed, randomly stuck at 0% to 80%. bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1003 opened Jun 2, 2024 by pp6699
I've been encountering an issue where Ragas generates test cases from the initially uploaded documents, even after updating the documents and rerunning the process. It either uses the old documents or mixes them with the new ones. bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1002 opened Jun 1, 2024 by AliHaider0343
1
Output testset when using Llama 3 8B instruct model is not proper. question Further information is requested
#1000 opened May 31, 2024 by Nandakishore-Thekkadathu
1
Evaluation Error with Gemini/VertexAI: InvalidArgument due to Empty Text Content bug Something isn't working
#996 opened May 28, 2024 by baptiste-pasquier
1
Using context utilization without ground truth throws error message bug Something isn't working
#993 opened May 28, 2024 by dschwalm
How to save reason of each evaluation metrics? enhancement New feature or request module-metrics this is part of metrics module
#992 opened May 28, 2024 by JinSeoung-Oh
1
[R-262] ImportError: llama_index must be installed to use this function. Please, install it with pip install llama_index. bug Something isn't working linear Created by Linear-GitHub Sync module-testsetgen Module testset generation
#991 opened May 27, 2024 by Prabhjot410
1
division by zero when computing output score bug Something isn't working
#989 opened May 25, 2024 by theoden8
is_async missing in context_relevancy in ragas 0.1.8 bug Something isn't working module-metrics this is part of metrics module
#986 opened May 23, 2024 by abetatos
1
ProTip! Follow long discussions with comments:>50.