Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create tutorials on common use cases and update docs #184

Open
ianarawjo opened this issue Dec 4, 2023 · 0 comments
Open

Create tutorials on common use cases and update docs #184

ianarawjo opened this issue Dec 4, 2023 · 0 comments
Labels
documentation Improvements or additions to documentation

Comments

@ianarawjo
Copy link
Owner

ianarawjo commented Dec 4, 2023

ChainForge is great for rapid prototyping and sensemaking of LLM outputs across prompts and models. However, this "rapid evaluation" is lost in its name.

To help this problem, I suggest creating dual blog posts-video tutorials on common use cases (see https://x.com/allafarce/status/1731816710250897658?s=20). The two most common are:

  • evaluating across prompt templates, showcasing template chaining and Table View
  • evaluating across multiple LLMs, for instance PRO models hosted on HuggingFace versus Claude-2

We should also update docs. There have been some nodes added to ChainForge, and the CSV Node has been renamed to Items Node. These changes should be reflected in the docs.

@ianarawjo ianarawjo added the documentation Improvements or additions to documentation label Dec 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant