Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bring your own model docs #291

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

mateoperezrivera
Copy link
Member

This pull request introduces a new feature that allows users to bring their own models to GPT-RAG, supporting various model providers. The documentation has been updated to include detailed instructions on configuring these models and setting the necessary environment variables.

Key changes include:

Documentation Updates:

  • Added a new section in docs/BRING_YOUR_OWN_MODEL.md explaining how to configure and use models from different providers, such as Azure OpenAI, OpenAI, Anthropic, Amazon Bedrock, Google, Vertex, Mistral, Ollama, and Onnx.
  • Provided a table listing the required environment variables and constructor settings for each provider, along with their necessity for integration.
  • Included guidance on using Key Vault for API key management instead of environment variables for certain providers.

@placerda
Copy link
Collaborator

placerda commented Feb 8, 2025

@gbecerra1982 @mateoperezrivera since this is specific to the SK Orchestrator, can we include just a reference to the documentation in that repository? There are other features belonging to the AG Orchestrator where we could do the same. As both orchestrators are expanding and offering different features, this approach will help organize the documentation within their respective repositories. Let's discuss this together.

Another example:
https://github.com/Azure/GPT-RAG/blob/main/docs/GUIDE.md#enabling-multimodality

@placerda placerda requested a review from gbecerra1982 February 9, 2025 19:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants