Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding Ollama and other LLMs support #765

Open
Haze-sh opened this issue Aug 24, 2024 · 3 comments
Open

Adding Ollama and other LLMs support #765

Haze-sh opened this issue Aug 24, 2024 · 3 comments

Comments

@Haze-sh
Copy link
Contributor

Haze-sh commented Aug 24, 2024

I would like to have autotagging with LLM support, firstly we should have Ollama support for offline tagging and for privacy reasons and we could add other services too, I think I can work on this.

I don't know how does tagging currently works, it seems inconsistent and I can't find a way to retag my whole database, Is there is a way for that so we can start from this point?

@LeXofLeviafan
Copy link
Collaborator

That sounds like a somewhat heavy feature, and possibly obscure / heavy on personal preference…

I've been thinking of implementing a plugin API as part of upcoming customization functionality; perhaps using that would be a better approach instead?

@Haze-sh
Copy link
Contributor Author

Haze-sh commented Aug 24, 2024

Could be heavy or not, dependable how it would be implemented. It could be something like if ollama exists -> then add tags and this could be built-in if it doesn't affect the performance or as a python script (likely would need langchain).

@LeXofLeviafan
Copy link
Collaborator

For the time being, you can try implementing an external Python script that uses buku as a library. Bukuserver seems to manage doing that well enough, so going over the existing records and updating data when necessary should not pose much of a challenge. (Alternatively you can check unit tests – they should work alright as usage examples.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants