Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added deletion of cache files and updated interface of iOS LlmTaskRunner and LlmInference #5191

Open
wants to merge 13 commits into
base: master
Choose a base branch
from

Conversation

priankakariatyml
Copy link
Collaborator

  1. Moved caching logic to LlmTaskRunner
  2. Added method to interface of LlmInference for deleting all caches.
  3. Updated property types in LlmInference.Options
  4. Added an extra check to see if provided modelPath is valid. As a result updated LlmInference and LlmTaskRunner inits to be throwing methods.
  5. Updated access modifiers of some classes.

@priankakariatyml
Copy link
Collaborator Author

priankakariatyml commented Mar 6, 2024

@mbrenon Our Google workspace is down. In case you need anything, LMK here. Or how we can communicate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant