Skip to content

Commit

Permalink
Modules working locally
Browse files Browse the repository at this point in the history
  • Loading branch information
alnutile committed Apr 14, 2024
1 parent 9387b7a commit cb53e18
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions Modules/LlmDriver/app/Helpers/JobMiddlewareTrait.php
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,13 @@ public function driverMiddleware(HasDrivers $hasDrivers): array
{
$defaults = [];

/**
* @NOTE
* basically Ollama can only handle one job
* at a time from what I can tell right now.
* So this prevents to many jobs hitting
* it at once
*/
if (LlmDriverFacade::driver($hasDrivers->getDriver())->isAsync()) {
return $defaults;
}
Expand Down

0 comments on commit cb53e18

Please sign in to comment.