Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Audio Transcript heuristic for dynamic thread allocation on client #2023

Open
wants to merge 27 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
26a6d13
add reenqueue item property and fallbacktask
gfd2020 Dec 7, 2023
dd6570f
add heuristic config variables to be set on RemoteWav2VectTranscript
gfd2020 Dec 7, 2023
0adf8c8
add config variables treatment
gfd2020 Dec 7, 2023
b74ab22
ass requeue item property and fallbacktask
gfd2020 Dec 7, 2023
ab38841
compatibility fix for new properties
gfd2020 Dec 7, 2023
5b2748f
setup config parameters
gfd2020 Dec 7, 2023
57e49ad
setup fallback task and call it when necessary
gfd2020 Dec 7, 2023
ad1586f
add new reenqueue method with spaced positioning
gfd2020 Dec 7, 2023
de1fcf0
add new method to add itens on middle of the queue
gfd2020 Dec 7, 2023
e5687f6
add static variables and logic to control the requeue heuristic
gfd2020 Dec 7, 2023
6e54dda
resolve conflict
gfd2020 Jun 17, 2024
36a48d9
fix conflict
gfd2020 Jun 17, 2024
95be1ab
fix fork conflicts
gfd2020 Jun 17, 2024
5bf47e4
fix conflits
gfd2020 Jun 17, 2024
728c713
fix conflicts
gfd2020 Jun 17, 2024
e2b1f05
fix conflicts
gfd2020 Jun 17, 2024
2abc1ca
Merge branch 'sepinf-inc:master' into audio-transcript-heuristic
gfd2020 Jun 17, 2024
4c434b8
fix conflicts
gfd2020 Jun 17, 2024
0d870f3
fix conflicts
gfd2020 Jun 17, 2024
063ebef
Merge branch 'sepinf-inc:master' into audio-transcript-heuristic
gfd2020 Jun 20, 2024
7eaa8c8
fix conflict
gfd2020 Dec 30, 2024
5002684
fix conflict
gfd2020 Dec 30, 2024
2c26c82
fix conflict
gfd2020 Dec 30, 2024
378fd55
Merge branch 'sepinf-inc:master' into audio-transcript-heuristic
gfd2020 Dec 30, 2024
7878e60
fix conflict
gfd2020 Dec 30, 2024
fa70309
Merge branch 'sepinf-inc:master' into audio-transcript-heuristic
gfd2020 Jan 2, 2025
1571ccc
Merge branch 'sepinf-inc:master' into audio-transcript-heuristic
gfd2020 Feb 27, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add new reenqueue method with spaced positioning
gfd2020 committed Dec 7, 2023
commit ad1586fcaa6242ec930a5efe43e5689564d7b4db
16 changes: 16 additions & 0 deletions iped-engine/src/main/java/iped/engine/task/AbstractTask.java
Original file line number Diff line number Diff line change
@@ -18,6 +18,8 @@
import iped.engine.data.CaseData;
import iped.engine.io.TimeoutException;
import iped.parsers.util.CorruptedCarvedException;
import java.util.concurrent.atomic.AtomicInteger;
import java.util.concurrent.atomic.AtomicLong;

/**
* Classe que representa uma tarefa de procesamento (assinatura, hash, carving,
@@ -248,6 +250,20 @@ protected void sendToNextTask(IItem evidence) throws Exception {
}
}

protected void reEnqueueItemSpaced(IItem item, int numWorkers, AtomicInteger lastQueueIndex, AtomicLong lastQueueTime, int queueSplit, long queueDeltaTime) throws InterruptedException {
reEnqueueItemSpaced(item, worker.manager.getProcessingQueues().getCurrentQueuePriority(), numWorkers, lastQueueIndex, lastQueueTime, queueSplit, queueDeltaTime);
throw new ItemReEnqueuedException();
}

private void reEnqueueItemSpaced(IItem item, int queue, int numWorkers, AtomicInteger lastQueueIndex, AtomicLong lastQueueTime, int queueSplit, long queueDeltaTime) throws InterruptedException {
item.dispose();
SkipCommitedTask.checkAgainLaterProcessedParents(item);
worker.manager.getProcessingQueues().addItemToQueueSpaced(item, queue, numWorkers, lastQueueIndex, lastQueueTime, queueSplit, queueDeltaTime);
if (!item.isQueueEnd()) {
worker.decItemsBeingProcessed();
}
}

protected void reEnqueueItem(IItem item) throws InterruptedException {
reEnqueueItem(item, worker.manager.getProcessingQueues().getCurrentQueuePriority());
throw new ItemReEnqueuedException();