Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallel execution of MongoSink operations #624

Open
paualarco opened this issue Apr 24, 2021 · 0 comments
Open

Parallel execution of MongoSink operations #624

paualarco opened this issue Apr 24, 2021 · 0 comments
Labels
enhancement New feature or request mongodb

Comments

@paualarco
Copy link
Member

paualarco commented Apr 24, 2021 •
edited
Loading

Add new and more performant variants for the existing Sinks for the MongoDb connector that allows parallel execution of the operations. That would imply adding new signatures that expect a list of events instead of single ones.

The new signatures might be called same as the method but adding a Parallel suffix:

Example: cmd.sink.updateMany and (updateManyPar or updateManyBatch)
@paualarco paualarco added the enhancement New feature or request label Jun 9, 2021
MattSzm added a commit to MattSzm/monix-connect that referenced this issue May 26, 2022
@MattSzm
Created poc of sink parallel execution (monix#624)
c93a759
MattSzm added a commit to MattSzm/monix-connect that referenced this issue Jun 4, 2022
@MattSzm
Migrated sink methods + wrote tests + created documentation (monix#624)
6bef456
MattSzm added a commit to MattSzm/monix-connect that referenced this issue Jun 4, 2022
@MattSzm
improved documentation (monix#624)
97fdbf5
MattSzm added a commit to MattSzm/monix-connect that referenced this issue Jun 18, 2022
@MattSzm
fixed flaky updateManyPar test (monix#624)
a355bc7
MattSzm added a commit to MattSzm/monix-connect that referenced this issue Jun 19, 2022
@MattSzm
updated names variables in updateManyPar (monix#624)
f3195eb
paualarco pushed a commit that referenced this issue Jun 19, 2022
@MattSzm
Created sink parallel execution (#624) (#917)
4c53530 
Created sink parallel execution (#624) (#917)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request mongodb
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@paualarco