Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Proto] Data, Model and Pipeline Parallelism example #140

Draft
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

dominikandreasseitz
Copy link
Collaborator

@dominikandreasseitz dominikandreasseitz commented Feb 22, 2024

Closes #164

@dominikandreasseitz dominikandreasseitz changed the title ModelParallelism example [Feature] Data, Model and Pipeline Parallelism example Feb 22, 2024
@dominikandreasseitz dominikandreasseitz self-assigned this Mar 18, 2024
@dominikandreasseitz dominikandreasseitz added the feature New feature or request label Mar 18, 2024
@dominikandreasseitz dominikandreasseitz changed the title [Feature] Data, Model and Pipeline Parallelism example [Proto] Data, Model and Pipeline Parallelism example May 15, 2024
@dominikandreasseitz
Copy link
Collaborator Author

@awennersteen it looks like i wont be able to finish this MR, but it seems like something you would enjoy doing so please either try to finish the task yourself or pass it to someone

@RolandMacDoland
Copy link
Collaborator

@awennersteen it looks like i wont be able to finish this MR, but it seems like something you would enjoy doing so please either try to finish the task yourself or pass it to someone

I can also give it a try jointly with @awennersteen

@RolandMacDoland
Copy link
Collaborator

Hey @awennersteen do you think we can merge and close it ?

@awennersteen
Copy link
Member

Hi @Roland-djee

I forgot to respond here when it happened.

I remember the issue here more or less. It was an clever idea Dominik had to use multiple GPUs.
Frankly this was only clear to Dominik and I'm not entirely sure how to do this in a way where we really gain something.
The classical NN equivalent is a lot simpler to parallelize in this way, and it was never 100% clear if possible for quantum

That being difficult is part of the reason why it's stuck here.
Let me try to have a look at this now in August and I'll check if there is anything we'd really like to keep.

@RolandMacDoland
Copy link
Collaborator

Hi @Roland-djee

I forgot to respond here when it happened.

I remember the issue here more or less. It was an clever idea Dominik had to use multiple GPUs. Frankly this was only clear to Dominik and I'm not entirely sure how to do this in a way where we really gain something. The classical NN equivalent is a lot simpler to parallelize in this way, and it was never 100% clear if possible for quantum

That being difficult is part of the reason why it's stuck here. Let me try to have a look at this now in August and I'll check if there is anything we'd really like to keep.

Cool, thanks a lot !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature] Data, Model and Pipeline Parallelism example
3 participants