Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于MoE进行的all to all通信实现在代码里的哪一部分？似乎没有找到 #245

Open
1195343015 opened this issue Jan 8, 2025 · 2 comments
Open

关于MoE进行的all to all通信实现在代码里的哪一部分？似乎没有找到 #245

1195343015 opened this issue Jan 8, 2025 · 2 comments

Comments

@1195343015
Copy link

No description provided.

@jinhao2
Copy link

jinhao2 commented Jan 10, 2025

现在肯定没有这些核心代码，不知道后面会不会继续开源。
目前 100%的python代码，真正的核心算子、通信接口都没开源。

@1195343015
Copy link
Author

现在肯定没有这些核心代码，不知道后面会不会继续开源。 目前 100%的python代码，真正的核心算子、通信接口都没开源。

谢谢你的回复，我现在在看vLLM中对deepseek v3的实现，感觉它的all to all通信似乎是直接实现在cuda代码里的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jinhao2 @1195343015