Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Requirements for the DS-Coder-V2-Instruct #26

Open
Urvesh71 opened this issue Jul 2, 2024 · 3 comments
Open

Requirements for the DS-Coder-V2-Instruct #26

Urvesh71 opened this issue Jul 2, 2024 · 3 comments

Comments

@Urvesh71
Copy link

Urvesh71 commented Jul 2, 2024

I want to know the Wondows system requirements of the below versions of DeepSeek Coder V2 (236 TB and 21B AP). I am using the system with specifications mentioned below:

Device Name: ####
Full Device Name: #####
Processor: 11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz (4 cores, 8 threads)
Installed RAM: 16.0 GB (15.3 GB usable)
Device ID: ###
Product ID: ###
System Type: 64-bit operating system, x64-based processor
Integrated GPU: Intel Iris Xe Graphics
Dedicated GPU: NVIDIA T500
Pen and Touch Input: No pen or touch input is available for this display

Can you also suggest me which version of DeepSeek Coder V2 I can use based on the system I have.

@guoday
Copy link
Contributor

guoday commented Jul 3, 2024

DeepSeek-Coder-V2-Lite-Instruct

@Urvesh71
Copy link
Author

Urvesh71 commented Jul 3, 2024

Thank you @guoday . Do you also know or is there any information about the System Requirements to use DeepSeek Coder V2 (Without Lite) version?

@viktara
Copy link

viktara commented Jul 8, 2024

https://github.com/deepseek-ai/DeepSeek-Coder-V2#6-how-to-run-locally
says
If you want to utilize DeepSeek-Coder-V2 in BF16 format for inference, 80GB*8 GPUs are required

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants