-
Notifications
You must be signed in to change notification settings - Fork 159
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
请问支持在Mac M2机器上进行训练吗 #249
Comments
@mobguang 目前还不支持,需要在gpu上 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
你好,请问sft_train.py支持在Mac M2机器上对CodeLlama-13b-Instruct-hf进行训练吗。我这边尝试了一下,有如下错误信息:
attn_output = torch.nn.functional.scaled_dot_product_attention(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Expected attn_mask dtype to be bool or to match query dtype, but got attn_mask.dtype: c10::Half and query.dtype: float instead.
请问要如何调整一下代码以便可以支持在M2上进行训练,谢谢。
The text was updated successfully, but these errors were encountered: