-
Notifications
You must be signed in to change notification settings - Fork 211
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
any possibility / estimation of work necessary to support mps
device
#1243
Comments
My 2c, surely Dan, Fangjun, and others could tell you more: besides the need to re-write the kernels for metal, you'd have to somehow work around the design based on lambdas. CUDA and moderngpu let you write the kernels as lambda functions, you'd need to figure out how to make metal work with that (IIRC k2 heavily relies on moderngpu). |
Yes, Piotr is right. |
This is more like a feature request / discussion.
Apple Silicon might not be the best hardware to train FSA/FST models and k2 does not officially support training on the metal shader accelerated devices.
I tried running a training for a stateless transducer zipformer with the necessary device arguments (instead of
cpu
) and ran into problems e.g. with theRaggedArray
implementation here.What would be a rough estimate to rudimentary implement
mps
support? Could anybody give me pointers where to start?The text was updated successfully, but these errors were encountered: