Run in webgpu

[pdufour]

Does anyone know if it's possible to run https://huggingface.co/nvidia/canary-1b via WebGPU? Possibly via https://github.com/xenova/transformers.js/ or https://github.com/mlc-ai/web-llm. I understand people have done it with whisper (https://huggingface.co/spaces/Xenova/whisper-webgpu) but wanted to try out canary.

I think maybe if I export it a ONNX version I can use it with transformers.js? https://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit/core/export.html

[Tejaswgupta]

@pdufour did you get an answer for this?