Faster transcription using JAX

[Mage-Enderman]

https://github.com/sanchit-gandhi/whisper-jax

Found out about it from this video
https://www.youtube.com/watch?v=E6-V86n61Qg

[walkersevenonethreenineone]

Is it possible to install this JAX Whisper for offline usage?
I just can't find any solution...
Especially for Windows...

[Lucas7AC]

How do I put this on buzz?

[raivisdejus]

My testing of whisper-jax did not show significantly faster results than faster-whisper on CPU or GPU. The claim of 70x faster speed is on specialized TPU hardware that most people usually do not have.

whisper-jax is currently not available in buzz

[raivisdejus]

A few notes for future:

• JAX needs a separate version of jaxlib for CPU and GPU, to implement it in Buzz this should be sorted out.
• Batched processing for Faster whisper is very fast, as claimed on their Github 3-4x faster than regular faster whisper. Once that has stable release, it could be implemented in Buzz.