Can SenseVoiceSmall be registered and run locally instead of downloading from HuggingFace? #2449
Replies: 1 comment
-
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I am trying to run a local version of SenseVoiceSmall (I am assuming that my production environment will not have access to download a model from HuggingFace), but am coming across the error '{model path} is not registered', despite attempting to use the tables.register() method. Is it possible to register a local copy of the SenseVoiceSmall and use it with AutoModel, and if so, how do I do so? Thanks in advance!
Reference code:
model_dir = "SenseVoiceSmall/model.pt" # downloaded from HuggingFace to be used locally
tables.register('SenseVoiceSmall', 'SenseVoice/model.py') # SenseVoice is the cloned SenseVoice code
#tables.register('SenseVoiceSmall', model_dir)
model = AutoModel(model=model_dir, device="cuda:0", hub=None)
Beta Was this translation helpful? Give feedback.
All reactions