How to fix this error

[Algoroxyolo]

FileNotFoundError: No such file or directory: "/data/user_data/yunzex/models--huggyllama--llama-30b/snapshots/2b1edcdb3c7ced7bce6c1aa75c94545777c3118b/model-00001-of-00007.safetensors"
[2023-09-14 09:00:04 -0400] [405297] [INFO] Worker exiting (pid: 405297)
[2023-09-14 09:00:04 -0400] [405296] [ERROR] Worker (pid:405297) exited with code 3
[2023-09-14 09:00:04 -0400] [405296] [ERROR] Shutting down: Master
[2023-09-14 09:00:04 -0400] [405296] [ERROR] Reason: Worker failed to boot.

[Algoroxyolo]

the model wants .safetensor files but the downloadables are .bin files. What can I do

[CoderPat]

Hey! Sorry for the late reply. This repo is currently unmaintained. I recommend moving to https://github.com/CoderPat/text-generation-inference/pull/1/files, the current framework used at LTI for LLM serving. I'll update the README to reflect this. Cheers Patrick

…

On Fri, Sep 15, 2023 at 7:48 AM Yunze Xiao ***@***.***> wrote: the model wants .safetensor files but the downloadables are .bin files. What can I do — Reply to this email directly, view it on GitHub <#19 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACV2WM3M2V26WM6EWCJCXCDX2P24XANCNFSM6AAAAAA4YCIOOU> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>