Replies: 1 comment
-
Same here. I need to use pipeline = transformers.pipeline(
"text-generation",
model=model,
tokenizer=tokenizer,
) |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Since
vllm.LLM
is not subclass oftransformers.PretrainedModel
, I can't use vllm likepipeline(model=vllm_model)
.My code is deeply coupled with Pipeline, and modifying multiple places to introduce vllm is troublesome for me.
Beta Was this translation helpful? Give feedback.
All reactions