There is no way to stop / abort / cancel a pipeline()

[sroussey]

Feature request

Provide a way to abort a long running operation.

Motivation

Many things can take a long time (downloading a multi-gig model on 3G) or are not operating normally (infinite output) and the user may change their mind.

Your contribution

I can look into how to use AbortSignals for the download issue. Not sure what ONNX provides.

https://developer.mozilla.org/en-US/docs/Web/API/AbortSignal

Any API suggestion?

[xenova]

Good idea! I'm also open to API suggestions since this functionality isn't available in the python library. Following the examples in the docs, perhaps passing a signal parameter to calls to from_pretrained or pipeline could work. Similarly for calls to generate.