Stateful/Memory models #20619

bhack started this conversation in Ideas / Feature Requests

bhack
May 9, 2024

How we are going to support stateful model in onnxruntime?
The majority of video segmentation models are going to manage an internal memory inside the same inference session:
https://github.com/hkchengrex/XMem
https://github.com/hkchengrex/Cutie
https://github.com/yoxu515/aot-benchmark/
etc..

See also the thread at:
pytorch/serve#2743 (comment)

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment