DeepCache with image2image and img2img ControlNet for SDXL/SD1.5

[WyattAutomation]

🚀 The feature, motivation and pitch

Requested Feature: enable DeepCache acceleration in onedfiff for use with img2img and img2imgControlNet diffusers pipelines.

Alternatives

There are many other optimizations I use in my pipeline already, I just need DeepCache to work with OneDiff

Additional context

The performace boost according to your documentation from DeepCache+OneDiff is great enough that it would be a huge benefit to have it fully functional for img2img pipelines (at least). ControlNet and img2img ControlNet pipelines would also be extremely useful as a lot of realtime applications make heavy use of these for controlling the output of realtime SDXL and SD 1.5 rendering.

The below video demonstrates one such usecase: Multiple ControlNet outputs from NDI from Unity3D into OneDiff accelerated diffusers pipelines for interactive/realtime WASD/mouse control

Without DeepCache the speed is somewhat OK at 2 steps on a single rtx3090, but to be able to add just 1 or 2 extra denoising steps and retain this same speed per the performance boost added by DeepCache, would result in far more viable rendering quality for use in a realtime ControlNet+Agent based WASD-controlled videogame.

367620057-03de1e1f-5d9f-49c4-ade1-58f9743135a1.mp4