upgrade the open-flagminto-v2

[numb3r3]

The open-flagminto-v2 has just been released: https://laion.ai/blog/open-flamingo-v2/ We need to adopt it in opengpt for better compatible with huggingface.

[mvsoom]

Would be great:)

[saahil]

@mvsoom Hello, thanks for your feedback! Can you please tell us your use-case for which you'd like to use Flamingo v2?

[mvsoom]

Hi saahil :) I want to use its capability for interleaving text and images for describing a single scene consisting of several webcam pictures taken at regular intervals. So this goes a bit beyond image captioning because there are $N$ correlated images in the prompt. An example for $N=2$ is attached (this is a random picture I found on the web).

Example prompt for $N=2$:

<pic_1_description> Webcam capture taken 1 sec ago</pic_1_description> <pic_2_description> Webcam capture taken 0 sec ago</pic_2_description> Describe the scene consisting of these 2 images which are taken at 1 sec intervals