Enhancement: OpenAI Assistants API V2 support

[danny-avila]

Discussed in #2489

^{Originally posted by sathyarajv April 22, 2024}
OpenAI updated the Assistants API to V2 with changes to the tools and files. Refer the Migration steps here

Known issues: The attached files of an existing Assistants are not loading in the UI but its available on the OpenAI platform. Migrating to V2 will resolve this issue.

Any plan on this migration?

[scottbetza]

Will this enhancement planned for v0.7.3 milestone completion allow for > 20 files?

[danny-avila]

Will this enhancement planned for v0.7.3 milestone completion allow for > 20 files?

yes I think it's possible through vector stores

[danny-avila]

Due to several undocumented, breaking and non-breaking changes, as well as gpt-4o support being exclusive to v2, this is a priority item for this week.

[danny-avila]

Just a quick preview of what will be possible with Assistants V2 (also using gpt-4o):

Recording.2024-05-16.170411.mp4

[danny-avila]

I've made a lot of progress, and the initial support is almost done but not quite ready.

Azure integration breaks with the latest openai SDK versions, so I need to write old v1 methods for Azure file handling. Because of the differences with Azure, even later on, I've decided to make Azure Assistants its own endpoint, and there are also a few things to touch on to complete that process.

The way file attachments now work for tool resources is not fully complete for Code Interpreter, but is nearly done (just need to handle deleting from its tool_resources)

This is saying nothing of the new File Search vector store handling. This needs a completely new UI and file management system, which I've already started earlier this week.

My goal is to release the initial support tomorrow, with the ability to use all v2 features including file search, but no way manage/attach vector stores for file search yet, other than attaching files at the thread level.

I've addressed a lot of fixes for Assistants in the process, so I'm excited to get this out soon!