Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

flexible message Content-Type handling #2

Open
Lance-Drane opened this issue Feb 18, 2025 · 0 comments
Open

flexible message Content-Type handling #2

Lance-Drane opened this issue Feb 18, 2025 · 0 comments

Comments

@Lance-Drane
Copy link
Contributor

On the INTERSECT-SDK side, the eventual plan is for the message body to be only the raw data being sent, and having all metadata stored on protocol-level headers. This will allow for us to bypass a number of JSON encoding/decoding steps which must currently take place.

  • switch from Server-Sent-Events (requires UTF-8 strings using the \n character as a delimiter) to Websockets ; this will be needed for certain data which is sent as a raw binary blob
  • encode the entire message metadata (into i.e. JSON) and write it in before the final message delimiter
  • (MAYBE:) have an additional "source" field as we currently have and evaluate that eagerly. This allows us to skip encoding/decoding JSON unless interacting directly with the message broker.

Ref: INTERSECT-SDK/python-sdk#8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant