Serialize and compress transactions

[ddimaria]

• JSON serialize and Zlib compress operations from core-to-client, client-to-multiplayer, multiplayer-to-client, and client-to-core
• Handle binary operations in multiplayer and files
• Update tests

[qa-wolf]

QA Wolf here! As you write new code it's important that your test coverage is keeping up.
Click here to request test coverage for this PR!

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated (UTC)
quadratic	✅ Ready (Inspect)	Visit Preview	Aug 14, 2024 5:59pm

[codecov]

Codecov Report

Attention: Patch coverage is 80.53691% with 29 lines in your changes missing coverage. Please review.

Project coverage is 90.67%. Comparing base (33bf2d7) to head (19d96a1).
Report is 201 commits behind head on qa.

Files	Patch %	Lines
...re/src/controller/execution/receive_multiplayer.rs	73.17%	11 Missing ⚠️
quadratic-multiplayer/src/message/handle.rs	70.00%	6 Missing ⚠️
quadratic-core/src/controller/transaction.rs	75.00%	5 Missing ⚠️
quadratic-rust-shared/src/pubsub/redis.rs	0.00%	5 Missing ⚠️
quadratic-multiplayer/src/message/response.rs	88.88%	1 Missing ⚠️
quadratic-rust-shared/src/pubsub/redis_streams.rs	90.90%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##               qa    #1607      +/-   ##
==========================================
+ Coverage   90.62%   90.67%   +0.04%     
==========================================
  Files         192      192              
  Lines       38441    38670     +229     
==========================================
+ Hits        34838    35063     +225     
- Misses       3603     3607       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[davidkircos]

tested a 3.3mb Parquet file
On this branch is 8mb, previously it was 48mb! This is sweet.

[AyushAgrawal-A2]

Importing 0.5M file fails, this works in main and qa.
1M and above file fails on main and qa.
Files link: https://github.com/datablist/sample-csv-files

[ddimaria]

Can not download .grid file

@davidkircos this is fixed. Please test once the branch deploys.

[davidkircos]

Can not download .grid file

@davidkircos this is fixed. Please test once the branch deploys.

Downloading files seems to work for me!

[ddimaria]

Importing 0.5M file fails, this works in main and qa.
1M and above file fails on main and qa.
Files link: https://github.com/datablist/sample-csv-files

Resolved