feat(plugin-flightshim): Add Arrow Federation connector to run federated queries on a native cluster #26404
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![sourcery-ai[bot]](https://avatars.githubusercontent.com/in/48477?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Sorry @pdabre12, your pull request is larger than the review limit of 150000 diff characters
pdabre12
force-pushed
the
oss-fed-flight-server
branch
2 times, most recently
from
af94842 to
906eb52
Compare
Contributor
Author
|
@sourcery-ai review |
Contributor
|
Sorry @pdabre12, your pull request is larger than the review limit of 150000 diff characters |
1 similar comment
|
Sorry @pdabre12, your pull request is larger than the review limit of 150000 diff characters |
pdabre12
changed the title
pdabre12
force-pushed
the
oss-fed-flight-server
branch
from
906eb52 to
ef1126d
Compare
pdabre12
changed the title
pdabre12
changed the title
pdabre12
changed the title
pdabre12
changed the title
pdabre12
force-pushed
the
oss-fed-flight-server
branch
3 times, most recently
from
a4b4cfa to
65e8e43
Compare
pdabre12
force-pushed
the
oss-fed-flight-server
branch
5 times, most recently
from
7b5096b to
ae521fe
Compare
Works up to getting RecordSet due to classloader conflict Test is now able to read from postgresql into recordset Using FlightShimConfig for location Added conversion with ArrowShimWriter Added more type conversions and writers Config with SSL working, test passes with row count Fix test for tpch Using executor service to run getStream Adding cancel tests Backpressure working Fixed config to load from file Added some basic unit tests Using bound FunctionAndTypeManager for type deser and ConnectorContext Made FlightShimQueryRunner, working but needs selecting columns Able to make select query by column name and use query runner Added test for MySql connector Added type support for date and timestamp, with tests. decimal test not working yet Fix floating point test Added logging Using plugins from plugin-bundles config Added oracle and singlestore tests, oracle not working yet Remove plugin dir Fixed deser of TupleDomain, need to test against query results Add test with additionalPredicate Enable mTLS, fix config typo Moved to test containers after rebase Fix code style Use SynchronousQueue in executor fix gRPC deadlock
pdabre12
force-pushed
the
oss-fed-flight-server
branch
from
743fb7d to
5b1d093
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Motivation and Context
Impact
Test Plan
Contributor checklist
Release Notes
Please follow release notes guidelines and fill in the release notes below.
If release note is NOT required, use: