Direct upload to cloud

[govthamreddy]

Is there anyway to upload parquet file directly to cloud without creating a local file?

[dobesv]

You can write a parquet file one row group at a time using the ParquetTransformer, and pass those onto your client library for your cloud storage.

[dobesv]

See also https://stackoverflow.com/questions/37336050/pipe-a-stream-to-s3-upload which shows an example of how to pass through a writable stream to the AWS client.