No SST files found

[aandis]

I'm trying to use this with structure streaming jobs and all my queries terminate with this exception

Error reading snapshot file $fileToRead of $this: No SST files found.

Do you mind explaining why this lib is expecting sst files and possible causes for the error?

[aandis]

cc: @itsvikramagr

[itsvikramagr]

@aandis - how are you trying to use this? Is this a new streaming application (different checkpoint folder)?

You can read about SST files from this wiki - https://github.com/facebook/rocksdb/wiki/A-Tutorial-of-RocksDB-SST-formats

[aandis]

@itsvikramagr the spark streaming application checkpoints data to a hdfs location.

[aandis]

Is this a new streaming application (different checkpoint folder)?

@itsvikramagr not sure what you mean by this?

[aandis]

@itsvikramagr would appreciate any inputs here.