Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time Travel for Qbeast-Spark! #429

Open
Jiaweihu08 opened this issue Sep 27, 2024 · 0 comments
Open

Time Travel for Qbeast-Spark! #429

Jiaweihu08 opened this issue Sep 27, 2024 · 0 comments
Assignees

Comments

@Jiaweihu08
Copy link
Member

Add time-traveling feature to qbeast-spark:

// Time travel using version
val df = spark.read.format("qbeast").option("versionAsOf", "1984").load(tablePath)
val df = spark.sql("SELECT * FROM myCatalog.tableName VERSION AS OF 1984")

// Time travel using timestamp
val df = spark.read.format("qbeast").option("timestampAsOf", "1844-10-15").load(tablePath)
val df = spark.sql("SELECT * FROM myCatalog.tableName TIMESTAMP AS OF '1844-10-15'")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants