Skip to content
Build

fix rebase error #125

Sign in to view logs

fix rebase error

fix rebase error #125

Triggered via push December 11, 2025 06:40
@zifeif2zifeif2
pushed 82c86fe
repartition-writer-multi-cf
Status Failure
Total duration 1h 54m 21s
Artifacts 27

build_main.yml

on: push
Run  /  Check changes
39s
Run / Check changes
Run  /  Base image build
1m 7s
Run / Base image build
Run  /  Protobuf breaking change detection and Python CodeGen check
1m 21s
Run / Protobuf breaking change detection and Python CodeGen check
Run  /  Java 17 build with Maven
44m 23s
Run / Java 17 build with Maven
Run  /  Java 25 build with Maven
40m 8s
Run / Java 25 build with Maven
Run  /  Run TPC-DS queries with SF=1
1h 23m
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
1h 31m
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
0s
Run / Run Spark on Kubernetes Integration test
Run  /  Run Spark UI tests
28s
Run / Run Spark UI tests
Matrix: Run / build
Run  /  Build modules: sparkr
28m 13s
Run / Build modules: sparkr
Run  /  Linters, licenses, and dependencies
29m 22s
Run / Linters, licenses, and dependencies
Run  /  Documentation generation
37m 48s
Run / Documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

22 errors and 3 warnings
Run / Build modules: sql - other tests
Process completed with exit code 18.
Run / Build modules: sql - extended tests
Process completed with exit code 18.
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-1568961926,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120006 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-356021316,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120006 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=1697250295,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120004 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-649144232,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120000 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-1723413383,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120000 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=2015755610,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120004 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=1422432880,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120010 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuite.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuite#L51
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-1348775185,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120006 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-1745881671,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120007 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=2117961032,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120005 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-1202671971,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120003 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = unsaferow) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-1083956232,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120002 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=577805246,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120007 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (with changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=1188599256,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120002 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$4(RocksDBSuite.scala:245) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingEnabled$1(RocksDBSuite.scala:173) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=-1439430803,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120007 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
RocksDBStateStoreSuiteWithRowChecksum.column family creation with reserved chars (encoding = avro) - with colFamiliesEnabled=true (without changelog checkpointing) (encoding = avro): org/apache/spark/sql/execution/streaming/state/RocksDBStateStoreSuiteWithRowChecksum#L1
org.apache.spark.SparkException: [CANNOT_LOAD_STATE_STORE.UNRELEASED_THREAD_ERROR] An error occurred during loading state. StateStoreId(opId=1420053243,partId=0,name=default): RocksDB instance could not be acquired by [ThreadId: Some(16)] for operationType=close as it was not released by [ThreadId: Some(16)] after 120007 ms. Thread holding the lock has trace: java.base/java.lang.Thread.getStackTrace(Thread.java:1619) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.awaitNotAcquiredWithLock(RocksDBStateMachine.scala:166) org.apache.spark.sql.execution.streaming.state.RocksDBStateMachine.close(RocksDBStateMachine.scala:324) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreProvider.close(RocksDBStateStoreProvider.scala:865) org.apache.spark.sql.execution.streaming.state.StateStoreSuiteBase.tryWithProviderResource(StateStoreSuite.scala:2829) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140(RocksDBStateStoreSuite.scala:1811) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.$anonfun$new$140$adapted(RocksDBStateStoreSuite.scala:1809) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$3(RocksDBSuite.scala:217) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2(RocksDBSuite.scala:217) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamiliesAndEncodingTypes$2$adapted(RocksDBSuite.scala:215) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithColumnFamilies$5(RocksDBSuite.scala:249) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithRocksDBFeatures.$anonfun$testWithChangelogCheckpointingDisabled$1(RocksDBSuite.scala:187) scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf(SQLConfHelper.scala:54) org.apache.spark.sql.catalyst.SQLConfHelper.withSQLConf$(SQLConfHelper.scala:38) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$apache$spark$sql$test$SQLTestUtilsBase$$super$withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf(SQLTestUtils.scala:253) org.apache.spark.sql.test.SQLTestUtilsBase.withSQLConf$(SQLTestUtils.scala:251) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.withSQLConf(RocksDBStateStoreSuite.scala:51) org.apache.spark.sql.execution.streaming.state.AlsoTestWithEncodingTypes.$anonfun$test$2(RocksDBSuite.scala:127) org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127) org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282) org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231) org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230) org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:68) org.apache.spark.SparkFunSuite.$anonfun$test$2(SparkFunSuite.scala:154) org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) org.scalatest.Transformer.apply(Transformer.scala:22) org.scalatest.Transformer.apply(Transformer.scala:20) org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226) org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:226) org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236) org.scalatest.SuperEngine.runTestImpl(Engine.scala:306) org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236) org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234) org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213) org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.runTest(RocksDBStateStoreSuite.scala:51) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269) org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413) scala.collection.immutable.List.foreach(List.scala:323) org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401) org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396) org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475) org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269) org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268) org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564) org.scalatest.Suite.run(Suite.scala:1114) org.scalatest.Suite.run$(Suite.scala:1096) org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564) org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273) org.scalatest.SuperEngine.runImpl(Engine.scala:535) org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273) org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272) org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:68) org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.org$scalatest$BeforeAndAfter$$super$run(RocksDBStateStoreSuite.scala:51) org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273) org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271) org.apache.spark.sql.execution.streaming.state.RocksDBStateStoreSuite.run(RocksDBStateStoreSuite.scala:51) org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321) org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517) sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414) java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) java.base/java.lang.Thread.run(Thread.java:840) SQLSTATE: 58030
ValueStateSuite.Value state operations for unsupported type name should fail (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/ValueStateSuite#L457
org.scalatest.exceptions.TestFailedException: Expected exception org.apache.spark.SparkUnsupportedOperationException to be thrown, but no exception was thrown
ValueStateSuite.Value state operations for unsupported type name should fail (encoding = avro): org/apache/spark/sql/execution/streaming/state/ValueStateSuite#L457
org.scalatest.exceptions.TestFailedException: Expected exception org.apache.spark.SparkUnsupportedOperationException to be thrown, but no exception was thrown
ValueStateSuiteWithRowChecksum.Value state operations for unsupported type name should fail (encoding = unsaferow): org/apache/spark/sql/execution/streaming/state/ValueStateSuiteWithRowChecksum#L1
org.scalatest.exceptions.TestFailedException: Expected exception org.apache.spark.SparkUnsupportedOperationException to be thrown, but no exception was thrown
ValueStateSuiteWithRowChecksum.Value state operations for unsupported type name should fail (encoding = avro): org/apache/spark/sql/execution/streaming/state/ValueStateSuiteWithRowChecksum#L1
org.scalatest.exceptions.TestFailedException: Expected exception org.apache.spark.SparkUnsupportedOperationException to be thrown, but no exception was thrown
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
No files were found with the provided path: **/target/test-reports/*.xml **/target/surefire-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
WARNING conda.cli.main_config:_set_key(456): Key auto_activate_base is an alias of auto_activate; setting value with latter
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
The 'defaults' channel might have been added implicitly. If this is intentional, add 'defaults' to the 'channels' list. Otherwise, consider setting 'conda-remove-defaults' to 'true'.

Artifacts

Produced during runtime
Name Size Digest
site Expired
64.6 MB
sha256:2f2428139810fe363dc05ebff92ee3585fd6de61f9654977bf48186de419f63b
test-results-api, catalyst, hive-thriftserver--17-hadoop3-hive2.3
38.9 KB
sha256:c8c025015082d77b877255b2c5eada90afec36c9141815a7c494517ff0443e10
test-results-core, unsafe, kvstore, avro, utils, utils-java, network-common, network-shuffle, repl, launcher, examples, sketch, variant--17-hadoop3-hive2.3
37.6 KB
sha256:ff5737f946b39aa763efc4920e13efe62b0725ae35e7ad4a3e7214b4665f939a
test-results-docker-integration--17-hadoop3-hive2.3
52.7 KB
sha256:1c5e83b7bbaa3676a434902cd5924d502469cfba5146e2925be3d64aa4f88bf8
test-results-hive-- other tests-17-hadoop3-hive2.3
235 KB
sha256:25bf6114df65aea283132fdcc83e2247736376ff74e68619c16ac4eee90755e1
test-results-hive-- slow tests-17-hadoop3-hive2.3
226 KB
sha256:aea233e8a44c94f8f9533403ce13fe56e45a2b6c748eb37d3a189f5c981c7bd1
test-results-mllib-local, mllib, graphx, profiler, pipelines--17-hadoop3-hive2.3
433 KB
sha256:1e90168f79711c5f09abdf90a91c2ae85c32027c1adcd83111b30fe14bb44b9c
test-results-pyspark-connect--17-hadoop3-hive2.3-python3.11
229 KB
sha256:1388b893dda51b6bc739ab0a2127deca94199e698aa147e962c66e111e81a31b
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines--17-hadoop3-hive2.3-python3.11
183 KB
sha256:26bc35b9a0b35cf13b88069e82bb1cc31dfd5c112e393fde8e9cb5e24ea33a5b
test-results-pyspark-pandas--17-hadoop3-hive2.3-python3.11
196 KB
sha256:0a15514300264003bd01f9c1ec120bb07d647b75bd60624cc351dc81827edf71
test-results-pyspark-pandas-connect--17-hadoop3-hive2.3-python3.11
206 KB
sha256:08ea5929b5edaa0c6855aa220a76620fb5bbc76ec13dc8243e437d95885018a2
test-results-pyspark-pandas-slow--17-hadoop3-hive2.3-python3.11
173 KB
sha256:61b93a495655de6d149cb42619147e6fb93a3952bd0fdb6a722accf29ef95466
test-results-pyspark-pandas-slow-connect--17-hadoop3-hive2.3-python3.11
183 KB
sha256:21b542adf599e442d231b15787bf4a06d80cb6f6a51831d8e02a75ecd948112d
test-results-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3-python3.11
265 KB
sha256:11f972d16e3b1001fcf571b1e31f917d2561e46a50c8877d4103b4033a17fa54
test-results-pyspark-structured-streaming, pyspark-structured-streaming-connect--17-hadoop3-hive2.3-python3.11
41.2 KB
sha256:ce6cde8820deb57a23d73165ab3c11fd9bea54cdce1e7cb2fc99ddf20e8eed16
test-results-sparkr--17-hadoop3-hive2.3
17.2 KB
sha256:ca3a45266fdd5477f3aac2870d69b0c7977741696fb7de1aa7bc0f971e9dd257
test-results-sql-- extended tests-17-hadoop3-hive2.3
1.32 MB
sha256:93b20799d0f2b8914308eb957010e04bf852a4822e49b101e99f56dbc7a36c48
test-results-sql-- other tests-17-hadoop3-hive2.3
1.54 MB
sha256:a444b7ab7b4f9309f467db19ec1b252f0495d8aac84bef6ff3e6830b8cd1f18e
test-results-sql-- slow tests-17-hadoop3-hive2.3
1.31 MB
sha256:94c96e86c126674bee6fc3e06c2801768786345f864f6b98f7de29666f754db9
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf, connect--17-hadoop3-hive2.3
238 KB
sha256:76906d73cf4e306d9b665723a9e809939f47b2ddcd3eec258d049ed3477cee73
test-results-tpcds--17-hadoop3-hive2.3
4.91 KB
sha256:9537bfacfd5dfe0dbbbe7fb91233ec5abbf588edf45ceefd16926e66ff905f0b
unit-tests-log-sql-- extended tests-17-hadoop3-hive2.3
36.5 MB
sha256:9ef8b148e09df64d7e5866edd746c578bb1dba47df5513978a5d5ba7ac342d26
unit-tests-log-sql-- other tests-17-hadoop3-hive2.3
49.9 MB
sha256:63682c72cf511ffc7f5063ab5b403d5f5236f1b2350ea934af64bd40bbb4e5c8
zifeif2~spark~6XMBRC.dockerbuild
31.6 KB
sha256:3fbf85dcac81c30e138b8180814c8e257eb74d8d7a4522bfd68bcb95ddfeb839
zifeif2~spark~C46DO2.dockerbuild
27.3 KB
sha256:64022482b82c1ed62e66c681a594dd52bcf8173d20c8f1859d36a7341c8cf08b
zifeif2~spark~GMDTL2.dockerbuild
28.6 KB
sha256:28e5a89236aca1688211e0c46b868fc713b18726ba492a9e48c3e747e3b89e67
zifeif2~spark~UMW1HU.dockerbuild
26.8 KB
sha256:fd6a7c142308c7629224ec9a75af8e5356613a6e8334556dc6744110c89245ec