Encounter error "Unable to activate object" when there are multiple threads / concurrent tasks #5783
-
SettingsHardware and software overviewNebulaGraph Database deployment
Computation cluster
Graph data
Others
IssuesWhen trying scanning full graph data such as import org.apache.spark.sql.DataFrame
import com.vesoft.nebula.connector.connector.NebulaDataFrameReader
import com.vesoft.nebula.connector.{NebulaConnectionConfig, ReadNebulaConfig}
val ec2_public_ip = "xx.xx.xx.xx"
val config = NebulaConnectionConfig.builder().withMetaAddress(s"${ec2_public_ip}:9559").withConnectionRetry(2).build()
val nebulaReadEdgeConfig: ReadNebulaConfig = ReadNebulaConfig.builder().withSpace("acct2asset_20231130").withLabel("USES").withNoColumn(false).withReturnCols(List()).withPartitionNum(10).build()
val dataset = spark.read.nebula(config, nebulaReadEdgeConfig).loadEdgesToDF()
dataset.count() Error log:
However, we can successfully run the following and get results on EMR machine.
We also tested scripts involving different volumes of the graph data. When
However, when we increase to What we found so farWith more tests going on, we found that when number of all threads / concurrent tasks is Could you please help with this issue? Feel free to let me know if I need provide more information. Thanks a lot! |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
This is the same topic as #5784. The discussion here has been closed, so let's continue the discussion in the issue. |
Beta Was this translation helpful? Give feedback.
This is the same topic as #5784. The discussion here has been closed, so let's continue the discussion in the issue.