pulsar cdc reported an error docking with oracle ：Failed to resolve Oracle database version #22937

ChaoY000000 · 2024-06-19T02:09:38Z

ChaoY000000
Jun 19, 2024

Error log: No oracle driver was found. Do you need to import oracle driver dependency when deploying pulsar

ERROR org.apache.pulsar.functions.instance.JavaInstanceRunnable - Source open produced uncaught exception:
java.lang.RuntimeException: Failed to resolve Oracle database version
at io.debezium.connector.oracle.OracleConnection.resolveOracleDatabaseVersion(OracleConnection.java:163) ~[debezium-connector-oracle-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.connector.oracle.OracleConnection.(OracleConnection.java:75) ~[debezium-connector-oracle-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.connector.oracle.OracleConnectorTask.start(OracleConnectorTask.java:54) ~[debezium-connector-oracle-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:133) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at org.apache.pulsar.io.kafka.connect.AbstractKafkaConnectSource.open(AbstractKafkaConnectSource.java:134) ~[pulsar-io-kafka-connect-adaptor-2.10.2.jar:2.10.2]
at org.apache.pulsar.io.kafka.connect.KafkaConnectSource.open(KafkaConnectSource.java:60) ~[pulsar-io-kafka-connect-adaptor-2.10.2.jar:2.10.2]
at org.apache.pulsar.io.debezium.DebeziumSource.open(DebeziumSource.java:98) ~[pulsar-io-debezium-core-2.10.2.jar:2.10.2]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.setupInput(JavaInstanceRunnable.java:762) ~[?:?]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.setup(JavaInstanceRunnable.java:227) ~[?:?]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:260) ~[?:?]
at java.lang.Thread.run(Thread.java:829) ~[?:?]
Caused by: java.sql.SQLException: No suitable driver found for jdbc:oracle:thin:@8.130.123.224:31521/ORCL
at java.sql.DriverManager.getConnection(DriverManager.java:702) ~[java.sql:?]
at java.sql.DriverManager.getConnection(DriverManager.java:189) ~[java.sql:?]
at io.debezium.jdbc.JdbcConnection.lambda$patternBasedFactory$0(JdbcConnection.java:185) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.jdbc.JdbcConnection$ConnectionFactoryDecorator.connect(JdbcConnection.java:122) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:891) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:886) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.jdbc.JdbcConnection.queryAndMap(JdbcConnection.java:639) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.jdbc.JdbcConnection.queryAndMap(JdbcConnection.java:513) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.connector.oracle.OracleConnection.resolveOracleDatabaseVersion(OracleConnection.java:133) ~[debezium-connector-oracle-1.7.2.Final.jar:1.7.2.Final]
... 10 more
2024-06-19T02:06:59,272+0000 [public/default/oracle-1-pulsar_job-0] ERROR org.apache.pulsar.functions.instance.JavaInstanceRunnable - [public/default/oracle-1-pulsar_job:0] Uncaught exception in Java Instance
java.lang.RuntimeException: Failed to resolve Oracle database version
at io.debezium.connector.oracle.OracleConnection.resolveOracleDatabaseVersion(OracleConnection.java:163) ~[?:?]
at io.debezium.connector.oracle.OracleConnection.(OracleConnection.java:75) ~[?:?]
at io.debezium.connector.oracle.OracleConnectorTask.start(OracleConnectorTask.java:54) ~[?:?]
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:133) ~[?:?]
at org.apache.pulsar.io.kafka.connect.AbstractKafkaConnectSource.open(AbstractKafkaConnectSource.java:134) ~[?:?]
at org.apache.pulsar.io.kafka.connect.KafkaConnectSource.open(KafkaConnectSource.java:60) ~[?:?]
at org.apache.pulsar.io.debezium.DebeziumSource.open(DebeziumSource.java:98) ~[?:?]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.setupInput(JavaInstanceRunnable.java:762) ~[org.apache.pulsar-pulsar-functions-instance-2.10.2.jar:2.10.2]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.setup(JavaInstanceRunnable.java:227) ~[org.apache.pulsar-pulsar-functions-instance-2.10.2.jar:2.10.2]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:260) ~[org.apache.pulsar-pulsar-functions-instance-2.10.2.jar:2.10.2]
at java.lang.Thread.run(Thread.java:829) ~[?:?]
Caused by: java.sql.SQLException: No suitable driver found for jdbc:oracle:thin:@8.130.123.224:31521/ORCL
at java.sql.DriverManager.getConnection(DriverManager.java:702) ~[java.sql:?]
at java.sql.DriverManager.getConnection(DriverManager.java:189) ~[java.sql:?]
at io.debezium.jdbc.JdbcConnection.lambda$patternBasedFactory$0(JdbcConnection.java:185) ~[?:?]
at io.debezium.jdbc.JdbcConnection$ConnectionFactoryDecorator.connect(JdbcConnection.java:122) ~[?:?]
at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:891) ~[?:?]
at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:886) ~[?:?]
at io.debezium.jdbc.JdbcConnection.queryAndMap(JdbcConnection.java:639) ~[?:?]
at io.debezium.jdbc.JdbcConnection.queryAndMap(JdbcConnection.java:513) ~[?:?]
at io.debezium.connector.oracle.OracleConnection.resolveOracleDatabaseVersion(OracleConnection.java:133) ~[?:?]
... 10 more
2024-06-19T02:06:59,371+0000 [public/default/oracle-1-pulsar_job-0] INFO org.apache.pulsar.functions.instance.JavaInstanceRunnable - Closing instance
2024-06-19T02:06:59,371+0000 [public/default/oracle-1-pulsar_job-0] INFO io.debezium.connector.common.BaseSourceTask - Stopping down connector
2024-06-19T02:06:59,374+0000 [public/default/oracle-1-pulsar_job-0] ERROR org.apache.pulsar.functions.instance.JavaInstanceRunnable - Failed to close source org.apache.pulsar.io.debezium.oracle.DebeziumOracleSource
java.lang.NullPointerException: null
at io.debezium.connector.oracle.OracleConnectorTask.doStop(OracleConnectorTask.java:135) ~[debezium-connector-oracle-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.connector.common.BaseSourceTask.stop(BaseSourceTask.java:255) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at io.debezium.connector.common.BaseSourceTask.stop(BaseSourceTask.java:225) ~[debezium-core-1.7.2.Final.jar:1.7.2.Final]
at org.apache.pulsar.io.kafka.connect.AbstractKafkaConnectSource.close(AbstractKafkaConnectSource.java:178) ~[pulsar-io-kafka-connect-adaptor-2.10.2.jar:2.10.2]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.close(JavaInstanceRunnable.java:437) ~[?:?]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:319) ~[?:?]
at java.lang.Thread.run(Thread.java:829) ~[?:?]

lhotari · 2024-06-19T08:48:37Z

lhotari
Jun 19, 2024
Collaborator

Please use English for discussions.

You will have to accept Oracle's license for the JDBC driver and download and package it for your usage.
Here's how we do that in Pulsar CI:

pulsar/tests/docker-images/latest-version-image/Dockerfile

Lines 95 to 107 in feae589

    
           # download Oracle JDBC driver for Oracle Debezium Connector tests 
        
           RUN mkdir -p META-INF/bundled-dependencies 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/ojdbc8/19.3.0.0/ojdbc8-19.3.0.0.jar -o ojdbc8-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/ucp/19.3.0.0/ucp-19.3.0.0.jar -o ucp-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/oraclepki/19.3.0.0/oraclepki-19.3.0.0.jar -o oraclepki-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/osdt_cert/19.3.0.0/osdt_cert-19.3.0.0.jar -o osdt_cert-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/osdt_core/19.3.0.0/osdt_core-19.3.0.0.jar -o osdt_core-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/simplefan/19.3.0.0/simplefan-19.3.0.0.jar -o simplefan-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/orai18n/19.3.0.0/orai18n-19.3.0.0.jar -o orai18n-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/xdb/19.3.0.0/xdb-19.3.0.0.jar -o xdb-19.3.0.0.jar 
        
           RUN cd META-INF/bundled-dependencies && curl -sSL https://search.maven.org/remotecontent?filepath=com/oracle/ojdbc/xmlparserv2/19.3.0.0/xmlparserv2-19.3.0.0.jar -o xmlparserv2-19.3.0.0.jar 
        
           RUN jar uf connectors/pulsar-io-debezium-oracle-*.nar META-INF/bundled-dependencies/ojdbc8-19.3.0.0.jar META-INF/bundled-dependencies/ucp-19.3.0.0.jar META-INF/bundled-dependencies/oraclepki-19.3.0.0.jar META-INF/bundled-dependencies/osdt_cert-19.3.0.0.jar META-INF/bundled-dependencies/osdt_core-19.3.0.0.jar META-INF/bundled-dependencies/simplefan-19.3.0.0.jar META-INF/bundled-dependencies/orai18n-19.3.0.0.jar META-INF/bundled-dependencies/xdb-19.3.0.0.jar META-INF/bundled-dependencies/xmlparserv2-19.3.0.0.jar

1 reply

ChaoY000000 Jun 20, 2024
Author

Thank you for your reply. The pulsar image was rebuilt according to your suggestion, but the problem still exists.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

pulsar cdc reported an error docking with oracle ：Failed to resolve Oracle database version #22937

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 1 reply

{{title}}

{{title}}

Select a reply

pulsar cdc reported an error docking with oracle ：Failed to resolve Oracle database version #22937

ChaoY000000 Jun 19, 2024

Replies: 1 comment · 1 reply

lhotari Jun 19, 2024 Collaborator

ChaoY000000 Jun 20, 2024 Author

ChaoY000000
Jun 19, 2024

Replies: 1 comment 1 reply

lhotari
Jun 19, 2024
Collaborator

ChaoY000000 Jun 20, 2024
Author