Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3122

Trying Debezium for Oracle but not logging any event

    XMLWordPrintable

Details

    • False
    • False
    • Undefined
    • Hide

      1-Launch zookeeper, kafka, oracle and connect images

      docker-compose -f docker-compose.yaml up --build

       2- check DB ip: 

      docker network inspect -f '{{json .Containers}}' debezium_apollo_last_default | jq '.[] | .Name + ":" + .IPv4Address'

      3- change DB IP in register_oracle.json file (connector configuration)

      4- launch connector: 

      curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" http://localhost:8083/connectors/ -d @register-oracle.json

      5- Check kafka topics are created: 

       docker exec -it kafka /kafka/bin/kafka-topics.sh --bootstrap-server kafka:9092 --list
       
      

      6- Launch watch-topic image to see what's going on:

      docker run -it --rm --name watcher --link zookeeper:zookeeper --link kafka:kafka debezium/kafka:1.4 watch-topic -a -k dbz_oracle.APOLLO_PROP.PACKAGETYPE

       Go to Oracle DB and try to make some changes: 

      SQL> connect apollo_prop
      Enter password:
      Connected.
      SQL> alter table apollo_prop.packagetype add birthdate date;
      alter table apollo_prop.packagetype drop column birthdate;
      Table altered.
      SQL>
      Table altered.
      

       On the  connect container log appear some changes:  

      2021-02-16 17:41:36,645 INFO || DDL: transactionId=03001B000A020000, SCN=473493, table_name=PACKAGETYPE, segOwner=APOLLO_PROP, operationCode=5, offsetSCN=473488, commitOffsetSCN=null, REDO_SQL: alter table apollo_prop.packagetype add birthdate date; [io.debezium.connector.oracle.logminer.LogMinerQueryResultProcessor]

       Some more changes in Oracle console, as Apollo_prop user:

      SQL> insert into apollo_prop.packagetype values (1003, 'Elena 3', sysdate);
      1 row created.
      SQL> insert into apollo_prop.packagetype values (1004, 'Elena 4', sysdate);
      1 row created.
      SQL> insert into apollo_prop.packagetype values (1005, 'Elena 5', sysdate);
      1 row created.
      SQL> insert into apollo_prop.packagetype values (1006, 'Elena 6', sysdate);
      1 row created.
      SQL> commit;
      Commit complete.

      No information on whatch-topic container or connect logs

      I cannot see any error on logs. So I don't know what's going on here. 

      Attach my docker-compose, register-oracle.json and database setup scripts

      Show
      1-Launch zookeeper, kafka, oracle and connect images docker-compose -f docker-compose.yaml up --build  2- check DB ip:  docker network inspect -f '{{json .Containers}}' debezium_apollo_last_default | jq '.[] | .Name + ":" + .IPv4Address' 3- change DB IP in register_oracle.json file (connector configuration) 4- launch connector:  curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" http: //localhost:8083/connectors/ -d @register-oracle.json 5- Check kafka topics are created:  docker exec -it kafka /kafka/bin/kafka-topics.sh --bootstrap-server kafka:9092 --list   6- Launch watch-topic image to see what's going on: docker run -it --rm --name watcher --link zookeeper:zookeeper --link kafka:kafka debezium/kafka:1.4 watch-topic -a -k dbz_oracle.APOLLO_PROP.PACKAGETYPE  Go to Oracle DB and try to make some changes:  SQL> connect apollo_prop Enter password: Connected. SQL> alter table apollo_prop.packagetype add birthdate date; alter table apollo_prop.packagetype drop column birthdate; Table altered. SQL> Table altered.  On the  connect container log appear some changes:   2021-02-16 17:41:36,645 INFO || DDL: transactionId=03001B000A020000, SCN=473493, table_name=PACKAGETYPE, segOwner=APOLLO_PROP, operationCode=5, offsetSCN=473488, commitOffsetSCN= null , REDO_SQL: alter table apollo_prop.packagetype add birthdate date; [io.debezium.connector.oracle.logminer.LogMinerQueryResultProcessor]  Some more changes in Oracle console, as Apollo_prop user: SQL> insert into apollo_prop.packagetype values (1003, 'Elena 3' , sysdate); 1 row created. SQL> insert into apollo_prop.packagetype values (1004, 'Elena 4' , sysdate); 1 row created. SQL> insert into apollo_prop.packagetype values (1005, 'Elena 5' , sysdate); 1 row created. SQL> insert into apollo_prop.packagetype values (1006, 'Elena 6' , sysdate); 1 row created. SQL> commit; Commit complete. No information on whatch-topic container or connect logs I cannot see any error on logs. So I don't know what's going on here.  Attach my docker-compose, register-oracle.json and database setup scripts

    Description

      Trying to deploy Debezium for Oracle, using logminer option, but not getting any event logged. 

      Oracle Version: 11.2.0.2.0 Express Edition

      Debezium : 1.4.

      Docker images: 

      • zookeeper: debezium/zookeeper:1.4
      • kafka: debezium/kafka:1.4
      • connect: debezium/connect:1.4
      • oracle: oracleinanutshell/oracle-xe-11g:latest

       

      Attachments

        Issue Links

          Activity

            People

              ccranfor@redhat.com Chris Cranford
              elenacuevas Elena Cuevas (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: