Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-6052

Debezium is not working with redis streams and postgresql

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • None
    • 2.1.2.Final
    • debezium-server
    • None
    • False
    • None
    • False

    Description

      I'm having an issue with running debezium with redis and postgresql, and I'm not sure if this is a bug or I did not know how to configure it.

       

      I will leave my already Stackoverflow opened issue here:

      Debezium is not working with redis streams and postgresql

      My docker compose is:

      version: "3.3"
      services:
        redis-stack:
          image: redis/redis-stack:7.0.6-RC4
          restart: unless-stopped
          ports:
            - 10001:6379
            - 13333:8001
          volumes:
            - ./data/redis-stack/:/data
      
        db:
          image: postgres
          restart: unless-stopped
          ports:
            - 5432:5432
          environment:
            POSTGRES_USER: postgres
            POSTGRES_PASSWORD: 1234
      
        pgadmin:
          image: dpage/pgadmin4
          restart: unless-stopped
          ports:
            - 5555:80
          environment:
            PGADMIN_DEFAULT_PASSWORD: 1234
            PGADMIN_DEFAULT_EMAIL: arkan.m.gerges@gmail.com
      
        debezium:
          image: debezium/server:2.1.2.Final
          restart: unless-stopped
          ports:
            - 8180:8080
          volumes:
            - ./config/debezium:/debezium/conf
            - ./data/debezium:/debezium/data
          depends_on:
            - redis-stack
            - db
      
      networks:
          app-network:
       

      in the config/debezium/application.properties

      debezium.source.connector.class=io.debezium.connector.postgresql.PostgresConnector
      debezium.source.offset.storage=io.debezium.storage.redis.offset.RedisOffsetBackingStore
      debezium.source.offset.flush.interval.ms=0
      debezium.source.offset.storage.redis.address=redis-stack:6379
      debezium.source.schema.history.internal=io.debezium.storage.redis.history.RedisSchemaHistory
      debezium.source.schema.history.internal.redis.address=redis-stack:6379
      debezium.sink.type=redis
      debezium.sink.redis.address=redis-stack:6379
      debezium.source.database.hostname=db
      debezium.source.database.port=5432
      debezium.source.database.user=postgres
      debezium.source.database.password=1234
      debezium.source.database.dbname=softwaredev_expert
      debezium.source.database.server.name=db
      debezium.source.schema.whitelist=public
      debezium.source.schema.include.list=public
      debezium.source.plugin.name=pgoutput 

      I can access redis insights, and access to postgresql, but I'm getting errors running debezium:

      https://pastebin.com/9TGUNvKe

      Attachments

        Activity

          People

            Unassigned Unassigned
            arkanmgerges Arkan Anabi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: