Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2198

Document database history and web server port for Debezium Server

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • Major
    • 1.2.0.CR2
    • 1.2.0.CR1
    • debezium-server
    • None

    Description

      running debezium-server with mysql is failing. i dont have kafka running, it there hard dependency to kafka? i suspect following config causing the issue.

      these are my config (disabled schema.changes)

      debezium.source.database.history.kafka.bootstrap.servers=kafka:9092
      debezium.source.database.history.kafka.topic=dbhistory.fullfillment
      debezium.source.include.schema.changes=false

      exception

      2020-06-14 16:28:14,899 ERROR [io.qua.application] (main) Failed to start application: java.lang.RuntimeException: Unable to start HTTP server
      	at io.quarkus.vertx.http.runtime.VertxHttpRecorder.doServerStart(VertxHttpRecorder.java:432)
      	at io.quarkus.vertx.http.runtime.VertxHttpRecorder.startServer(VertxHttpRecorder.java:198)
      	at io.quarkus.deployment.steps.VertxHttpProcessor$openSocket-2064782366.deploy_0(VertxHttpProcessor$openSocket-2064782366.zig:119)
      	at io.quarkus.deployment.steps.VertxHttpProcessor$openSocket-2064782366.deploy(VertxHttpProcessor$openSocket-2064782366.zig:36)
      	at io.quarkus.runner.ApplicationImpl.doStart(ApplicationImpl.zig:354)
      	at io.quarkus.runtime.Application.start(Application.java:90)
      	at io.quarkus.runtime.ApplicationLifecycleManager.run(ApplicationLifecycleManager.java:90)
      	at io.quarkus.runtime.Quarkus.run(Quarkus.java:61)
      	at io.quarkus.runtime.Quarkus.run(Quarkus.java:38)
      	at io.quarkus.runtime.Quarkus.run(Quarkus.java:106)
      	at io.debezium.server.Main.main(Main.java:15)
      Caused by: java.util.concurrent.ExecutionException: java.net.BindException: Address already in use
      	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
      	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
      	at io.quarkus.vertx.http.runtime.VertxHttpRecorder.doServerStart(VertxHttpRecorder.java:403)
      	... 10 more
      Caused by: java.net.BindException: Address already in use
      	at sun.nio.ch.Net.bind0(Native Method)
      	at sun.nio.ch.Net.bind(Net.java:433)
      	at sun.nio.ch.Net.bind(Net.java:425)
      	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:220)
      	at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:134)
      	at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:550)
      	at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1334)
      	at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:506)
      	at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:491)
      	at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:973)
      	at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:248)
      	at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:356)
      	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
      	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasksFrom(SingleThreadEventExecutor.java:428)
      	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:377)
      	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:488)
      	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
      	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
      	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
      	at java.lang.Thread.run(Thread.java:748)
      

       

      2020-06-14 16:00:41,006 INFO  [io.deb.ser.ConnectorLifecycle] (pool-3-thread-1) Connector completed: success = 'false', message = 'Unable to initialize and start connector's task class 'io.debezium.connector.mysql.MySqlConnectorTask' with config: {name=s3batch, connector.class=io.debezium.connector.mysql.MySqlConnector, database.server.id=123456, database.port=3306, include.schema.changes=false, database.whitelist=mydb, database.user=mydb, database.hostname=mydbmysql.cgwwwsgmyvim.eu-central-1.rds.amazonaws.com, offset.storage.file.filename=data/offsets.dat, database.password=********, database.history.kafka.bootstrap.servers=kafka:9092, offset.flush.interval.ms=0, database.server.name=mydb, database.history.kafka.topic=dbhistory.fullfillment, database.dbname=mydb}', 
              error = '{}': org.apache.kafka.connect.errors.ConnectException: org.apache.kafka.common.KafkaException: Failed to construct kafka producer
              at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:298)
              at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:101)
              at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:751)
              at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:170)
              at io.debezium.server.DebeziumServer.lambda$start$1(DebeziumServer.java:133)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
              at java.lang.Thread.run(Thread.java:748)
              Caused by: org.apache.kafka.common.KafkaException: Failed to construct kafka producer
              at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:434)
              at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:298)
              at io.debezium.relational.history.KafkaDatabaseHistory.start(KafkaDatabaseHistory.java:233)
              at io.debezium.connector.mysql.MySqlSchema.start(MySqlSchema.java:166)
              at io.debezium.connector.mysql.MySqlTaskContext.start(MySqlTaskContext.java:246)
              at io.debezium.connector.mysql.MySqlConnectorTask.createAndStartTaskContext(MySqlConnectorTask.java:358)
              at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:143)
              ... 7 more
              Caused by: org.apache.kafka.common.config.ConfigException: No resolvable bootstrap urls given in bootstrap.servers
              at org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:89)
              at org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:48)
              at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:408)
              ... 13 more
      

       

      2020-06-14 16:00:41,060 ERROR [io.qua.run.Application] (main) Error running Quarkus application: java.lang.RuntimeException: Failed to start quarkus
      	at io.quarkus.runner.ApplicationImpl.doStart(ApplicationImpl.zig:415)
      	at io.quarkus.runtime.Application.start(Application.java:90)
      	at io.quarkus.runtime.ApplicationLifecycleManager.run(ApplicationLifecycleManager.java:90)
      	at io.quarkus.runtime.Quarkus.run(Quarkus.java:61)
      	at io.quarkus.runtime.Quarkus.run(Quarkus.java:38)
      	at io.quarkus.runtime.Quarkus.run(Quarkus.java:106)
      	at io.debezium.server.Main.main(Main.java:15)
      Caused by: java.lang.RuntimeException: Unable to start HTTP server
      	at io.quarkus.vertx.http.runtime.VertxHttpRecorder.doServerStart(VertxHttpRecorder.java:432)
      	at io.quarkus.vertx.http.runtime.VertxHttpRecorder.startServer(VertxHttpRecorder.java:198)
      	at io.quarkus.deployment.steps.VertxHttpProcessor$openSocket-2064782366.deploy_0(VertxHttpProcessor$openSocket-2064782366.zig:119)
      	at io.quarkus.deployment.steps.VertxHttpProcessor$openSocket-2064782366.deploy(VertxHttpProcessor$openSocket-2064782366.zig:36)
      	at io.quarkus.runner.ApplicationImpl.doStart(ApplicationImpl.zig:354)
      	... 6 more
      Caused by: java.util.concurrent.ExecutionException: java.net.BindException: Address already in use
      	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
      	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
      	at io.quarkus.vertx.http.runtime.VertxHttpRecorder.doServerStart(VertxHttpRecorder.java:403)
      	... 10 more
      Caused by: java.net.BindException: Address already in use
      	at sun.nio.ch.Net.bind0(Native Method)
      	at sun.nio.ch.Net.bind(Net.java:433)
      	at sun.nio.ch.Net.bind(Net.java:425)
      	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:220)
      	at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:134)
      	at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:550)
      	at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1334)
      	at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:506)
      	at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:491)
      	at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:973)
      	at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:248)
      	at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:356)
      	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
      	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasksFrom(SingleThreadEventExecutor.java:428)
      	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:377)
      	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:488)
      	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
      	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
      	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
      	at java.lang.Thread.run(Thread.java:748)
      

       

      Attachments

        Activity

          People

            jpechane Jiri Pechanec
            ismailsimsek ismail simsek
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: