-
Bug
-
Resolution: Unresolved
-
Major
-
3.0.0.Final
-
False
-
-
False
In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.
Bug report
For bug reports, provide this information, please:
What Debezium connector do you use and what version?
PostgreSQL Connector (io.debezium.connector.postgresql.PostgresConnector) Version: 3.0.0-final
What is the connector configuration?
#Commons Configuration debezium.source.connector.class=io.debezium.connector.postgresql.PostgresConnector debezium.source.plugin.name=pgoutput # Offset Configuration Configuration template decrypted successfully Current template content (for debugging): #Commons Configuration debezium.source.connector.class=io.debezium.connector.postgresql.PostgresConnector debezium.source.plugin.name=pgoutput # Offset Configuration debezium.source.snapshot.mode=never debezium.source.offset.storage=io.debezium.storage.redis.offset.RedisOffsetBackingStore debezium.source.offset.storage.redis.address={{REDIS_HOSTNAME}}:{{REDIS_PORT}} debezium.source.offset.storage.redis.user={{REDIS_USER}} debezium.source.offset.storage.redis.password={{REDIS_PASSWORD}} debezium.source.offset.storage.redis.ssl.enabled={{REDISS_USE_SSL}} debezium.source.offset.flush.interval.ms=1000 debezium.source.offset.storage.file.filename= # PostgreSQL Configuration debezium.source.database.hostname={{PG_HOSTNAME}} debezium.source.database.port={{PG_PORT}} debezium.source.database.user={{PG_USERNAME}} debezium.source.database.password={{PG_PASSWORD}} debezium.source.database.dbname={{PG_DBNAME}} debezium.source.database.server.name=prod-postgres-db-01 # Publication and Stream Configuration debezium.source.publication.name={{PG_PUBLICATION_NAME}} debezium.source.topic.prefix={{STREAM_NAME}} debezium.source.table.include.list={{OUTBOX_TABLE}} debezium.source.table.field.event.key=aggregate_id debezium.source.max.batch.size=512 debezium.source.max.queue.size=8192 debezium.source.heartbeat.interval.ms=10000 debezium.source.heartbeat.action.query=SELECT 1 debezium.source.include.schema.changes=false # RabbitMQ Sink Configuration debezium.sink.type=rabbitmq debezium.sink.rabbitmq.connection.uri={{QUEUE_CONNECTION_URI}} debezium.sink.rabbitmq.ssl.enabled=true debezium.sink.rabbitmq.ssl.validate=true debezium.sink.rabbitmq.ssl.validate.server.certificate=true debezium.sink.rabbitmq.ssl.verify.hostname=true debezium.sink.rabbitmq.exchange=outbox # Transformation Configurations debezium.transforms=outbox,filter_heartbeats # Outbox Configuration debezium.transforms.outbox.type=io.debezium.transforms.outbox.EventRouter debezium.transforms.outbox.table.expand.json.payload=false debezium.transforms.outbox.route.by.field=aggregate_type debezium.transforms.outbox.table.field.event.id=id debezium.transforms.outbox.table.field.event.key=aggregate_id debezium.transforms.outbox.table.fields.additional.placement=id:envelope,type:envelope,aggregate_type:envelope,aggregate_id:envelope,created_at:envelope # Filter configuration using a predicate rather than Filter transform debezium.transforms.filter_heartbeats.type=io.debezium.transforms.Filter debezium.transforms.filter_heartbeats.language=jsr223.groovy debezium.transforms.filter_heartbeats.condition=value.schema?.name != 'io.debezium.connector.common.Heartbeat' debezium.sink.tombstones.on.delete=false # Performance Configuration debezium.source.buffer.memory.size=256MB debezium.source.internal.buffer.size=16384 debezium.source.errors.retry.delay.initial.ms=1000 debezium.source.errors.retry.delay.max.ms=10000 debezium.source.errors.max.retries=3 debezium.source.tasks.max=1 debezium.source.poll.interval.ms=1000 #Quarkus Configuration quarkus.log.console.json=false quarkus.log.level=INFO quarkus.profile=prod Configuration complete. Starting Debezium server...
What is the captured database version and mode of deployment?
PostgreSQL version: 16.8
Deployment: Docker
Dockerfile:
FROM debezium/server:3.0.0.Final USER root # Install required packages RUN microdnf update -y && \ microdnf install -y openssl wget && \ microdnf clean all # Download the Debezium Filtering SMT # Download the Debezium Scripting SMT and necessary dependencies RUN wget -P /tmp/ https://repo1.maven.org/maven2/io/debezium/debezium-scripting/3.0.6.Final/debezium-scripting-3.0.6.Final.jar && \ wget -P /tmp/ https://repo1.maven.org/maven2/org/codehaus/groovy/groovy/3.0.19/groovy-3.0.19.jar && \ wget -P /tmp/ https://repo1.maven.org/maven2/org/codehaus/groovy/groovy-jsr223/3.0.19/groovy-jsr223-3.0.19.jar && \ cp /tmp/*.jar /debezium/lib/ && \ rm -rf /tmp/*.jar # Set permissions for the new JARs RUN chown jboss:jboss /debezium/lib/*.jar && \ chmod 644 /debezium/lib/*.jar # Copy the template configuration file and entrypoint script COPY application.properties.template /debezium/config/application.properties.template COPY entrypoint.sh /debezium/entrypoint.sh# Set permissions RUN chmod +x /debezium/entrypoint.sh && \ chown jboss:jboss /debezium/config/application.properties.template USER jboss # Set environment variables for Java ENV JAVA_OPTS="-XX:+UseSerialGC \ -Xms1g \ -Xmx1536m \ -XX:MetaspaceSize=96m \ -XX:MaxMetaspaceSize=256m \ -XX:+HeapDumpOnOutOfMemoryError \ -XX:HeapDumpPath=/debezium/data/heapdump.bin \ -Djava.security.egd=file:/dev/./urandom \ -XX:+ExitOnOutOfMemoryError \ -XX:+AlwaysPreTouch" ENTRYPOINT ["/debezium/entrypoint.sh"]
And entrypoint.sh
#!/bin/bash set -eecho "Starting configuration process..." echo "Working directory: $(pwd)"# Display file permissions and content length echo "File details:" cat /debezium/config/application.properties.template echo "File content size: $(wc -c < /debezium/config/application.properties.template) bytes"# Verify the template file if [ -f /debezium/config/application.properties.template ]; then echo "Successfully found configuration file. Content preview:" head -n 5 /debezium/config/application.properties.template else echo "Error: Could not find file" exit 1 fiecho "Current template content (for debugging):" cat /debezium/config/application.properties.template# Replace placeholders with environment variables echo "Replacing placeholders with environment variables..." sed -i "s|{{REDIS_HOSTNAME}}|$REDIS_HOSTNAME|g" /debezium/config/application.properties.template sed -i "s|{{REDIS_PORT}}|$REDIS_PORT|g" /debezium/config/application.properties.template sed -i "s|{{REDIS_USER}}|$REDIS_USER|g" /debezium/config/application.properties.template sed -i "s|{{REDIS_PASSWORD}}|$REDIS_PASSWORD|g" /debezium/config/application.properties.template sed -i "s|{{REDISS_USE_SSL}}|$REDISS_USE_SSL|g" /debezium/config/application.properties.template sed -i "s|{{PG_HOSTNAME}}|$PG_HOSTNAME|g" /debezium/config/application.properties.template sed -i "s|{{PG_PORT}}|$PG_PORT|g" /debezium/config/application.properties.template sed -i "s|{{PG_USERNAME}}|$PG_USERNAME|g" /debezium/config/application.properties.template sed -i "s|{{PG_PASSWORD}}|$PG_PASSWORD|g" /debezium/config/application.properties.template sed -i "s|{{PG_DBNAME}}|$PG_DBNAME|g" /debezium/config/application.properties.template sed -i "s|{{PG_PUBLICATION_NAME}}|$PG_PUBLICATION_NAME|g" /debezium/config/application.properties.template sed -i "s|{{STREAM_NAME}}|$STREAM_NAME|g" /debezium/config/application.properties.template sed -i "s|{{OUTBOX_TABLE}}|$OUTBOX_TABLE|g" /debezium/config/application.properties.template sed -i "s|{{QUEUE_CONNECTION_URI}}|$QUEUE_CONNECTION_URI|g" /debezium/config/application.properties.template# Move the configured file to its final location mv /debezium/config/application.properties.template /debezium/config/application.propertiesecho "Final configuration file content (for debugging):" cat /debezium/config/application.propertiesecho "Configuration complete. Starting Debezium server..." bash ./run.sh
What behavior do you expect?
I expect the PostgreSQL replication slot to regularly update its confirmed_flush_lsn value as Debezium processes WAL entries, allowing PostgreSQL to release processed WAL segments and maintain a reasonable WAL size.
What behavior do you see?
The replication slot's confirmed_flush_lsn is not advancing despite Debezium successfully:
- Processing records (logs show "records sent during previous...")
- Correctly updating offsets in Redis
- Successfully publishing events to RabbitMQ
This results in:
- WAL files growing to 59 GB despite a small database size (18 MB)
- Replication slot showing status "extended"
- Significant lag (59 GB) between pg_current_wal_lsn() and confirmed_flush_lsn
SELECT slot_name, confirmed_flush_lsn, pg_wal_lsn_diff(pg_current_wal_lsn(), confirmed_flush_lsn) as lag_bytes, pg_size_pretty(pg_wal_lsn_diff(pg_current_wal_lsn(), confirmed_flush_lsn)) as lag_size FROM pg_replication_slots; Result: [ { "slot_name": "debezium", "confirmed_flush_lsn": "17A/89005C90", "lag_bytes": 62864205496, "lag_size": "59 GB" } ]
Redis offset storage shows transactions being processed:
Field: ["rabbitmq",{"server":"esz_outbox"}] Value: {"lsn_proc":1645408689392,"messageType":"INSERT","lsn_commit":1625796140176,"lsn":1645408689392,"txId":6787310,"ts_usec":1742484554528465}
But the replication slot's confirmed_flush_lsn remains at "17A/89005C90" indefinitely.
Do you see the same behaviour using the latest released Debezium version?
(Ideally, also verify with latest Alpha/Beta/CR version)
Could not verify, not sure how to quickly test and see it happening :/
Do you have the connector logs, ideally from start till finish?
(You might be asked later to provide DEBUG/TRACE level log)
Yes, I've attached logs showing the connector startup and processing messages. The logs confirm that records are being successfully processed and sent, but the WAL position acknowledgment isn't happening.
Key log entries showing the issue:
Starting configuration process... Working directory: /debezium File details: (...) File content size: 5669 bytes Successfully found configuration file. Content preview: #Commons Configuration debezium.source.connector.class=io.debezium.connector.postgresql.PostgresConnector debezium.source.plugin.name=pgoutput # Offset Configuration Configuration template decrypted successfully Current template content (for debugging): #Commons Configuration debezium.source.connector.class=io.debezium.connector.postgresql.PostgresConnector debezium.source.plugin.name=pgoutput # Offset Configuration debezium.source.snapshot.mode=never debezium.source.offset.storage=io.debezium.storage.redis.offset.RedisOffsetBackingStore debezium.source.offset.storage.redis.address={{REDIS_HOSTNAME}}:{{REDIS_PORT}} debezium.source.offset.storage.redis.user={{REDIS_USER}} debezium.source.offset.storage.redis.password={{REDIS_PASSWORD}} debezium.source.offset.storage.redis.ssl.enabled={{REDISS_USE_SSL}} debezium.source.offset.flush.interval.ms=1000 debezium.source.offset.storage.file.filename= # PostgreSQL Configuration debezium.source.database.hostname={{PG_HOSTNAME}} debezium.source.database.port={{PG_PORT}} debezium.source.database.user={{PG_USERNAME}} debezium.source.database.password={{PG_PASSWORD}} debezium.source.database.dbname={{PG_DBNAME}} debezium.source.database.server.name=prod-postgres-db-01 # Publication and Stream Configuration debezium.source.publication.name={{PG_PUBLICATION_NAME}} debezium.source.topic.prefix={{STREAM_NAME}} debezium.source.table.include.list={{OUTBOX_TABLE}} debezium.source.table.field.event.key=aggregate_id debezium.source.max.batch.size=512 debezium.source.max.queue.size=8192 debezium.source.heartbeat.interval.ms=10000 debezium.source.heartbeat.action.query=SELECT 1 debezium.source.include.schema.changes=false # RabbitMQ Sink Configuration debezium.sink.type=rabbitmq debezium.sink.rabbitmq.connection.uri={{QUEUE_CONNECTION_URI}} debezium.sink.rabbitmq.ssl.enabled=true debezium.sink.rabbitmq.ssl.validate=true debezium.sink.rabbitmq.ssl.validate.server.certificate=true debezium.sink.rabbitmq.ssl.verify.hostname=true debezium.sink.rabbitmq.exchange=outbox # Transformation Configurations debezium.transforms=outbox,filter_heartbeats # Outbox Configuration debezium.transforms.outbox.type=io.debezium.transforms.outbox.EventRouter debezium.transforms.outbox.table.expand.json.payload=false debezium.transforms.outbox.route.by.field=aggregate_type debezium.transforms.outbox.table.field.event.id=id debezium.transforms.outbox.table.field.event.key=aggregate_id debezium.transforms.outbox.table.fields.additional.placement=id:envelope,type:envelope,aggregate_type:envelope,aggregate_id:envelope,created_at:envelope # Filter configuration using a predicate rather than Filter transform debezium.transforms.filter_heartbeats.type=io.debezium.transforms.Filter debezium.transforms.filter_heartbeats.language=jsr223.groovy debezium.transforms.filter_heartbeats.condition=value.schema?.name != 'io.debezium.connector.common.Heartbeat' debezium.sink.tombstones.on.delete=false # Performance Configuration debezium.source.buffer.memory.size=256MB debezium.source.internal.buffer.size=16384 debezium.source.errors.retry.delay.initial.ms=1000 debezium.source.errors.retry.delay.max.ms=10000 debezium.source.errors.max.retries=3 debezium.source.tasks.max=1 debezium.source.poll.interval.ms=1000 #Quarkus Configuration quarkus.log.console.json=false quarkus.log.level=INFO quarkus.profile=prod Configuration complete. Starting Debezium server... 2025-04-07 11:50:10 __ __ _ 2025-04-07 11:50:10 ____/ /___ / /_ ___ ____ (_)__ __ ____ ___ 2025-04-07 11:50:10 / __ // _ \ / __ \ / _ \/_ / / // / / // __ `__ \ 2025-04-07 11:50:10 / /_/ // __// /_/ // __/ / /_ / // /_/ // / / / / / 2025-04-07 11:50:10 \__,_/ \___//_.___/ \___/ /___//_/ \__,_//_/ /_/ /_/ 2025-04-07 11:50:10 2025-04-07 11:50:10 2025-04-07 11:50:10 2025-04-07 11:50:10 Powered by Quarkus 3.8.5 2025-04-07 11:50:10 2025-04-07 10:50:08,540 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) --------------------------------------------------------------------- 2025-04-07 11:50:10 2025-04-07 10:50:08,540 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) Legacy REST API date formats enabled (this is currently the default). 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) For maximum compatibility and to ease upgrades from older versions 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) of Registry, the date format used in the REST API is not compliant 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) with OpenAPI standards (due to a bug in older versions). Please 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) make sure you upgrade all of your client applications to use the 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) latest client version. The next release will fix the date format 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) bug, which will result in older clients no longer being compatible 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) with the REST API. 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) If you would like to fix the date format bug in THIS version of 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) Registry (great!) please set the following ENV variable + value: 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) REGISTRY_APIS_V2_DATE_FORMAT=yyyy-MM-dd'T'HH:mm:ss'Z' 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) Doing this will result in a REST API that is OpenAPI compliant, but 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) please remember to upgrade all your client applications first! 2025-04-07 11:50:10 2025-04-07 10:50:08,541 INFO [io.api.reg.res.JacksonDateTimeCustomizer] (main) --------------------------------------------------------------------- 2025-04-07 11:50:10 2025-04-07 10:50:10,150 WARN [io.qua.config] (main) Unrecognized configuration file file:/debezium/config/application.properties.example found; Please, check if your are providing the proper extension to load the file 2025-04-07 11:50:10 2025-04-07 10:50:10,150 WARN [io.qua.config] (main) Unrecognized configuration file file:/debezium/config/application.properties.cassandra.redis.example found; Please, check if your are providing the proper extension to load the file 2025-04-07 11:50:10 2025-04-07 10:50:10,150 WARN [io.qua.config] (main) Unrecognized configuration file file:/debezium/config/application.properties.encrypted found; Please, check if your are providing the proper extension to load the file 2025-04-07 11:50:10 2025-04-07 10:50:10,327 INFO [io.deb.ser.BaseChangeConsumer] (main) Using 'io.debezium.server.BaseChangeConsumer$$Lambda/0x00007fffd2396500@7327a447' stream name mapper 2025-04-07 11:50:10 2025-04-07 10:50:10,431 WARN [com.rab.cli.TrustEverythingTrustManager] (main) SECURITY ALERT: this trust manager trusts every certificate, effectively disabling peer verification. This is convenient for local development but offers no protection against man-in-the-middle attacks. Please see https://www.rabbitmq.com/ssl.html to learn more about peer certificate verification. 2025-04-07 11:50:10 2025-04-07 10:50:10,435 INFO [io.deb.ser.rab.RabbitMqStreamChangeConsumer] (main) Using connection to ********.rmq.cloudamqp.com:5671 2025-04-07 11:50:11 2025-04-07 10:50:11,693 INFO [io.deb.ser.DebeziumServer] (main) Consumer 'io.debezium.server.rabbitmq.RabbitMqStreamChangeConsumer' instantiated 2025-04-07 11:50:11 2025-04-07 10:50:11,843 INFO [org.apa.kaf.con.jso.JsonConverterConfig] (main) JsonConverterConfig values: 2025-04-07 11:50:11 converter.type = header 2025-04-07 11:50:11 decimal.format = BASE64 2025-04-07 11:50:11 replace.null.with.default = true 2025-04-07 11:50:11 schemas.cache.size = 1000 2025-04-07 11:50:11 schemas.enable = true 2025-04-07 11:50:11 2025-04-07 11:50:11 2025-04-07 10:50:11,845 INFO [org.apa.kaf.con.jso.JsonConverterConfig] (main) JsonConverterConfig values: 2025-04-07 11:50:11 converter.type = key 2025-04-07 11:50:11 decimal.format = BASE64 2025-04-07 11:50:11 replace.null.with.default = true 2025-04-07 11:50:11 schemas.cache.size = 1000 2025-04-07 11:50:11 schemas.enable = true 2025-04-07 11:50:11 2025-04-07 11:50:11 2025-04-07 10:50:11,848 INFO [org.apa.kaf.con.jso.JsonConverterConfig] (main) JsonConverterConfig values: 2025-04-07 11:50:11 converter.type = value 2025-04-07 11:50:11 decimal.format = BASE64 2025-04-07 11:50:11 replace.null.with.default = true 2025-04-07 11:50:11 schemas.cache.size = 1000 2025-04-07 11:50:11 schemas.enable = true 2025-04-07 11:50:11 2025-04-07 11:50:11 2025-04-07 10:50:11,929 INFO [io.deb.emb.EmbeddedWorkerConfig] (main) EmbeddedWorkerConfig values: 2025-04-07 11:50:11 access.control.allow.methods = 2025-04-07 11:50:11 access.control.allow.origin = 2025-04-07 11:50:11 admin.listeners = null 2025-04-07 11:50:11 auto.include.jmx.reporter = true 2025-04-07 11:50:11 bootstrap.servers = [localhost:9092] 2025-04-07 11:50:11 client.dns.lookup = use_all_dns_ips 2025-04-07 11:50:11 config.providers = [] 2025-04-07 11:50:11 connector.client.config.override.policy = All 2025-04-07 11:50:11 header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter 2025-04-07 11:50:11 key.converter = class org.apache.kafka.connect.json.JsonConverter 2025-04-07 11:50:11 listeners = [http://:8083] 2025-04-07 11:50:11 metric.reporters = [] 2025-04-07 11:50:11 metrics.num.samples = 2 2025-04-07 11:50:11 metrics.recording.level = INFO 2025-04-07 11:50:11 metrics.sample.window.ms = 30000 2025-04-07 11:50:11 offset.flush.interval.ms = 1000 2025-04-07 11:50:11 offset.flush.timeout.ms = 5000 2025-04-07 11:50:11 offset.storage.file.filename = 2025-04-07 11:50:11 offset.storage.partitions = null 2025-04-07 11:50:11 offset.storage.replication.factor = null 2025-04-07 11:50:11 offset.storage.topic = 2025-04-07 11:50:11 plugin.discovery = hybrid_warn 2025-04-07 11:50:11 plugin.path = null 2025-04-07 11:50:11 response.http.headers.config = 2025-04-07 11:50:11 rest.advertised.host.name = null 2025-04-07 11:50:11 rest.advertised.listener = null 2025-04-07 11:50:11 rest.advertised.port = null 2025-04-07 11:50:11 rest.extension.classes = [] 2025-04-07 11:50:11 ssl.cipher.suites = null 2025-04-07 11:50:11 ssl.client.auth = none 2025-04-07 11:50:11 ssl.enabled.protocols = [TLSv1.2, TLSv1.3] 2025-04-07 11:50:11 ssl.endpoint.identification.algorithm = https 2025-04-07 11:50:11 ssl.engine.factory.class = null 2025-04-07 11:50:11 ssl.key.password = null 2025-04-07 11:50:11 ssl.keymanager.algorithm = SunX509 2025-04-07 11:50:11 ssl.keystore.certificate.chain = null 2025-04-07 11:50:11 ssl.keystore.key = null 2025-04-07 11:50:11 ssl.keystore.location = null 2025-04-07 11:50:11 ssl.keystore.password = null 2025-04-07 11:50:11 ssl.keystore.type = JKS 2025-04-07 11:50:11 ssl.protocol = TLSv1.3 2025-04-07 11:50:11 ssl.provider = null 2025-04-07 11:50:11 ssl.secure.random.implementation = null 2025-04-07 11:50:11 ssl.trustmanager.algorithm = PKIX 2025-04-07 11:50:11 ssl.truststore.certificates = null 2025-04-07 11:50:11 ssl.truststore.location = null 2025-04-07 11:50:11 ssl.truststore.password = null 2025-04-07 11:50:11 ssl.truststore.type = JKS 2025-04-07 11:50:11 task.shutdown.graceful.timeout.ms = 5000 2025-04-07 11:50:11 topic.creation.enable = true 2025-04-07 11:50:11 topic.tracking.allow.reset = true 2025-04-07 11:50:11 topic.tracking.enable = true 2025-04-07 11:50:11 value.converter = class org.apache.kafka.connect.json.JsonConverter 2025-04-07 11:50:11 2025-04-07 11:50:12 2025-04-07 10:50:12,010 INFO [io.deb.tra.Filter] (main) Using language 'jsr223.groovy' to evaluate expression 'value.schema?.name != 'io.debezium.connector.common.Heartbeat'' 2025-04-07 11:50:13 2025-04-07 10:50:13,240 INFO [org.apa.kaf.con.jso.JsonConverterConfig] (main) JsonConverterConfig values: 2025-04-07 11:50:13 converter.type = key 2025-04-07 11:50:13 decimal.format = BASE64 2025-04-07 11:50:13 replace.null.with.default = true 2025-04-07 11:50:13 schemas.cache.size = 1000 2025-04-07 11:50:13 schemas.enable = false 2025-04-07 11:50:13 2025-04-07 11:50:13 2025-04-07 10:50:13,241 INFO [org.apa.kaf.con.jso.JsonConverterConfig] (main) JsonConverterConfig values: 2025-04-07 11:50:13 converter.type = value 2025-04-07 11:50:13 decimal.format = BASE64 2025-04-07 11:50:13 replace.null.with.default = true 2025-04-07 11:50:13 schemas.cache.size = 1000 2025-04-07 11:50:13 schemas.enable = false 2025-04-07 11:50:13 2025-04-07 11:50:13 2025-04-07 10:50:13,242 INFO [io.deb.ser.DebeziumServer] (main) Engine executor started 2025-04-07 11:50:13 2025-04-07 10:50:13,242 INFO [io.deb.emb.asy.AsyncEmbeddedEngine] (pool-7-thread-1) Engine state has changed from 'CREATING' to 'INITIALIZING' 2025-04-07 11:50:13 2025-04-07 10:50:13,422 INFO [io.deb.con.CommonConnectorConfig] (pool-7-thread-1) Loading the custom source info struct maker plugin: io.debezium.connector.postgresql.PostgresSourceInfoStructMaker 2025-04-07 11:50:13 2025-04-07 10:50:13,737 INFO [io.quarkus] (main) debezium-server-dist 3.0.0.Final on JVM (powered by Quarkus 3.8.5) started in 7.302s. Listening on: http://0.0.0.0:8080 2025-04-07 11:50:13 2025-04-07 10:50:13,741 INFO [io.quarkus] (main) Profile prod activated. 2025-04-07 11:50:13 2025-04-07 10:50:13,801 INFO [io.quarkus] (main) Installed features: [cdi, kubernetes-client, resteasy, resteasy-jackson, smallrye-context-propagation, smallrye-health, vertx] 2025-04-07 11:50:14 2025-04-07 10:50:14,938 INFO [io.deb.con.pos.PostgresConnector] (pool-7-thread-1) Successfully tested connection for jdbc:postgresql://192.168.65.254:5432/my_db with user 'deb_db_usr' 2025-04-07 11:50:15 2025-04-07 10:50:15,479 INFO [io.deb.jdb.JdbcConnection] (pool-12-thread-1) Connection gracefully closed 2025-04-07 11:50:15 2025-04-07 10:50:15,505 INFO [io.deb.sto.red.RedisCommonConfig] (pool-7-thread-1) Configuration for 'RedisOffsetBackingStoreConfig' with prefix 'offset.storage.': {rabbitmq.ssl.enabled=true, redis.password=********, rabbitmq.connection.uri=amqps://********:********@********.rmq.cloudamqp.com/********, rabbitmq.ssl.validate=true, rabbitmq.ssl.verify.hostname=true, redis.ssl.enabled=true, redis.user=, rabbitmq.ssl.validate.server.certificate=true, redis.address=****.redis.cache.windows.net:6380, file.filename=, rabbitmq.exchange=outbox} 2025-04-07 11:50:15 2025-04-07 10:50:15,507 INFO [io.deb.sto.red.off.RedisOffsetBackingStore] (pool-7-thread-1) Starting RedisOffsetBackingStore 2025-04-07 11:50:17 2025-04-07 10:50:17,631 INFO [io.deb.sto.red.RedisConnection] (pool-7-thread-1) Using Redis client 'JedisClient [jedis=Jedis{Connection{DefaultJedisSocketFactory{****.redis.cache.windows.net:6380}}}]' 2025-04-07 11:50:17 2025-04-07 10:50:17,970 INFO [io.deb.sto.red.off.RedisOffsetBackingStore] (pool-7-thread-1) Offsets: { ["rabbitmq",{"server":"esz_outbox"}]={"lsn_proc":1716040884464,"messageType":"INSERT","lsn":1716040884464,"txId":7080563,"ts_usec":1744021804796053}, ["rabbitmq",{"server":"esz_outbox_new"}]={"lsn_proc":1645408689392,"messageType":"INSERT","lsn_commit":1625796140176,"lsn":1645408689392,"txId":6787310,"ts_usec":1742484554528465} } 2025-04-07 11:50:17 2025-04-07 10:50:17,995 INFO [io.deb.emb.asy.AsyncEmbeddedEngine] (pool-7-thread-1) Engine state has changed from 'INITIALIZING' to 'CREATING_TASKS' 2025-04-07 11:50:18 2025-04-07 10:50:18,032 INFO [io.deb.emb.asy.AsyncEmbeddedEngine] (pool-7-thread-1) Engine state has changed from 'CREATING_TASKS' to 'STARTING_TASKS' 2025-04-07 11:50:18 2025-04-07 10:50:18,033 INFO [io.deb.emb.asy.AsyncEmbeddedEngine] (pool-7-thread-1) Waiting max. for 180000 ms for individual source tasks to start. 2025-04-07 11:50:18 2025-04-07 10:50:18,037 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) Starting PostgresConnectorTask with configuration: 2025-04-07 11:50:18 2025-04-07 10:50:18,038 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) connector.class = io.debezium.connector.postgresql.PostgresConnector 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) schema.history.internal.rabbitmq.connection.uri = amqps://********:********@********.rmq.cloudamqp.com/******** 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.outbox.type = io.debezium.transforms.outbox.EventRouter 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.rabbitmq.ssl.verify.hostname = true 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) publication.name = debezium_outbox_publication 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms = outbox,filter_heartbeats 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) table.field.event.key = aggregate_id 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) buffer.memory.size = 256MB 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) include.schema.changes = false 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.outbox.table.expand.json.payload = false 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) heartbeat.action.query = SELECT 1 2025-04-07 11:50:18 2025-04-07 10:50:18,039 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) poll.interval.ms = 1000 2025-04-07 11:50:18 2025-04-07 10:50:18,040 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) record.processing.threads = 2025-04-07 11:50:18 2025-04-07 10:50:18,041 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) errors.retry.delay.initial.ms = 1000 2025-04-07 11:50:18 2025-04-07 10:50:18,041 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) key.converter = org.apache.kafka.connect.json.JsonConverter 2025-04-07 11:50:18 2025-04-07 10:50:18,041 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) database.dbname = my_db 2025-04-07 11:50:18 2025-04-07 10:50:18,041 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) database.user = deb_db_usr 2025-04-07 11:50:18 2025-04-07 10:50:18,041 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage = io.debezium.storage.redis.offset.RedisOffsetBackingStore 2025-04-07 11:50:18 2025-04-07 10:50:18,042 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.outbox.table.fields.additional.placement = id:envelope,type:envelope,aggregate_type:envelope,aggregate_id:envelope,created_at:envelope 2025-04-07 11:50:18 2025-04-07 10:50:18,042 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.outbox.table.field.event.key = aggregate_id 2025-04-07 11:50:18 2025-04-07 10:50:18,042 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.outbox.route.by.field = aggregate_type 2025-04-07 11:50:18 2025-04-07 10:50:18,042 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) heartbeat.interval.ms = 10000 2025-04-07 11:50:18 2025-04-07 10:50:18,042 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) plugin.name = pgoutput 2025-04-07 11:50:18 2025-04-07 10:50:18,043 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) internal.task.management.timeout.ms = 180000 2025-04-07 11:50:18 2025-04-07 10:50:18,043 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.rabbitmq.ssl.validate = true 2025-04-07 11:50:18 2025-04-07 10:50:18,043 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) errors.max.retries = 3 2025-04-07 11:50:18 2025-04-07 10:50:18,043 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) database.password = ******** 2025-04-07 11:50:18 2025-04-07 10:50:18,043 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) name = rabbitmq 2025-04-07 11:50:18 2025-04-07 10:50:18,045 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.rabbitmq.ssl.validate.server.certificate = true 2025-04-07 11:50:18 2025-04-07 10:50:18,045 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) schema.history.internal.rabbitmq.ssl.verify.hostname = true 2025-04-07 11:50:18 2025-04-07 10:50:18,045 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) max.batch.size = 512 2025-04-07 11:50:18 2025-04-07 10:50:18,045 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.redis.password = ******** 2025-04-07 11:50:18 2025-04-07 10:50:18,045 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) schema.history.internal.rabbitmq.exchange = outbox 2025-04-07 11:50:18 2025-04-07 10:50:18,045 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) snapshot.mode = never 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) max.queue.size = 8192 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.filter_heartbeats.condition = value.schema?.name != 'io.debezium.connector.common.Heartbeat' 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.redis.ssl.enabled = true 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) tasks.max = 1 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) record.processing.shutdown.timeout.ms = 1000 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.redis.user = 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) record.processing.order = ORDERED 2025-04-07 11:50:18 2025-04-07 10:50:18,046 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.rabbitmq.ssl.enabled = true 2025-04-07 11:50:18 2025-04-07 10:50:18,047 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.redis.address = ****.redis.cache.windows.net:6380 2025-04-07 11:50:18 2025-04-07 10:50:18,047 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) topic.prefix = esz_outbox 2025-04-07 11:50:18 2025-04-07 10:50:18,047 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.file.filename = 2025-04-07 11:50:18 2025-04-07 10:50:18,047 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.filter_heartbeats.type = io.debezium.transforms.Filter 2025-04-07 11:50:18 2025-04-07 10:50:18,047 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.rabbitmq.exchange = outbox 2025-04-07 11:50:18 2025-04-07 10:50:18,047 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) value.converter = org.apache.kafka.connect.json.JsonConverter 2025-04-07 11:50:18 2025-04-07 10:50:18,048 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) internal.buffer.size = 16384 2025-04-07 11:50:18 2025-04-07 10:50:18,048 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.filter_heartbeats.language = jsr223.groovy 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) errors.retry.delay.max.ms = 10000 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) database.server.name = prod-postgres-db-01 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.flush.timeout.ms = 5000 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) transforms.outbox.table.field.event.id = id 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) database.port = 5432 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) schema.history.internal.rabbitmq.ssl.validate.server.certificate = true 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) schema.history.internal.rabbitmq.ssl.enabled = true 2025-04-07 11:50:18 2025-04-07 10:50:18,049 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.flush.interval.ms = 1000 2025-04-07 11:50:18 2025-04-07 10:50:18,050 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) record.processing.with.serial.consumer = false 2025-04-07 11:50:18 2025-04-07 10:50:18,050 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) database.hostname = 192.168.65.254 2025-04-07 11:50:18 2025-04-07 10:50:18,050 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) table.include.list = debezium.outbox 2025-04-07 11:50:18 2025-04-07 10:50:18,050 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) schema.history.internal.rabbitmq.ssl.validate = true 2025-04-07 11:50:18 2025-04-07 10:50:18,050 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) offset.storage.rabbitmq.connection.uri = amqps://********:********@********.rmq.cloudamqp.com/******** 2025-04-07 11:50:18 2025-04-07 10:50:18,051 INFO [io.deb.con.CommonConnectorConfig] (pool-10-thread-1) Loading the custom source info struct maker plugin: io.debezium.connector.postgresql.PostgresSourceInfoStructMaker 2025-04-07 11:50:18 2025-04-07 10:50:18,054 INFO [io.deb.con.CommonConnectorConfig] (pool-10-thread-1) Loading the custom topic naming strategy plugin: io.debezium.schema.SchemaTopicNamingStrategy 2025-04-07 11:50:19 2025-04-07 10:50:19,010 INFO [io.deb.jdb.JdbcConnection] (pool-13-thread-1) Connection gracefully closed 2025-04-07 11:50:21 2025-04-07 10:50:21,033 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:14114, name:_pg_user_mappings] is already mapped 2025-04-07 11:50:21 2025-04-07 10:50:21,060 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13788, name:cardinal_number] is already mapped 2025-04-07 11:50:21 2025-04-07 10:50:21,061 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13791, name:character_data] is already mapped 2025-04-07 11:50:21 2025-04-07 10:50:21,061 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13793, name:sql_identifier] is already mapped 2025-04-07 11:50:21 2025-04-07 10:50:21,061 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13799, name:time_stamp] is already mapped 2025-04-07 11:50:21 2025-04-07 10:50:21,061 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13801, name:yes_or_no] is already mapped 2025-04-07 11:50:21 2025-04-07 10:50:21,222 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) Found previous partition offset PostgresPartition [sourcePartition={server=esz_outbox}]: {lsn_proc=1716040884464, messageType=INSERT, lsn_commit=1716040884464, lsn=1716040884464, txId=7080563, ts_usec=1744021804796053} 2025-04-07 11:50:23 2025-04-07 10:50:23,171 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:14114, name:_pg_user_mappings] is already mapped 2025-04-07 11:50:23 2025-04-07 10:50:23,176 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13788, name:cardinal_number] is already mapped 2025-04-07 11:50:23 2025-04-07 10:50:23,177 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13791, name:character_data] is already mapped 2025-04-07 11:50:23 2025-04-07 10:50:23,177 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13793, name:sql_identifier] is already mapped 2025-04-07 11:50:23 2025-04-07 10:50:23,177 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13799, name:time_stamp] is already mapped 2025-04-07 11:50:23 2025-04-07 10:50:23,177 WARN [io.deb.con.pos.TypeRegistry] (pool-10-thread-1) Type [oid:13801, name:yes_or_no] is already mapped 2025-04-07 11:50:23 2025-04-07 10:50:23,520 INFO [io.deb.con.pos.con.PostgresConnection] (pool-10-thread-1) Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{18F/8C01E0F0}, catalogXmin=7028240] 2025-04-07 11:50:23 2025-04-07 10:50:23,542 INFO [io.deb.con.pos.PostgresConnectorTask] (pool-10-thread-1) Found previous offset PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='esz_outbox'db='my_db', lsn=LSN{18F/8C01E0F0}, txId=7080563, messageType=INSERT, lastCommitLsn=LSN{18F/8C01E0F0}, timestamp=2025-04-07T10:30:04.796053Z, snapshot=FALSE, schema=, table=], lastSnapshotRecord=false, lastCompletelyProcessedLsn=LSN{18F/8C01E0F0}, lastCommitLsn=LSN{18F/8C01E0F0}, streamingStoppingLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]] 2025-04-07 11:50:23 2025-04-07 10:50:23,810 INFO [io.deb.con.pos.PostgresConnectorTask] (pool-10-thread-1) user 'deb_db_usr' connected to database 'my_db' on PostgreSQL 16.8 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0, 64-bit with roles: 2025-04-07 11:50:23 role 'deb_db_usr' [superuser: false, replication: true, inherit: true, create role: false, create db: false, can log in: true] 2025-04-07 11:50:23 role 'debezium_admins' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false] 2025-04-07 11:50:23 2025-04-07 10:50:23,936 INFO [io.deb.con.pos.con.PostgresConnection] (pool-10-thread-1) Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{18F/8C01E0F0}, catalogXmin=7028240] 2025-04-07 11:50:24 2025-04-07 10:50:24,096 INFO [io.deb.uti.Threads] (pool-10-thread-1) Requested thread factory for component PostgresConnector, id = esz_outbox named = SignalProcessor 2025-04-07 11:50:24 2025-04-07 10:50:24,124 INFO [io.deb.uti.Threads] (pool-10-thread-1) Requested thread factory for component PostgresConnector, id = esz_outbox named = change-event-source-coordinator 2025-04-07 11:50:24 2025-04-07 10:50:24,124 INFO [io.deb.uti.Threads] (pool-10-thread-1) Requested thread factory for component PostgresConnector, id = esz_outbox named = blocking-snapshot 2025-04-07 11:50:24 2025-04-07 10:50:24,134 INFO [io.deb.uti.Threads] (pool-10-thread-1) Creating thread debezium-postgresconnector-esz_outbox-change-event-source-coordinator 2025-04-07 11:50:24 2025-04-07 10:50:24,137 INFO [io.deb.emb.asy.AsyncEmbeddedEngine] (pool-7-thread-1) All tasks have started successfully. 2025-04-07 11:50:24 2025-04-07 10:50:24,137 INFO [io.deb.emb.asy.AsyncEmbeddedEngine] (pool-7-thread-1) Engine state has changed from 'STARTING_TASKS' to 'POLLING_TASKS' 2025-04-07 11:50:24 2025-04-07 10:50:24,138 INFO [io.deb.emb.asy.AsyncEmbeddedEngine] (pool-7-thread-1) Using io.debezium.embedded.async.ParallelSmtAndConvertBatchProcessor processor 2025-04-07 11:50:24 2025-04-07 10:50:24,438 INFO [io.deb.pip.ChangeEventSourceCoordinator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Metrics registered 2025-04-07 11:50:24 2025-04-07 10:50:24,439 INFO [io.deb.pip.ChangeEventSourceCoordinator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Context created 2025-04-07 11:50:24 2025-04-07 10:50:24,443 INFO [io.deb.con.pos.PostgresSnapshotChangeEventSource] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) A previous offset indicating a completed snapshot has been found. 2025-04-07 11:50:24 2025-04-07 10:50:24,444 INFO [io.deb.con.pos.PostgresSnapshotChangeEventSource] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) According to the connector configuration no snapshot will be executed 2025-04-07 11:50:24 2025-04-07 10:50:24,446 INFO [io.deb.pip.ChangeEventSourceCoordinator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Snapshot ended with SnapshotResult [status=SKIPPED, offset=PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='esz_outbox'db='my_db', lsn=LSN{18F/8C01E0F0}, txId=7080563, messageType=INSERT, lastCommitLsn=LSN{18F/8C01E0F0}, timestamp=2025-04-07T10:30:04.796053Z, snapshot=FALSE, schema=, table=], lastSnapshotRecord=false, lastCompletelyProcessedLsn=LSN{18F/8C01E0F0}, lastCommitLsn=LSN{18F/8C01E0F0}, streamingStoppingLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]]] 2025-04-07 11:50:24 2025-04-07 10:50:24,449 INFO [io.deb.pip.ChangeEventSourceCoordinator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Connected metrics set to 'true' 2025-04-07 11:50:25 2025-04-07 10:50:25,278 INFO [io.deb.con.pos.PostgresSchema] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) REPLICA IDENTITY for 'debezium.outbox' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2025-04-07 11:50:25 2025-04-07 10:50:25,321 INFO [io.deb.pip.sig.SignalProcessor] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) SignalProcessor started. Scheduling it every 5000ms 2025-04-07 11:50:25 2025-04-07 10:50:25,322 INFO [io.deb.uti.Threads] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Creating thread debezium-postgresconnector-esz_outbox-SignalProcessor 2025-04-07 11:50:25 2025-04-07 10:50:25,322 INFO [io.deb.pip.ChangeEventSourceCoordinator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Starting streaming 2025-04-07 11:50:25 2025-04-07 10:50:25,323 INFO [io.deb.con.pos.PostgresStreamingChangeEventSource] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Retrieved latest position from stored offset 'LSN{18F/8C01E0F0}' 2025-04-07 11:50:25 2025-04-07 10:50:25,325 INFO [io.deb.con.pos.con.WalPositionLocator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Looking for WAL restart position for last commit LSN 'LSN{18F/8C01E0F0}' and last change LSN 'LSN{18F/8C01E0F0}' 2025-04-07 11:50:25 2025-04-07 10:50:25,326 INFO [io.deb.con.pos.con.PostgresReplicationConnection] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Initializing PgOutput logical decoder publication 2025-04-07 11:50:27 2025-04-07 10:50:27,425 INFO [io.deb.con.pos.con.PostgresConnection] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{18F/8C01E0F0}, catalogXmin=7028240] 2025-04-07 11:50:27 2025-04-07 10:50:27,561 INFO [io.deb.jdb.JdbcConnection] (pool-14-thread-1) Connection gracefully closed 2025-04-07 11:50:27 2025-04-07 10:50:27,860 INFO [io.deb.uti.Threads] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Requested thread factory for component PostgresConnector, id = esz_outbox named = keep-alive 2025-04-07 11:50:27 2025-04-07 10:50:27,861 INFO [io.deb.uti.Threads] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Creating thread debezium-postgresconnector-esz_outbox-keep-alive 2025-04-07 11:50:28 2025-04-07 10:50:28,399 INFO [io.deb.con.pos.PostgresSchema] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) REPLICA IDENTITY for 'debezium.outbox' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2025-04-07 11:50:28 2025-04-07 10:50:28,529 INFO [io.deb.con.pos.PostgresStreamingChangeEventSource] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Searching for WAL resume position 2025-04-07 11:50:36 2025-04-07 10:50:36,191 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) 1 records sent during previous 00:00:18.169, last recorded offset of {server=esz_outbox} partition is {lsn_proc=1716040884464, messageType=INSERT, lsn_commit=1716040884464, lsn=1716040884464, txId=7080563, ts_usec=1744021804796053} 2025-04-07 11:50:57 2025-04-07 10:50:57,630 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) 2 records sent during previous 00:00:21.437, last recorded offset of {server=esz_outbox} partition is {lsn_proc=1716040884464, messageType=INSERT, lsn_commit=1716040884464, lsn=1716040884464, txId=7080563, ts_usec=1744021804796053} 2025-04-07 11:51:39 2025-04-07 10:51:39,822 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) 4 records sent during previous 00:00:42.194, last recorded offset of {server=esz_outbox} partition is {lsn_proc=1716040884464, messageType=INSERT, lsn_commit=1716040884464, lsn=1716040884464, txId=7080563, ts_usec=1744021804796053} 2025-04-07 11:52:53 2025-04-07 10:52:53,127 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) 7 records sent during previous 00:01:13.305, last recorded offset of {server=esz_outbox} partition is {lsn_proc=1716040884464, messageType=INSERT, lsn_commit=1716040884464, lsn=1716040884464, txId=7080563, ts_usec=1744021804796053} 2025-04-07 11:54:29 2025-04-07 10:54:29,036 INFO [io.deb.con.pos.con.WalPositionLocator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) First LSN 'LSN{18F/8C0138C8}' received 2025-04-07 11:54:29 2025-04-07 10:54:29,360 INFO [io.deb.con.pos.con.WalPositionLocator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) LSN after last stored change LSN 'LSN{18F/8D002E98}' received 2025-04-07 11:54:29 2025-04-07 10:54:29,360 INFO [io.deb.con.pos.PostgresStreamingChangeEventSource] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) WAL resume position 'LSN{18F/8D002E98}' discovered 2025-04-07 11:54:29 2025-04-07 10:54:29,635 INFO [io.deb.jdb.JdbcConnection] (pool-15-thread-1) Connection gracefully closed 2025-04-07 11:54:29 2025-04-07 10:54:29,639 INFO [io.deb.jdb.JdbcConnection] (pool-16-thread-1) Connection gracefully closed 2025-04-07 11:54:30 2025-04-07 10:54:30,463 INFO [io.deb.con.pos.con.PostgresReplicationConnection] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Initializing PgOutput logical decoder publication 2025-04-07 11:54:30 2025-04-07 10:54:30,994 INFO [io.deb.uti.Threads] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Requested thread factory for component PostgresConnector, id = esz_outbox named = keep-alive 2025-04-07 11:54:30 2025-04-07 10:54:30,996 INFO [io.deb.uti.Threads] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Creating thread debezium-postgresconnector-esz_outbox-keep-alive 2025-04-07 11:54:30 2025-04-07 10:54:30,997 INFO [io.deb.con.pos.PostgresStreamingChangeEventSource] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Processing messages 2025-04-07 11:54:31 2025-04-07 10:54:31,000 INFO [io.deb.con.pos.con.AbstractMessageDecoder] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Streaming requested from LSN LSN{18F/8C01E0F0}, received LSN LSN{18F/8C0138C8} identified as already processed 2025-04-07 11:54:32 2025-04-07 10:54:32,460 INFO [io.deb.con.pos.con.WalPositionLocator] (debezium-postgresconnector-esz_outbox-change-event-source-coordinator) Message with LSN 'LSN{18F/8D002E98}' arrived, switching off the filtering 2025-04-07 11:55:41 2025-04-07 10:55:41,771 INFO [io.deb.con.com.BaseSourceTask] (pool-10-thread-1) 16 records sent during previous 00:02:48.643, last recorded offset of {server=esz_outbox} partition is {lsn_proc=1716057550488, messageType=COMMIT, lsn_commit=1716057550488, lsn=1716057550488, txId=7080563, ts_usec=1744021804796053}
How to reproduce the issue using our tutorial deployment?
Not sure