Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1161

Postgresql Snapshot with a table that has > 8192records hangs

XMLWordPrintable

    • Hide

      Every table I have that has > 8192 rows hangs. It appears to hang on the rs.next() line in this function in RecordsSnapshotProducer.java

          private void readTable(TableId tableId, ResultSet rs,
                           BlockingConsumer<ChangeEvent> consumer,
                           AtomicInteger rowsCounter) throws SQLException, InterruptedException {
        Table table = schema().tableFor(tableId);
        assert table != null;
        final int numColumns = table.columns().size();
        final Object[] row = new Object[numColumns];
        final ResultSetMetaData metaData = rs.getMetaData();
        while (rs.next()) {
            rowsCounter.incrementAndGet();
            sendCurrentRecord(consumer);
            for (int i = 0, j = 1; i != numColumns; ++i, ++j) {
                row[i] = valueForColumn(rs, j, metaData);
            }
            generateReadRecord(tableId, row);
        }
    }
      Show
      Every table I have that has > 8192 rows hangs. It appears to hang on the rs.next() line in this function in RecordsSnapshotProducer.java private void readTable(TableId tableId, ResultSet rs, BlockingConsumer<ChangeEvent> consumer, AtomicInteger rowsCounter) throws SQLException, InterruptedException { Table table = schema().tableFor(tableId); assert table != null ; final int numColumns = table.columns().size(); final Object [] row = new Object [numColumns]; final ResultSetMetaData metaData = rs.getMetaData(); while (rs.next()) { rowsCounter.incrementAndGet(); sendCurrentRecord(consumer); for ( int i = 0, j = 1; i != numColumns; ++i, ++j) { row[i] = valueForColumn(rs, j, metaData); } generateReadRecord(tableId, row); } }

      As soon as the postgres connector encounters a table that has > 8192 rows it hangs without any errors. Given the number? Is there some kind of configuration setting I am missing?
      Note this did not happen using the same configuration in 0.8

              jpechane Jiri Pechanec
              splace_jira Sandy Place (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: