Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5644

OracleClobDataTypeIT shouldNotStreamAnyChangesWhenLobEraseIsDetected may fail randomly

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Cannot Reproduce
    • Icon: Major Major
    • None
    • 1.9.5.Final, 2.0.0.Beta2
    • oracle-connector
    • None
    • False
    • None
    • False

      This has recently resurfaced on internal CI:

      org.junit.ComparisonFailure: expected:<[tru]e> but was:<[fals]e>
      	at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      	at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:77)
      	at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      	at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:499)
      	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:480)
      	at org.fest.assertions.ConstructorInvoker.newInstance(ConstructorInvoker.java:36)
      	at org.fest.assertions.ComparisonFailureFactory.newComparisonFailure(ComparisonFailureFactory.java:60)
      	at org.fest.assertions.ComparisonFailureFactory.comparisonFailure(ComparisonFailureFactory.java:46)
      	at org.fest.assertions.Fail.comparisonFailed(Fail.java:83)
      	at org.fest.assertions.Fail.failIfNotEqual(Fail.java:71)
      	at org.fest.assertions.GenericAssert.isEqualTo(GenericAssert.java:217)
      	at org.fest.assertions.BooleanAssert.isEqualTo(BooleanAssert.java:73)
      	at org.fest.assertions.BooleanAssert.isTrue(BooleanAssert.java:55)
      	at io.debezium.embedded.AbstractConnectorTest.assertNoRecordsToConsume(AbstractConnectorTest.java:916)
      	at io.debezium.connector.oracle.OracleClobDataTypeIT.shouldNotStreamAnyChangesWhenLobEraseIsDetected(OracleClobDataTypeIT.java:1122)
      	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
      	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
      	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
      	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
      	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
      	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:377)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:284)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:248)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:167)
      	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:456)
      	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:169)
      	at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:595)
      	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:581)
      

      The log shows:

      2022-09-22 04:31:23,709 INFO   OracleClobDataTypeIT||test  Starting test io.debezium.connector.oracle.OracleClobDataTypeIT#shouldNotStreamAnyChangesWhenLobEraseIsDetected   [io.debezium.connector.oracle.OracleClobDataTypeIT]
      2022-09-22 04:31:23,761 INFO   OracleClobDataTypeIT||test  Database Version: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
      Version 19.3.0.0.0   [io.debezium.connector.oracle.OracleConnection]
      2022-09-22 04:31:23,803 WARN   OracleClobDataTypeIT||test  Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results.   [org.apache.kafka.connect.runtime.WorkerConfig]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine  Starting OracleConnectorTask with configuration:   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     log.mining.buffer.drop.on.stop = true   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     connector.class = io.debezium.connector.oracle.OracleConnector   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.dbname = ORCLCDB   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.user = c##dbzuser   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.pdb.name = ORCLPDB1   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.connection.adapter = logminer   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     offset.flush.timeout.ms = 5000   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     log.mining.strategy = online_catalog   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     include.schema.changes = false   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.port = 1521   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     schema.history.internal.file.filename = /home/centos/workspace/connector-debezium-oracle-matrix-test/Node/NodeXL/ORACLE_VERSION/19.3.0/debezium-connector-oracle/target/data/file-schema-history-connect.txt   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     offset.flush.interval.ms = 0   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     topic.prefix = server1   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     schema.history.internal = io.debezium.storage.file.history.FileSchemaHistory   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     offset.storage.file.filename = /home/centos/workspace/connector-debezium-oracle-matrix-test/Node/NodeXL/ORACLE_VERSION/19.3.0/debezium-connector-oracle/target/data/file-connector-offsets.txt   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.hostname = 0.0.0.0   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.password = ********   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     name = testing-connector   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     lob.enabled = true   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     value.converter = org.apache.kafka.connect.json.JsonConverter   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     table.include.list = DEBEZIUM\.CLOB_TEST   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     key.converter = org.apache.kafka.connect.json.JsonConverter   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,804 INFO   OracleClobDataTypeIT||engine     database.admin.hostname = 0.0.0.0   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,805 INFO   OracleClobDataTypeIT||engine  Loading the custom topic naming strategy plugin: io.debezium.schema.SchemaTopicNamingStrategy   [io.debezium.config.CommonConnectorConfig]
      2022-09-22 04:31:23,841 INFO   OracleClobDataTypeIT||engine  Database Version: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
      Version 19.3.0.0.0   [io.debezium.connector.oracle.OracleConnection]
      2022-09-22 04:31:23,843 INFO   OracleClobDataTypeIT||engine  No previous offsets found   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:23,843 INFO   OracleClobDataTypeIT||engine  Connector started for the first time, database schema history recovery will not be executed   [io.debezium.connector.oracle.OracleConnectorTask]
      2022-09-22 04:31:23,844 INFO   OracleClobDataTypeIT||engine  Requested thread factory for connector OracleConnector, id = server1 named = change-event-source-coordinator   [io.debezium.util.Threads]
      2022-09-22 04:31:23,844 INFO   OracleClobDataTypeIT||engine  Creating thread debezium-oracleconnector-server1-change-event-source-coordinator   [io.debezium.util.Threads]
      2022-09-22 04:31:23,844 INFO   Oracle|server1|snapshot  Metrics registered   [io.debezium.pipeline.ChangeEventSourceCoordinator]
      2022-09-22 04:31:23,844 INFO   Oracle|server1|snapshot  Context created   [io.debezium.pipeline.ChangeEventSourceCoordinator]
      2022-09-22 04:31:23,844 INFO   Oracle|server1|snapshot  No previous offset has been found.   [io.debezium.connector.oracle.OracleSnapshotChangeEventSource]
      2022-09-22 04:31:23,844 INFO   Oracle|server1|snapshot  According to the connector configuration both schema and data will be snapshot.   [io.debezium.connector.oracle.OracleSnapshotChangeEventSource]
      2022-09-22 04:31:23,847 INFO   Oracle|server1|snapshot  Snapshot step 1 - Preparing   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:23,847 INFO   Oracle|server1|snapshot  Snapshot step 2 - Determining captured tables   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:24,136 INFO   Oracle|server1|snapshot  Adding table ORCLPDB1.DEBEZIUM.CLOB_TEST to the list of capture schema tables   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:24,137 INFO   Oracle|server1|snapshot  Snapshot step 3 - Locking captured tables [ORCLPDB1.DEBEZIUM.CLOB_TEST]   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:24,142 INFO   Oracle|server1|snapshot  Snapshot step 4 - Determining snapshot offset   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:26,873 INFO   Oracle|server1|snapshot  	No in-progress transactions will be captured.   [io.debezium.connector.oracle.logminer.LogMinerAdapter]
      2022-09-22 04:31:26,874 INFO   ||  Connection gracefully closed   [io.debezium.jdbc.JdbcConnection]
      2022-09-22 04:31:26,875 INFO   Oracle|server1|snapshot  Snapshot step 5 - Reading structure of captured tables   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:26,875 INFO   Oracle|server1|snapshot  All eligible tables schema should be captured, capturing: [ORCLPDB1.DEBEZIUM.CLOB_TEST]   [io.debezium.connector.oracle.OracleSnapshotChangeEventSource]
      2022-09-22 04:31:27,272 INFO   Oracle|server1|snapshot  Snapshot step 6 - Persisting schema history   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:27,272 INFO   Oracle|server1|snapshot  Capturing structure of table ORCLPDB1.DEBEZIUM.CLOB_TEST   [io.debezium.connector.oracle.OracleSnapshotChangeEventSource]
      2022-09-22 04:31:37,704 INFO   Oracle|server1|snapshot  Already applied 1 database changes   [io.debezium.relational.history.SchemaHistoryMetrics]
      2022-09-22 04:31:37,704 INFO   Oracle|server1|snapshot  Snapshot step 7 - Snapshotting data   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:37,704 INFO   Oracle|server1|snapshot  Snapshotting contents of 1 tables while still in transaction   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:37,704 INFO   Oracle|server1|snapshot  Exporting data from table 'ORCLPDB1.DEBEZIUM.CLOB_TEST' (1 of 1 tables)   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:37,705 INFO   Oracle|server1|snapshot  	 For table 'ORCLPDB1.DEBEZIUM.CLOB_TEST' using select statement: 'SELECT "ID", "VAL_CLOB" FROM "DEBEZIUM"."CLOB_TEST" AS OF SCN 2291394'   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:37,714 INFO   Oracle|server1|snapshot  	 Finished exporting 0 records for table 'ORCLPDB1.DEBEZIUM.CLOB_TEST'; total duration '00:00:00.01'   [io.debezium.relational.RelationalSnapshotChangeEventSource]
      2022-09-22 04:31:37,715 INFO   Oracle|server1|snapshot  Snapshot - Final stage   [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource]
      2022-09-22 04:31:37,716 INFO   Oracle|server1|snapshot  Snapshot ended with SnapshotResult [status=COMPLETED, offset=OracleOffsetContext [scn=2291394, commit_scn=[]]]   [io.debezium.pipeline.ChangeEventSourceCoordinator]
      2022-09-22 04:31:37,716 INFO   Oracle|server1|streaming  Connected metrics set to 'true'   [io.debezium.pipeline.ChangeEventSourceCoordinator]
      2022-09-22 04:31:37,716 INFO   Oracle|server1|streaming  Starting streaming   [io.debezium.pipeline.ChangeEventSourceCoordinator]
      2022-09-22 04:31:38,373 INFO   OracleClobDataTypeIT||engine  1 records sent during previous 00:00:14.568, last recorded offset of {server=server1} partition is {commit_scn=2291751:1:010010008b020000, transaction_id=null, snapshot_scn=2291394, scn=2291694}   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:39,312 WARN   Oracle|server1|streaming  	LOB_ERASE for table 'ORCLPDB1.DEBEZIUM.CLOB_TEST' column 'VAL_CLOB' is not supported.   [io.debezium.connector.oracle.logminer.processor.TransactionCommitConsumer]
      2022-09-22 04:31:39,375 INFO   OracleClobDataTypeIT||engine  1 records sent during previous 00:00:01.002, last recorded offset of {server=server1} partition is {commit_scn=2291765:1:0400170076020000, transaction_id=null, snapshot_scn=2291394, scn=2291762}   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:39,459 INFO   ||  Connection gracefully closed   [io.debezium.jdbc.JdbcConnection]
      2022-09-22 04:31:39,460 INFO   OracleClobDataTypeIT||test  Stopping the connector   [io.debezium.connector.oracle.OracleClobDataTypeIT]
      2022-09-22 04:31:39,460 INFO   OracleClobDataTypeIT||test  Stopping the engine   [io.debezium.connector.oracle.OracleClobDataTypeIT]
      2022-09-22 04:31:39,460 INFO   OracleClobDataTypeIT||test  Stopping the embedded engine   [io.debezium.embedded.EmbeddedEngine]
      2022-09-22 04:31:39,460 INFO   OracleClobDataTypeIT||test  Waiting for PT20S for connector to stop   [io.debezium.embedded.EmbeddedEngine]
      2022-09-22 04:31:39,877 INFO   OracleClobDataTypeIT||engine  Stopping the task and engine   [io.debezium.embedded.EmbeddedEngine]
      2022-09-22 04:31:39,877 INFO   OracleClobDataTypeIT||engine  Stopping down connector   [io.debezium.connector.common.BaseSourceTask]
      2022-09-22 04:31:40,724 INFO   Oracle|server1|streaming  startScn=2291765, endScn=2291768   [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource]
      2022-09-22 04:31:40,725 INFO   Oracle|server1|streaming  Streaming metrics dump: OracleStreamingChangeEventSourceMetrics{currentScn=2291768, oldestScn=2291762, committedScn=2291765, offsetScn=2291762, logMinerQueryCount=2, totalProcessedRows=293, totalCapturedDmlCount=1, totalDurationOfFetchingQuery=PT0.118911377S, lastCapturedDmlCount=0, lastDurationOfFetchingQuery=PT0.051092525S, maxCapturedDmlCount=1, maxDurationOfFetchingQuery=PT0.067818852S, totalBatchProcessingDuration=PT0.205350671S, lastBatchProcessingDuration=PT0.059400601S, maxBatchProcessingThroughput=7, currentLogFileName=[/opt/oracle/oradata/ORCLCDB/redo03.log], minLogFilesMined=1, maxLogFilesMined=1, redoLogStatus=[/opt/oracle/oradata/ORCLCDB/redo03.log | CURRENT, /opt/oracle/oradata/ORCLCDB/redo01.log | INACTIVE, /opt/oracle/oradata/ORCLCDB/redo02.log | INACTIVE], switchCounter=0, batchSize=20000, millisecondToSleepBetweenMiningQuery=1400, hoursToKeepTransaction=0, networkConnectionProblemsCounter0, batchSizeDefault=20000, batchSizeMin=1000, batchSizeMax=100000, sleepTimeDefault=1000, sleepTimeMin=0, sleepTimeMax=3000, sleepTimeIncrement=200, totalParseTime=PT0.000028158S, totalStartLogMiningSessionDuration=PT0.007781952S, lastStartLogMiningSessionDuration=PT0.003031956S, maxStartLogMiningSessionDuration=PT0.004749996S, totalProcessTime=PT0.205350671S, minBatchProcessTime=PT0.059400601S, maxBatchProcessTime=PT0.14595007S, totalResultSetNextTime=PT0.065747093S, lagFromTheSource=DurationPT1.312799025S, maxLagFromTheSourceDuration=PT11.973668885S, minLagFromTheSourceDuration=PT1.024249537S, lastCommitDuration=PT0.000414513S, maxCommitDuration=PT0S, activeTransactions=0, rolledBackTransactions=33, oversizedTransactions=0, committedTransactions=99, abandonedTransactionIds={}, rolledbackTransactionIds={0500000039030000=0500000039030000, 06000e0032030000=06000e0032030000, 04000d0035030000=04000d0035030000, 08000a004c030000=08000a004c030000, 020009005b030000=020009005b030000, 0100060057030000=0100060057030000, 06001b0032030000=06001b0032030000, 0900120041030000=0900120041030000, 0a0000001b030000=0a0000001b030000, 01001a008a020000=01001a008a020000}, registeredDmlCount=3, committedDmlCount=29, errorCount=0, warningCount=0, scnFreezeCount=0, unparsableDdlCount=0, miningSessionUserGlobalAreaMemory=2133960, miningSessionUserGlobalAreaMaxMemory=3466480, miningSessionProcessGlobalAreaMemory=58540848, miningSessionProcessGlobalAreaMaxMemory=58540848}   [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource]
      2022-09-22 04:31:40,725 INFO   Oracle|server1|streaming  Offsets: OracleOffsetContext [scn=2291765, commit_scn=["2291765:1:0400170076020000"]]   [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource]
      2022-09-22 04:31:40,725 INFO   Oracle|server1|streaming  Finished streaming   [io.debezium.pipeline.ChangeEventSourceCoordinator]
      2022-09-22 04:31:40,725 INFO   Oracle|server1|streaming  Connected metrics set to 'false'   [io.debezium.pipeline.ChangeEventSourceCoordinator]
      2022-09-22 04:31:40,733 INFO   ||  Connection gracefully closed   [io.debezium.jdbc.JdbcConnection]
      2022-09-22 04:31:40,734 INFO   OracleClobDataTypeIT||engine  Connector 'io.debezium.connector.oracle.OracleConnector' completed normally.   [io.debezium.connector.oracle.OracleClobDataTypeIT]
      2022-09-22 04:31:40,734 INFO   OracleClobDataTypeIT||test  Interrupting the engine   [io.debezium.connector.oracle.OracleClobDataTypeIT]
      2022-09-22 04:31:40,735 INFO   OracleClobDataTypeIT||test  Test io.debezium.connector.oracle.OracleClobDataTypeIT#shouldNotStreamAnyChangesWhenLobEraseIsDetected failed   [io.debezium.connector.oracle.OracleClobDataTypeIT]
      

              ccranfor@redhat.com Chris Cranford
              ccranfor@redhat.com Chris Cranford
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: