Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-8569

S3 storage can force path-style addressing

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 3.1.0.Alpha1
    • None
    • core-library
    • None
    • Moderate

      DBZ-8274 Azure Managed Identity support for Azure Blob Schema History by seanshi007 · Pull Request #6069 · debezium/debezium

      In the above PR, S3 sdk has been upgraded from 2.17.x to 2.18+, where S3 has a behavior change that it will build URL using virtual-hosted–style instead of path-style (Document use of disableHostPrefixInjection for 2.18.x · Issue #3524 · aws/aws-sdk-java-v2). However, the S3Mock container doesn't support virtual-hosted-style yet (Amazon S3 virtual-hosted-style buckets fail with java.net.UnknownHostException · Issue #247 · adobe/S3Mock). 

       

      The proposed fix is to add an additional configuration (forcePathStyle) for S3SchemaHistory that indicates whether to use path-style URL or not. 

       

      Note: Real S3 use case shouldn't be impacted as real S3 bucket should just support virtual-hosted-style URL, it's only the local test that doesn't support virtual-hosted-style URL. 

              Unassigned Unassigned
              seanshi007 Sean Shi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: