Uploaded image for project: 'Subscription Watch'
  1. Subscription Watch
  2. SWATCH-4100

Document Snowpipe requirements for Replacement of Fivetran

XMLWordPrintable

    • Icon: Spike Spike
    • Resolution: Unresolved
    • Icon: Critical Critical
    • None
    • None
    • dataverse
    • 5
    • False
    • Hide

      None

      Show
      None
    • False
    • subs-swatch-thunder

      Snowpipe is a newly available tool that can be used as an alternative for moving S3 data into snowflake. Snowpipe is likely going to cost less and give us more control over the import process of the files then fivetran does.

      This spike is to review the snowpipe documentation and document how we can use it to move swatch data into snowflake

      https://dataverse.pages.redhat.com/data-docs/platform-teams/snowflake/snowpipe/snowpipe/

       

      Contacts on that may be able to help with SnowPipe:

      • Mark Hawkins
      • Michael Sanborn
      • Martin Bacovsky

      Acceptance Criteria:
      The following is documented in inscope:

      • Is snowpipe a viable option for us?
      • What is required for us to get it to work
      • Pros and cons of using snowpipe

              Unassigned Unassigned
              kflahert@redhat.com Kevin Flaherty
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: