Uploaded image for project: 'OpenShift Request For Enhancement'
  1. OpenShift Request For Enhancement
  2. RFE-4394

Test and document usage of pg_loader in migrating Quay db from MySQL to PostgreSQL

    XMLWordPrintable

Details

    • Feature Request
    • Resolution: Unresolved
    • Undefined
    • None
    • None
    • Quay
    • 5
    • False
    • False
    • x86_64
    • 0
    • 0% 0%

    Description

      We have a client that used pg_loader to migrate a Quay database from the MySQL engine to PostgreSQL. I tried the same procedure and have had no issues with accessing the new database, all data appears to be transferred exactly as it should be. However, the conversion did not go without warnings, it appears that the index names in MySQL are much longer than what PostgreSQL supports, so these were truncated:

      # pgloader mysql://testuser:test123@172.24.10.1/quay330 postgresql://testuser:test123@172.24.10.1/quay330_2
      2022-01-17T10:58:44.028000Z LOG pgloader version "3.6.2"
      2022-01-17T10:58:44.067000Z LOG Migrating from #<MYSQL-CONNECTION mysql://testuser@172.24.10.1:3306/quay330 {10053CE8E3}>
      2022-01-17T10:58:44.067000Z LOG Migrating into #<PGSQL-CONNECTION pgsql://testuser@172.24.10.1:5432/quay330_2 {1005523D73}>
      2022-01-17T10:58:45.747000Z WARNING PostgreSQL warning: identifier "idx_347492_apprmanifestlistmanifest_manifest_list_id_media_type_id" will be truncated to "idx_347492_apprmanifestlistmanifest_manifest_list_id_media_type"
      2022-01-17T10:58:45.806000Z WARNING PostgreSQL warning: identifier "idx_347492_apprmanifestlistmanifest_manifest_list_id_operating_system_arch" will be truncated to "idx_347492_apprmanifestlistmanifest_manifest_list_id_operating_"
      2022-01-17T10:58:46.200000Z WARNING PostgreSQL warning: identifier "idx_347780_namespacegeorestriction_namespace_id_restricted_region_iso_code" will be truncated to "idx_347780_namespacegeorestriction_namespace_id_restricted_regi"
      2022-01-17T10:58:46.262000Z WARNING PostgreSQL warning: identifier "idx_347735_manifestchild_repository_id_manifest_id_child_manifest_id" will be truncated to "idx_347735_manifestchild_repository_id_manifest_id_child_manife"
      ...
      

      I am unsure whether this poses an issue in the long term, I would imagine not, but I would still like someone to take a look at it. This will also be important for the future, since a decision was made not to support MySQL anymore .

      Attachments

        Activity

          People

            kwestpha@redhat.com Keith Westphal (Inactive)
            rhn-support-ibazulic Ivan Bazulic
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: