Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-1658

Quay APP POD was failed to start after configure to use external mysql database with SSL

XMLWordPrintable

      Description:

      This is an issue found when configure quay to use AWS RDS mysql database with only support SSL, initially with Quay Operator to deploy quay with managed database, then use quay config editor to config Mysql database, upload AWS RDS Mysql SSL Cert, trigger quay redeployment, Quay APP POD was failed to start with error message "Could not connect to database. Error: Could not find database.pem in config bundle", see Quay APP POD logs attached.

      Index Image:

      Index image v4.7: brew.registry.redhat.io/rh-osbs/iib-pub-pending:v4.7

      Quay Image:

      oc get pod
      NAME                                         READY   STATUS             RESTARTS   AGE
      quayaws-clair-app-95b7975dc-4mqf4            1/1     Running            1          47m
      quayaws-clair-postgres-78bfccb8b-9ljt8       1/1     Running            0          47m
      quayaws-quay-app-6866bd4dcc-5wq28            1/1     Running            2          4h23m
      quayaws-quay-app-6976fd58f5-qtmv5            0/1     Error              14         47m
      quayaws-quay-config-editor-5f5c7d6ff-72zqs   1/1     Running            0          47m
      quayaws-quay-database-7f7cf67db9-s4zxn       1/1     Running            0          4h23m
      quayaws-quay-mirror-7c7fc57c88-czxcl         0/1     CrashLoopBackOff   13         47m
      quayaws-quay-postgres-init-n9xsx             0/1     Completed          0          4h23m
      quayaws-quay-redis-cdd8566c6-pj6ds           1/1     Running            0          47m
      
      oc get pod quayaws-quay-app-6976fd58f5-qtmv5 -o json | jq '.spec.containers[0].image'
      "registry.redhat.io/quay/quay-rhel8@sha256:7bb8b18eab97d2ca2814322cb63b7c45b810ccbd0a2d03424cc06a6d7bc463ba"
      
      
      

      Quay Operator Image:

      oc get pod quay-operator.v3.4.2-78bc4fdf76-8v778 -n openshift-operators -o json | jq '.spec.containers[0].image'
      "registry.redhat.io/quay/quay-operator-rhel8@sha256:bf29ea38bd88f48377b91d6d56d0db7695ecbf4a954cdb544c525c50ad8ed382"
      

      Configure Quay to use AWS RDS Mysql Database with SSL Cert:

      Quay config editor

      Steps:

      1. Deploy Quay 3.4.2 with V3.4.2 TNG Operator on AWS using AWS S3 object Storage
      2. Open Quay config editor and click "Edit Fields" in Database section
      3. Input valid AWS RDS Mysql configurations, and upload AWS RDS SSL Cert
      4. Click "Validate Configurations Change"
      5. Click "Reconfigure Quay"
      6. Check new Quay APP POD status

      Expected Results:

      New Quay APP POD come to ready status.

      Actual Results:

      New Quay APP POD was failed to start with error message "Could not connect to database. Error: Could not find database.pem in config bundle

      "

        1. image-2021-03-03-16-15-27-718.png
          298 kB
          luffy zhang
        2. Quay_342_APP_POD.logs
          8 kB
          luffy zhang

              jonathankingfc Jonathan King
              lzha1981 luffy zhang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: