Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-5468

Quay 3.9.0 APP POD was crashed after configuring Splunk as LOGS_MODEL

XMLWordPrintable

    • False
    • None
    • False
    • 0

      Description:

      This is an issue of Quay 3.9.0, after configuring Splunk as Logs Model, after Quay Operator reconcile the change, new Quay APP POD was crashed, checked Quay APP Pod logs, get "xml.etree.ElementTree.ParseError: syntax error: line 1, column 0",pls review this issue.

      Quay ENV: quay-operator-bundle-container-v3.9.0-71

      Splunk ENV: http://18.222.194.73:8000/en-US/app/launcher/home#(admin:password)

      Quay Config:

      BROWSER_API_CALLS_XHR_ONLY: false
      CREATE_REPOSITORY_ON_PUSH_PUBLIC: true
      FEATURE_EXTENDED_REPOSITORY_NAMES: true
      CREATE_PRIVATE_REPO_ON_PUSH: true
      CREATE_NAMESPACE_ON_PUSH: true
      FEATURE_QUOTA_MANAGEMENT: true
      FEATURE_PROXY_CACHE: true
      FEATURE_USER_INITIALIZE: true
      FEATURE_GENERAL_OCI_SUPPORT: true
      FEATURE_HELM_OCI_SUPPORT: true
      FEATURE_PROXY_STORAGE: true
      SUPER_USERS:
        - quay
        - admin
      DISTRIBUTED_STORAGE_DEFAULT_LOCATIONS:
        - default
      DISTRIBUTED_STORAGE_PREFERENCE:
        - default
      DISTRIBUTED_STORAGE_CONFIG:
        default:
          - S3Storage
          - s3_bucket: quayaws720
            storage_path: /datafile
            s3_access_key: ******
            s3_secret_key: ******
            host: s3.us-east-2.amazonaws.com
      USERFILES_LOCATION: default
      USERFILES_PATH: userfiles/
      LOGS_MODEL: splunk
      LOGS_MODEL_CONFIG:
        producer: splunk
        splunk_config:
          host: ec2-18-222-194-73.us-east-2.compute.amazonaws.com     
          port: 8000
          bearer_token: 'eyJraWQiOiJzcGx1bmsuc2VjcmV0IiwiYWxnIjoiSFM1MTIiLCJ2ZXIiOiJ2MiIsInR0eXAiOiJzdGF0aWMifQ.eyJpc3MiOiJhZG1pbiBmcm9tIDE0NzBkNTlhODgyNiIsInN1YiI6ImFkbWluIiwiYXVkIjoidGVzdCIsImlkcCI6IlNwbHVuayIsImp0aSI6IjdjN2M1NmI2NTc1OGQ3NGQ5NmVkMDgwZmM4ZTk2YmViZGU5ODUxNzA4ODA2NmEyMzVkZTRlZTEzM2NhMzIwZWIiLCJpYXQiOjE2ODM2MDUxNTksImV4cCI6MTY4NjE5NzE1OSwibmJyIjoxNjgzNjA1MTU5fQ.QWgmQ1yRgvgFjNaRIyPyzGQmXBXANHTjfmiKmAL7J58GHYfZ8Ih7gGFU_u_j-SdiJEpReqrJf3x8-GDcCL8VNw'
          url_scheme: http
          verify_ssl: False
          index_prefix: Splunk_quay 

      Quay Logs:

      oc get pod
      NAME                                              READY   STATUS             RESTARTS         AGE
      quay-operator.v3.9.0-574f78b5bd-m2qbx             1/1     Running            0                10m
      quayregistry-clair-app-6f7dcdbd57-28trt           1/1     Running            0                6h7m
      quayregistry-clair-app-6f7dcdbd57-6pdkc           1/1     Running            0                5h38m
      quayregistry-clair-postgres-56b4c486cc-w47m7      1/1     Running            1 (6h6m ago)     6h7m
      quayregistry-quay-app-5bbc94744b-v227p            0/1     CrashLoopBackOff   6 (4m38s ago)    10m
      quayregistry-quay-app-cf5c6b99d-2p9c4             1/1     Running            0                6h5m
      quayregistry-quay-app-cf5c6b99d-khp7j             1/1     Running            0                5h38m
      quayregistry-quay-app-upgrade-d6kf2               0/1     Completed          0                6h7m
      quayregistry-quay-config-editor-c6b965c5d-5tcvv   0/1     CrashLoopBackOff   6 (4m54s ago)    10m
      quayregistry-quay-database-5b77b4c786-dls9d       1/1     Running            0                6h7m
      quayregistry-quay-mirror-655d89f9b-m4824          0/1     CrashLoopBackOff   39 (4m48s ago)   3h1m
      quayregistry-quay-mirror-655d89f9b-tmc2r          0/1     CrashLoopBackOff   39 (3m56s ago)   3h1m
      quayregistry-quay-redis-f8f8d87c5-lmpr4           1/1     Running            0                6h7m 
      
      
      
      oc logs quayregistry-quay-app-5bbc94744b-v227p
         __   __
        /  \ /  \     ______   _    _     __   __   __
       / /\ / /\ \   /  __  \ | |  | |   /  \  \ \ / /
      / /  / /  \ \  | |  | | | |  | |  / /\ \  \   /
      \ \  \ \  / /  | |__| | | |__| | / ____ \  | |
       \ \/ \ \/ /   \_  ___/  \____/ /_/    \_\ |_|
        \__/ \__/      \ \__
                        \___\ by Red Hat
       Build, Store, and Distribute your Containers
      
      
      Startup timestamp: 
      Tue May  9 07:07:46 UTC 2023
      
      
      Running all default registry services without migration
      Running init script '/quay-registry/conf/init/certs_install.sh'
      Installing extra certificates found in /quay-registry/conf/stack/extra_ca_certs directory
      Running init script '/quay-registry/conf/init/copy_config_files.sh'
      Running init script '/quay-registry/conf/init/d_validate_config_bundle.sh'
      Validating Configuration
      plpgsql
      pg_trgm
      +------------------------+-------+--------+
      |      Field Group       | Error | Status |
      +------------------------+-------+--------+
      | AccessSettings         | -     | 🟢     |
      +------------------------+-------+--------+
      | ActionLogArchiving     | -     | 🟢     |
      +------------------------+-------+--------+
      | AppTokenAuthentication | -     | 🟢     |
      +------------------------+-------+--------+
      | BitbucketBuildTrigger  | -     | 🟢     |
      +------------------------+-------+--------+
      | BuildManager           | -     | 🟢     |
      +------------------------+-------+--------+
      | Database               | -     | 🟢     |
      +------------------------+-------+--------+
      | DistributedStorage     | -     | 🟢     |
      +------------------------+-------+--------+
      | ElasticSearch          | -     | 🟢     |
      +------------------------+-------+--------+
      | Email                  | -     | 🟢     |
      +------------------------+-------+--------+
      | GitHubBuildTrigger     | -     | 🟢     |
      +------------------------+-------+--------+
      | GitHubLogin            | -     | 🟢     |
      +------------------------+-------+--------+
      | GitLabBuildTrigger     | -     | 🟢     |
      +------------------------+-------+--------+
      | GoogleLogin            | -     | 🟢     |
      +------------------------+-------+--------+
      | HostSettings           | -     | 🟢     |
      +------------------------+-------+--------+
      | JWTAuthentication      | -     | 🟢     |
      +------------------------+-------+--------+
      | LDAP                   | -     | 🟢     |
      +------------------------+-------+--------+
      | OIDC                   | -     | 🟢     |
      +------------------------+-------+--------+
      | QuayDocumentation      | -     | 🟢     |
      +------------------------+-------+--------+
      | Redis                  | -     | 🟢     |
      +------------------------+-------+--------+
      | RepoMirror             | -     | 🟢     |
      +------------------------+-------+--------+
      | SecurityScanner        | -     | 🟢     |
      +------------------------+-------+--------+
      | TeamSyncing            | -     | 🟢     |
      +------------------------+-------+--------+
      | TimeMachine            | -     | 🟢     |
      +------------------------+-------+--------+
      | UserVisibleSettings    | -     | 🟢     |
      +------------------------+-------+--------+
      Running init script '/quay-registry/conf/init/nginx_conf_create.sh'
      Running init script '/quay-registry/conf/init/supervisord_conf_create.sh'
      Running init script '/quay-registry/conf/init/zz_boot.sh'
      Traceback (most recent call last):
        File "/quay-registry/./boot.py", line 15, in <module>
          from app import app
        File "/quay-registry/app.py", line 336, in <module>
          logs_model.configure(app.config)
        File "/quay-registry/data/logs_model/__init__.py", line 67, in configure
          logs_model.initialize(_LOG_MODELS[model_name](**model_config))
        File "/quay-registry/data/logs_model/splunk_logs_model.py", line 26, in __init__
          self._logs_producer.initialize(SplunkLogsProducer(**splunk_config))
        File "/quay-registry/data/logs_model/logs_producer/splunk_logs_producer.py", line 34, in __init__
          self.index = service.indexes[index_prefix]
        File "/usr/local/lib/python3.9/site-packages/splunklib/client.py", line 1377, in __getitem__
          entries = self._load_list(response)
        File "/usr/local/lib/python3.9/site-packages/splunklib/client.py", line 1481, in _load_list
          entries = _load_atom_entries(response)
        File "/usr/local/lib/python3.9/site-packages/splunklib/client.py", line 212, in _load_atom_entries
          r = _load_atom(response)
        File "/usr/local/lib/python3.9/site-packages/splunklib/client.py", line 206, in _load_atom
          return data.load(response.body.read()
        File "/usr/local/lib/python3.9/site-packages/splunklib/data.py", line 85, in load
          root = XML(text)
        File "/usr/lib64/python3.9/xml/etree/ElementTree.py", line 1344, in XML
          parser.feed(text)
      xml.etree.ElementTree.ParseError: syntax error: line 1, column 0     

            hgovinda Harish Govindarajulu
            lzha1981 luffy zhang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: