-
Bug
-
Resolution: Unresolved
-
Critical
-
odf-4.18
Description of problem - Provide a detailed description of the issue encountered, including logs/command-output snippets and screenshots if the issue is observed in the UI:
-------------------------------------------------------------
Listing buckets via the MCG CLI (aliased here as mcg-cli, but can been found as nb as well in doctumentation and examples) fails on ODF 4.18:
$ mcg-cli bucket list INFO[0002] ✅ Exists: NooBaa "noobaa" INFO[0002] ✅ Exists: Service "noobaa-mgmt" INFO[0002] ✅ Exists: Secret "noobaa-operator" INFO[0002] ✅ Exists: Secret "noobaa-admin" INFO[0003] ✈️ RPC: bucket.list_buckets() Request: <nil> WARN[0003] RPC: GetConnection creating connection to wss://localhost:60144/rpc/ 0xc000f99f20 INFO[0003] RPC: Connecting websocket (0xc000f99f20) &{RPC:0xc0007ed3b0 Address:wss://localhost:60144/rpc/ State:init WS:<nil> PendingRequests:map[] NextRequestID:0 Lock:{state:1 sema:0} ReconnectDelay:0s cancelPings:<nil>} INFO[0003] RPC: Connected websocket (0xc000f99f20) &{RPC:0xc0007ed3b0 Address:wss://localhost:60144/rpc/ State:init WS:<nil> PendingRequests:map[] NextRequestID:0 Lock:{state:1 sema:0} ReconnectDelay:0s cancelPings:<nil>} ERRO[0004] ⚠️ RPC: bucket.list_buckets() Response Error: Code=INVALID_SCHEMA_PARAMS Message=INVALID_SCHEMA_PARAMS SERVER bucket_api#/methods/list_buckets FATA[0004] INVALID_SCHEMA_PARAMS SERVER bucket_api#/methods/list_buckets
With the the following errors in the noobaa-core logs:
Nov-11 10:41:08.951 [WebServer/29] [ERROR] core.rpc.rpc_schema:: INVALID_SCHEMA_PARAMS SERVER bucket_api#/methods/list_buckets ERRORS: [ { instancePath: '', schemaPath: '#/type', keyword: 'type', params: { type: 'object' }, message: 'must be object', schema: 'object', parentSchema: { type: 'object', properties: { continuation_token: { '$ref': 'common_api#/definitions/continuation_token' }, max_buckets: { type: 'integer', minimum: 1, maximum: 1000 } }, additionalProperties: false }, data: undefined }, [length]: 1 ] PARAMS: undefined Nov-11 10:41:08.952 [WebServer/29] [ERROR] CONSOLE:: RPC._on_request: ERROR srv bucket_api.list_buckets reqid wss://localhost:58684/rpc/-0 connid ws://[::1]:51788/(27p3qe3he) Error: INVALID_SCHEMA_PARAMS SERVER bucket_api#/methods/list_buckets at method_api.validate_params (/root/node_modules/noobaa-core/src/rpc/rpc_schema.js:119:31) at RPC._on_request (/root/node_modules/noobaa-core/src/rpc/rpc.js:315:32) at /root/node_modules/noobaa-core/src/rpc/rpc.js:734:38 at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
The OCP platform infrastructure and deployment type (AWS, Bare Metal, VMware, etc. Please clarify if it is platform agnostic deployment), (IPI/UPI):
-------------------------------------------------------------
IBM Cloud, but most likely platform agnostic
The ODF deployment type (Internal, External, Internal-Attached (LSO), Multicluster, DR, Provider, etc):
-------------------------------------------------------------
Internal
The version of all relevant components (OCP, ODF, RHCS, ACM whichever is applicable):
-------------------------------------------------------------
OCP: 4.18.0-0.nightly-2024-11-10-133523
ODF: 4.18.0-48
noobaa core: 5.18.0-fc266c3
noobaa operator: 5.18.0-1fc5447dccb45522e128e3db057527a9408dd9e5
mcg-cli: 5.18.0
Does this issue impact your ability to continue to work with the product?
-------------------------------------------------------------
It might break existing automation
Is there any workaround available to the best of your knowledge?
-------------------------------------------------------------
Yes - listing the buckets via S3 still works
Can this issue be reproduced? If so, please provide the hit rate
-------------------------------------------------------------
Yes - reproduced on three 4.18 clusters thus far
Can this issue be reproduced from the UI?
-------------------------------------------------------------
N/A
If this is a regression, please provide more details to justify this:
-------------------------------------------------------------
Yes - the mcg-cli command works when ran against a 4.17 cluster, even when using the mcg-cli binary from 4.18.
Steps to Reproduce:
1. Download the MCG CLI via `oc extract`:
$ oc image extract --registry-config $MY_PULL_SECRET_PATH quay.io/rhceph-dev/mcg-cli:4.18.0-47 --confirm --path /usr/share/mcg/macosx/noobaa:$MY_LOCAL_MCG_CLI_DIR $ chmod +x $MY_LOCAL_MCG_CLI_DIR/noobaa $ mv $MY_LOCAL_MCG_CLI_DIR/noobaa $MY_LOCAL_MCG_CLI_DIR/mcg-cli
2. Attempt to list the buckets via the MCG CLI:
$ mcg-cli bucket list
The exact date and time when the issue was observed, including timezone details:
-------------------------------------------------------------
11/11/24, 10:00 UTC
Actual results:
-------------------------------------------------------------
The buckets were not listed due to an INVALID_SCHEMA_PARAMS error
Expected results:
-------------------------------------------------------------
The list of the buckets on the system, including at least first.bucket on a fresh installation
Logs collected and log location:
-------------------------------------------------------------
must-gather logs: https://drive.google.com/drive/folders/1VgM0RmWn9jybFnkj06XoahtEcqKRC4g-?usp=drive_link
Additional info:
-------------------------------------------------------------
- Note that I was using the MacOS binary of the MCG CLI
- Setting the Severity to Critical since this is a regression
- links to
-
RHBA-2024:138027 Red Hat OpenShift Data Foundation 4.18 security, enhancement & bug fix update