Uploaded image for project: 'Data Foundation Bugs'
  1. Data Foundation Bugs
  2. DFBUGS-2343

noobaa misleading message "Pinging endpoint host :localhost , port 6443 Error

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • odf-4.18.2
    • noobaa-nc
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • ?
    • ?
    • ?
    • ?
    • Hide

      Noobaa message can it be removed at the start , till the noobaa endpoint starts appropriately or after 1 min of the start of the process

      Show
      Noobaa message can it be removed at the start , till the noobaa endpoint starts appropriately or after 1 min of the start of the process
    • None

      When Noobaa process starts with the required configuration (like Endpoints etc), it was observed in the noobaa log the "Error while pinging endpoint host :localhost, port 6443 Error" at the start of the process even before the Noobaa become Active. This way when the logs are looked by Customers or by Support / Dev team, there are chances of misleading , even though it is appropriate and acceptable at that point in time. Hence request is, can we not do the check until the noobaa process is started appropriately say a minute after start (given there could be many ENDPOINT_FORKS, once they are all started listening on the port 6443 for example) ..

      noobaa.log

      Apr 22 00:18:20 node-gui0 node[698936]: [noobaa-cli/698936]   [LOG] CONSOLE:: init_rand_seed: seeding with 32 bytes
      Apr 22 00:18:20 node-gui0 node[698936]: [noobaa-cli/698936]   [LOG] CONSOLE:: Error while pinging endpoint host :localhost, port 6443 Error: Noobaa endpoi
      nt is not running, all the retries failed    at func (/usr/local/noobaa-core/src/manage_nsfs/health.js:191:31)    at process.processTicksAndRejections (node:i
      nternal/process/task_queues:105:5)    at async Object.retry (/usr/local/noobaa-core/src/util/promise.js:184:25)    at async NSFSHealth.get_endpoint_response (
      /usr/local/noobaa-core/src/manage_nsfs/health.js:185:13)    at async NSFSHealth.nc_nsfs_health (/usr/local/noobaa-core/src/manage_nsfs/health.js:127:30)    at
       async Object.get_health_status (/usr/local/noobaa-core/src/manage_nsfs/health.js:669:35)    at async Object.manage_diagnose_operations (/usr/local/noobaa-cor
      e/src/manage_nsfs/diagnose.js:24:13)    at async main (/usr/local/noobaa-core/src/cmd/manage_nsfs.js:84:13)
      Apr 22 00:18:20 node-gui0 node[698936]: [noobaa-cli/698936]    [L0] core.sdk.config_fs:: config_fs.compare_host_and_config_dir_version: ver_comparison 0 running_code_config_dir_version 1.0.0 system_config_dir_version 1.0.0
      Apr 22 00:18:20 node-gui0 node[698936]: [noobaa-cli/698936]    [L0] core.sdk.config_fs:: config_fs.compare_host_and_config_dir_version: ver_comparison 0 running_code_config_dir_version 1.0.0 system_config_dir_version 1.0.0
      Apr 22 00:18:20 node-gui0 node[698878]: 2025-04-22 00:18:20.975553 [PID-698878/TID-698878] FS::GPFS gpfs_ganesha_noobaa_arg=args.noobaa_version=0 args.noobaa_delay=1000 args.noobaa_flags=0
      Apr 22 00:18:20 node-gui0 node[698878]: [nsfs/698878]    [L0] core.upgrade.upgrade_utils:: the versions of the new_version and the current_version match. no need to upgrade
      Apr 22 00:18:21 node-gui0 node[698878]: [nsfs/698878]    [L0] core.endpoint.endpoint:: endpoint: replacing old umask:  22 with new umask:  0
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]  [WARN] CONSOLE:: WORKER started { id: 1, pid: 698999 }
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]  [WARN] CONSOLE:: WORKER started { id: 2, pid: 699000 }
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]    [L0] core.util.fork_utils:: Starting metrics server 7004
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]    [L0] core.util.http_utils:: Starting METRICS server on HTTP port 7004
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]    [L0] core.util.http_utils:: Started METRICS HTTP server successfully
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]   [LOG] CONSOLE:: init_rand_seed: seeding with 32 bytes
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]    [L0] core.util.ssl_utils:: SSL certificate not found in dir /ibm/fvt_ces_root/ces/s3-config/certificates/ for service METRICS
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]  [WARN] core.util.ssl_utils:: Generating self-signed SSL certificate for METRICS
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]   [LOG] CONSOLE:: detect_fips_mode: found /proc/sys/crypto/fips_enabled with value 0
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]  [WARN] core.util.ssl_utils:: Certificate folder  /ibm/fvt_ces_root/ces/s3-config/certificates/  does not exist. New certificate won't be loaded.
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]    [L0] core.util.http_utils:: Starting METRICS server on HTTPS port 9443
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]    [L0] core.util.http_utils:: Started METRICS HTTPS server successfully
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]    [L0] core.util.fork_utils:: Started metrics server successfully
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]   [LOG] CONSOLE:: nsfs: listening on 'https://localhost:6443'
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]   [LOG] CONSOLE:: generate_entropy: entropy_avail 256

      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]   [LOG] CONSOLE:: generate_entropy: adding entropy: dd if=/dev/sda bs=1048576 count=32 skip=55711 | md5sum
      Apr 22 00:18:21 node-gui0 [698878]: [nsfs/698878]   [LOG] CONSOLE:: init_rand_seed: done
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]   [LOG] CONSOLE:: read_rand_seed: reading 32 bytes from /dev/urandom ...
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]   [LOG] CONSOLE:: read_rand_seed: got 32 bytes from /dev/urandom, total 32 ...
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]   [LOG] CONSOLE:: read_rand_seed: closing fd ...
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]   [LOG] CONSOLE:: init_rand_seed: seeding with 32 bytes
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]   [LOG] CONSOLE:: Error while pinging endpoint host :localhost, port 6443 Error: Noobaa endpoint is not running, all the retries failed    at func (/usr/local/noobaa-core/src/manage_nsfs/health.js:191:31)    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)    at async Object.retry (/usr/local/noobaa-core/src/util/promise.js:184:25)    at async NSFSHealth.get_endpoint_response (/usr

      /local/noobaa-core/src/manage_nsfs/health.js:185:13)    at async NSFSHealth.nc_nsfs_health (/usr/local/noobaa-core/src/manage_nsfs/health.js:127:30)    at async Object.get_health_status (/usr/local/noobaa-core/src/manage_nsfs/health.js:669:35)    at async Object.manage_diagnose_operations (/usr/local/noobaa-core/src/manage_nsfs/diagnose.js:24:13)    at async main (/usr/local/noobaa-core/src/cmd/manage_nsfs.js:84:13)
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]    [L0] core.sdk.config_fs:: config_fs.compare_host_and_config_dir_version: ver_comparison 0 running_code_config_dir_version 1.0.0 system_config_dir_version 1.0.0
      Apr 22 00:18:21 node-gui0 node[698992]: [noobaa-cli/698992]    [L0] core.sdk.config_fs:: config_fs.compare_host_and_config_dir_version: ver_comparison 0 running_code_config_dir_version 1.0.0 system_config_dir_version 1.0.0
      Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]   [LOG] CONSOLE:: detect_fips_mode: found /proc/sys/crypto/fips_enabled with value 0
      Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]   [LOG] CONSOLE:: read_rand_seed: reading 32 bytes from /dev/urandom ...
      Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]   [LOG] CONSOLE:: read_rand_seed: got 32 bytes from /dev/urandom, total 32 ...
      Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]   [LOG] CONSOLE:: read_rand_seed: closing fd ...
      Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]   [LOG] CONSOLE:: init_rand_seed: seeding with 32 bytes
      Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]   [LOG] CONSOLE:: Error while pinging endpoint host :localhost, port 6443 Error: Noobaa endpoint is not running, all the retries failed    at func (/usr/local/noobaa-core/src/manage_nsfs/health.js:191:31)    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)    at async Object.retry (/usr/local/noobaa-core/src/util/promise.js:184:25)    at async NSFSHealth.get_endpoint_response (/usr/local/noobaa-core/src/manage_nsfs/health.js:185:13)    at async NSFSHealth.nc_nsfs_health (/usr/local/noobaa-core/src/manage_nsfs/health.js:127:30)    at async Object.get_health_status (/usr/local/noobaa-core/src/manage_nsfs/health.js:669:35)    at async Object.manage_diagnose_operations (/usr/local/noobaa-core/src/manage_nsfs/diagnose.js:24:13)    at async main (/usr/local/noobaa-core/src/cmd/manage_nsfs.js:84:13)
      Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]    [L0] core.sdk.config_fs:: config_fs.compare_host_and_config_dir_version: ver_comparison 0 running_code_config_dir_version 1.0.0 system_config_dir_version 1.0.0

      Apr 22 00:18:23 node-gui0 node[698999]: [nsfs/698999]    [L0] core.upgrade.upgrade_utils:: the versions of the new_version and the current_version match. no need to upgrade
      Apr 22 00:18:23 node-gui0 node[698999]: [nsfs/698999]    [L0] core.endpoint.endpoint:: endpoint: replacing old umask:  0 with new umask:  0
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]    [L0] core.endpoint.endpoint:: Configured Virtual Hosts: []
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]    [L0] core.endpoint.endpoint:: Configured Location Info: { region: '' }
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]  [WARN] core.endpoint.endpoint:: HTTP is not allowed for NC NSFS.
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]   [LOG] CONSOLE:: init_rand_seed: seeding with 32 bytes
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]    [L0] core.util.ssl_utils:: SSL certificate not found in dir /ibm/fvt_ces_root/ces/s3-config/certificates/ for service S3
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]  [WARN] core.util.ssl_utils:: Generating self-signed SSL certificate for S3
      Apr 22 00:18:23 node-gui0 node[699000]: [nsfs/699000]    [L0] core.upgrade.upgrade_utils:: the versions of the new_version and the current_version match. no need to upgrade
      Apr 22 00:18:23 node-gui0 node[699000]: [nsfs/699000]    [L0] core.endpoint.endpoint:: endpoint: replacing old umask:  0 with new umask:  0
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]    [L0] core.endpoint.endpoint:: Configured Virtual Hosts: []
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]    [L0] core.endpoint.endpoint:: Configured Location Info: { region: '' }
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]  [WARN] core.endpoint.endpoint:: HTTP is not allowed for NC NSFS.
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]   [LOG] CONSOLE:: init_rand_seed: seeding with 32 bytes
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]  [WARN] core.util.ssl_utils:: Generating self-signed SSL certificate for S3
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]  [WARN] core.util.ssl_utils:: Certificate folder  /ibm/fvt_ces_root/ces/s3-config/certificates/  does not exist. New certificate won't be loaded.
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]  [WARN] core.util.ssl_utils:: Certificate folder  /ibm/fvt_ces_root/ces/s3-config/certificates/  does not exist. New certificate won't be loaded.
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]    [L0] core.util.http_utils:: Starting S3 server on HTTPS port 6443
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]   [LOG] CONSOLE:: generate_entropy: entropy_avail 256
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]    [L0] core.util.http_utils:: Started S3 HTTPS server successfully
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]    [L0] core.util.background_scheduler:: Registering semaphore_monitor bg worker
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]   [LOG] core.util.background_scheduler:: run_background_worker: INIT semaphore_monitor
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]    [L0] core.util.http_utils:: Starting S3 server on HTTPS port 6443
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]    [L0] core.endpoint.endpoint:: Endpoint monitor started
      Apr 22 00:18:23 node-gui0 [699000]: [nsfs/699000]   [LOG] CONSOLE:: nsfs: listening on 'https://localhost:6443'
      Apr 22 00:18:23 node-gui0 [698999]: [nsfs/698999]    [L0] core.util.http_utils:: Started S3 HTTPS server successfully

      am referring to the
      "Apr 22 00:18:22 node-gui0 node[699072]: [noobaa-cli/699072]   [LOG] CONSOLE:: Error while pinging endpoint host :localhost, port 6443 Error: Noobaa endpoint"

      Can these be avoided in the start and then print if still noobaa process is not started ?
      Any thoughts

      Description of problem - Provide a detailed description of the issue encountered, including logs/command-output snippets and screenshots if the issue is observed in the UI:

       

      The OCP platform infrastructure and deployment type (AWS, Bare Metal, VMware, etc. Please clarify if it is platform agnostic deployment), (IPI/UPI):

       

      The ODF deployment type (Internal, External, Internal-Attached (LSO), Multicluster, DR, Provider, etc):

       

       

      The version of all relevant components (OCP, ODF, RHCS, ACM whichever is applicable):

       

       

      Does this issue impact your ability to continue to work with the product?

       

       

      Is there any workaround available to the best of your knowledge?

       

       

      Can this issue be reproduced? If so, please provide the hit rate

       

       

      Can this issue be reproduced from the UI?

       

      If this is a regression, please provide more details to justify this:

       

      Steps to Reproduce:

      1. Start the noobaa service

      2.

      3.

       

      The exact date and time when the issue was observed, including timezone details:

       

      Actual results:

       

       

      Expected results:

       

      Logs collected and log location:

       

      Additional info:

       
       

              rayalon@redhat.com Rom Ayalon (Inactive)
              rkomandu@in.ibm.com Ravi Kumar Komanduri (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

                Created:
                Updated:
                Resolved: