Uploaded image for project: 'FlightPath'
  1. FlightPath
  2. FLPATH-1094

[M2K] If workflow fails to clone the repo in start planning phase, workflow continues running instead of failing with error

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False

      Description of the problem: If there is an error with cloning the desired repo, the workflow continues running for a long time instead of failing with an error. 

      How reproducible: 

      Steps to reproduce:

      1. Deploy orchestrator with Helm chart 0.1.31 and Workflows with 0.2.26

      2. Add ssh key to desired repo 

      3. Deploy m2k with relevant parameters.

      Actual results: If the workflow fails to clone the repo for some reason, the workflow continue running in active state instead of failing with an error.

      Expected results: Workflow will immediately fail if the repo can't be cloned.

      M2K pod logs:

      ime="2024-03-07T21:02:31Z" level=info msg="Planning started for the project with id 124343f5-a26d-477d-ae5c-8823e75d7721"
      time="2024-03-07T21:02:31Z" level=info msg="Starting plan at directory /tmp/plan-124343f5-a26d-477d-ae5c-8823e75d7721-3512543554 using configs [] and source git+ssh://github.com/test-workflows/application-onboarding@main and customizations  to output /tmp/plan-124343f5-a26d-477d-ae5c-8823e75d7721-3512543554"
      time="2024-03-07T21:02:31Z" level=info msg="plan cmdArgs: [plan --name project1 --plan-progress-port 35609 --log-file m2kcli.log --source git+ssh://github.com/test-workflows/application-onboarding@main --disable-local-execution]"
      time="2024-03-07T21:02:31Z" level=info msg="Project: 124343f5-a26d-477d-ae5c-8823e75d7721; level=info msg=\"Cloning the repository using git into '/tmp/move2kube147904727/m2ksources' . This might take some time.\""
      time="2024-03-07T21:02:31Z" level=info msg="Project: 124343f5-a26d-477d-ae5c-8823e75d7721; level=fatal msg=\"failed to create the plan. Error: \\\"failed to clone the repo 'git+ssh://github.com/test-workflows/application-onboarding@main'. Error: failed to clone using vcs url 'git+ssh://github.com/test-workflows/application-onboarding@main' and clone options {CommitDepth:1 Overwrite:true MaxSize:-1 CloneDestinationPath:/tmp/move2kube147904727/m2ksources}. Error: failed to perform clone operation using git. Error: repository already exists\\\"\""
      time="2024-03-07T21:02:31Z" level=error msg="failed to update the database after planning finished. Error: \"failed to copy the plan file from /tmp/plan-124343f5-a26d-477d-ae5c-8823e75d7721-3512543554/m2k.plan to /move2kube-api/data/projects/124343f5-a26d-477d-ae5c-8823e75d7721/inputs/expanded/m2k.plan after planning finished. Error: \\\"failed to open the source file at path \\\\\\\"/tmp/plan-124343f5-a26d-477d-ae5c-8823e75d7721-3512543554/m2k.plan\\\\\\\" Error: \\\\\\\"open /tmp/plan-124343f5-a26d-477d-ae5c-8823e75d7721-3512543554/m2k.plan: no such file or directory\\\\\\\"\\\"\""
      time="2024-03-07T21:02:33Z" level=info msg="GET /api/v1/workspaces/99f5f7ec-6bc5-4915-80d1-dbe39021b487/projects/124343f5-a26d-477d-ae5c-8823e75d7721/plan" request-id=77d8dd4d-2677-4cf6-9b98-162daaef481b
      time="2024-03-07T21:02:33Z" level=error msg="failed to send a GET request to get the plan progress from the server at http://localhost:35609/progress . Error: \"Get \\\"http://localhost:35609/progress\\\": dial tcp [::1]:35609: connect: connection refused\""
      time="2024-03-07T21:02:35Z" level=info msg="GET /api/v1/workspaces/99f5f7ec-6bc5-4915-80d1-dbe39021b487/projects/124343f5-a26d-477d-ae5c-8823e75d7721/plan" request-id=a0676461-78f1-4e87-9fba-792165ed8cc7
      time="2024-03-07T21:02:35Z" level=error msg="failed to send a GET request to get the plan progress from the server at http://localhost:35609/progress . Error: \"Get \\\"http://localhost:35609/progress\\\": dial tcp [::1]:35609: connect: connection refused\""
      time="2024-03-07T21:02:37Z" level=info msg="GET /api/v1/workspaces/99f5f7ec-6bc5-4915-80d1-dbe39021b487/projects/124343f5-a26d-477d-ae5c-8823e75d7721/plan" request-id=065f33be-a8b9-4dc7-b309-31d28348bb62
      time="2024-03-07T21:02:37Z" level=error msg="failed to send a GET request to get the plan progress from the server at http://localhost:35609/progress . Error: \"Get \\\"http://localhost:35609/progress\\\": dial tcp [::1]:35609: connect: connection refused\""
      time="2024-03-07T21:02:39Z" level=info msg="GET /api/v1/workspaces/99f5f7ec-6bc5-4915-80d1-dbe39021b487/projects/124343f5-a26d-477d-ae5c-8823e75d7721/plan" request-id=d807a42b-d370-4496-8287-854858fcce04
      time="2024-03-07T21:02:39Z" level=error msg="failed to send a GET request to get the plan progress from the server at http://localhost:35609/progress . Error: \"Get \\\"http://localhost:35609/progress\\\": dial tcp [::1]:35609: connect: connection refused\""
      time="2024-03-07T21:02:41Z" level=info msg="GET /api/v1/workspaces/99f5f7ec-6bc5-4915-80d1-dbe39021b487/projects/124343f5-a26d-477d-ae5c-8823e75d7721/plan" request-id=9fa99fe3-0858-4360-a5ac-532c2557a1a9
      time="2024-03-07T21:02:41Z" level=error msg="failed to send a GET request to get the plan progress from the server at http://localhost:35609/progress . Error: \"Get \\\"http://localhost:35609/progress\\\": dial tcp [::1]:35609: connect: connection refused\""
      time="2024-03-07T21:02:43Z" level=info msg="GET /api/v1/workspaces/99f5f7ec-6bc5-4915-80d1-dbe39021b487/projects/124343f5-a26d-477d-ae5c-8823e75d7721/plan" request-id=008cb501-4178-4772-bb07-93714e6f2c94
      time="2024-03-07T21:02:43Z" level=error msg="failed to send a GET request to get the plan progress from the server at http://localhost:35609/progress . Error: \"Get \\\"http://localhost:35609/progress\\\": dial tcp [::1]:35609: connect: connection refused\""
       

            rh-ee-gfarache Gabriel Farache
            yfirst Yona First
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: