The "always" part is missing in the first block in main.yml of the test_azure_load_balancer_with_public_ip test. There is "always" part only for the second block - name: Test with create and delete Resource Group. but there is no "always" for the first block - name: Test with pre created Resource Group