-
Bug
-
Resolution: Done
-
Major
-
None
-
None
-
Serverless Sprint 181
This test is located in test/conformance/api/v1/service_test.go and test/conformance/api/v1beta1/service_test.
The prober that runs in this test returns 503 error code for some requests:
service_test.go:93: Service should reflect new revision created and ready in status. prober.go:114: "http://service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com" status = 503, want: 200
It runs a prober in the background which hits the 503 error while we patch the service.
The test log is below.
--- FAIL: TestService (104.08s)
service.go:97: Creating a new Service service-pdanhqhr.
crd.go:36: resource {<nil> <nil> <*>{&TypeMeta{Kind:,APIVersion:,} &ObjectMeta{Name:service-pdanhqhr,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],} {{&ObjectMeta{Name:,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],}} {[{ <*>true <*>100 <nil>}]}} {{0 <nil>} { } {<nil> <nil> <nil>}}} <nil>}
service.go:112: Waiting for Service "service-pdanhqhr" to transition to Ready.
service.go:117: Checking to ensure Service Status is populated for Ready service service-pdanhqhr
service.go:123: Getting latest objects Created by Service service-pdanhqhr
service.go:126: Successfully created Service service-pdanhqhr
util.go:221: Checking to ensure Revision is in desired state with generation: 1
util.go:242: Checking to ensure Configuration is in desired state.
util.go:256: Checking to ensure Route is in desired state with generation: 1
util.go:202: Checking that the endpoint vends the expected text: What a spaceport!
spoof.go:114: Spoofing service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com -> service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com
util.go:268: Validate Labels on Revision Object
util.go:278: Validate Labels on Configuration Object
util.go:287: Validate Labels on Route Object
prober.go:160: Starting Route prober for http://service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com.
service_test.go:86: Updating the Service to use a different image.
spoof.go:114: Spoofing service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com -> service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com
crd.go:36: resource {<nil> <nil> <*>{&TypeMeta{Kind:,APIVersion:,} &ObjectMeta{Name:service-pdanhqhr,GenerateName:,Namespace:serving-tests,SelfLink:/apis/serving.knative.dev/v1beta1/namespaces/serving-tests/services/service-pdanhqhr,UID:5bb5911b-4342-4367-a367-8b4940e3b3d6,ResourceVersion:33628,Generation:1,CreationTimestamp:2020-02-15 08:40:25 -0500 EST,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{serving.knative.dev/creator: kube:admin,serving.knative.dev/lastModifier: kube:admin,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],} {{&ObjectMeta{Name:,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],}} {[{ <*>true <*>100 <nil>}]}} {{1 [{ConfigurationsReady True {2020-02-15 08:40:56 -0500 EST} } {Ready True {2020-02-15 08:41:18 -0500 EST} } {RoutesReady True {2020-02-15 08:41:18 -0500 EST} }]} {service-pdanhqhr-rtvj8 service-pdanhqhr-rtvj8} {<*>http://service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com <*>{<*>http://service-pdanhqhr.serving-tests.svc.cluster.local} [{ service-pdanhqhr-rtvj8 <*>true <*>100 <nil>}]}}} <nil>}
service_test.go:93: Service should reflect new revision created and ready in status.
prober.go:114: "http://service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com" status = 503, want: 200
prober.go:115: response: status: 503, body: <html>
<head>
<meta name="viewport" content="width=device-width, initial-scale=1">
<style type="text/css">
/*!
* Bootstrap v3.3.5 (http://getbootstrap.com)
* Copyright 2011-2015 Twitter, Inc.
* Licensed under MIT (https://github.com/twbs/bootstrap/blob/master/LICENSE)
*/
/*! normalize.css v3.0.3 | MIT License | github.com/necolas/normalize.css */
html {
font-family: sans-serif;
-ms-text-size-adjust: 100%;
-webkit-text-size-adjust: 100%;
}
body {
margin: 0;
}
h1 {
font-size: 1.7em;
font-weight: 400;
line-height: 1.3;
margin: 0.68em 0;
}
* {
-webkit-box-sizing: border-box;
-moz-box-sizing: border-box;
box-sizing: border-box;
}
*:before,
*:after {
-webkit-box-sizing: border-box;
-moz-box-sizing: border-box;
box-sizing: border-box;
}
html {
-webkit-tap-highlight-color: rgba(0, 0, 0, 0);
}
body {
font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
line-height: 1.66666667;
font-size: 13px;
color: #333333;
background-color: #ffffff;
margin: 2em 1em;
}
p {
margin: 0 0 10px;
font-size: 13px;
}
.alert.alert-info {
padding: 15px;
margin-bottom: 20px;
border: 1px solid transparent;
background-color: #f5f5f5;
border-color: #8b8d8f;
color: #363636;
margin-top: 30px;
}
.alert p {
padding-left: 35px;
}
a {
color: #0088ce;
}
ul {
position: relative;
padding-left: 51px;
}
p.info {
position: relative;
font-size: 15px;
margin-bottom: 10px;
}
p.info:before, p.info:after {
content: "";
position: absolute;
top: 9%;
left: 0;
}
p.info:before {
content: "i";
left: 3px;
width: 20px;
height: 20px;
font-family: serif;
font-size: 15px;
font-weight: bold;
line-height: 21px;
text-align: center;
color: #fff;
background: #4d5258;
border-radius: 16px;
}
@media (min-width: 768px) {
body {
margin: 4em 3em;
}
h1 {
font-size: 2.15em;}
}
</style>
</head>
<body>
<div>
<h1>Application is not available</h1>
<p>The application is currently not serving requests at this endpoint. It may not have been started or is still starting.</p>
<div class="alert alert-info">
<p class="info">
Possible reasons you are seeing this page:
</p>
<ul>
<li>
<strong>The host doesn't exist.</strong>
Make sure the hostname was typed correctly and that a route matching this hostname exists.
</li>
<li>
<strong>The host exists, but doesn't have a matching path.</strong>
Check if the URL path was typed correctly and that the route was created using the desired path.
</li>
<li>
<strong>Route and path matches, but all pods are down.</strong>
Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
</li>
</ul>
</div>
</div>
</body>
</html>
, headers: map[Cache-Control:[private, max-age=0, no-cache, no-store] Connection:[close] Content-Type:[text/html] Pragma:[no-cache] Zipkin_trace_id:[f13dae15772914fc9b1d0e0ad4314452]]
service_test.go:99: Waiting for Service to transition to Ready.
util.go:221: Checking to ensure Revision is in desired state with generation: 2
util.go:242: Checking to ensure Configuration is in desired state.
util.go:256: Checking to ensure Route is in desired state with generation: 2
util.go:202: Checking that the endpoint vends the expected text: Re-energize yourself with a slice of pepperoni!
spoof.go:114: Spoofing service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com -> service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com
service_test.go:113: Updating labels of the RevisionTemplateSpec for service service-pdanhqhr.
crd.go:36: resource {<nil> <nil> <*>{&TypeMeta{Kind:,APIVersion:,} &ObjectMeta{Name:service-pdanhqhr,GenerateName:,Namespace:serving-tests,SelfLink:/apis/serving.knative.dev/v1beta1/namespaces/serving-tests/services/service-pdanhqhr,UID:5bb5911b-4342-4367-a367-8b4940e3b3d6,ResourceVersion:33628,Generation:1,CreationTimestamp:2020-02-15 08:40:25 -0500 EST,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{serving.knative.dev/creator: kube:admin,serving.knative.dev/lastModifier: kube:admin,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],} {{&ObjectMeta{Name:,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{labelX: abc,labelY: def,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],}} {[{ <*>true <*>100 <nil>}]}} {{1 [{ConfigurationsReady True {2020-02-15 08:40:56 -0500 EST} } {Ready True {2020-02-15 08:41:18 -0500 EST} } {RoutesReady True {2020-02-15 08:41:18 -0500 EST} }]} {service-pdanhqhr-rtvj8 service-pdanhqhr-rtvj8} {<*>http://service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com <*>{<*>http://service-pdanhqhr.serving-tests.svc.cluster.local} [{ service-pdanhqhr-rtvj8 <*>true <*>100 <nil>}]}}} <nil>}
service_test.go:124: Waiting for the new revision to appear as LatestRevision.
service_test.go:130: Updating annotations of RevisionTemplateSpec for service service-pdanhqhr
crd.go:36: resource {<nil> <nil> <*>{&TypeMeta{Kind:,APIVersion:,} &ObjectMeta{Name:service-pdanhqhr,GenerateName:,Namespace:serving-tests,SelfLink:/apis/serving.knative.dev/v1beta1/namespaces/serving-tests/services/service-pdanhqhr,UID:5bb5911b-4342-4367-a367-8b4940e3b3d6,ResourceVersion:36505,Generation:3,CreationTimestamp:2020-02-15 08:40:25 -0500 EST,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{serving.knative.dev/creator: kube:admin,serving.knative.dev/lastModifier: kube:admin,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],} {{&ObjectMeta{Name:,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{annotationA: 123,annotationB: 456,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],}} {[{ <*>true <*>100 <nil>}]}} {{2 [{ConfigurationsReady True {2020-02-15 08:41:34 -0500 EST} } {Ready True {2020-02-15 08:41:36 -0500 EST} } {RoutesReady True {2020-02-15 08:41:36 -0500 EST} }]} {service-pdanhqhr-qjn9d service-pdanhqhr-qjn9d} {<*>http://service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com <*>{<*>http://service-pdanhqhr.serving-tests.svc.cluster.local} [{ service-pdanhqhr-qjn9d <*>true <*>100 <nil>}]}}} <nil>}
service_test.go:141: Waiting for the new revision to appear as LatestRevision.
service_test.go:147: Waiting for Service to transition to Ready.
util.go:221: Checking to ensure Revision is in desired state with generation: 4
util.go:242: Checking to ensure Configuration is in desired state.
util.go:256: Checking to ensure Route is in desired state with generation: 4
util.go:202: Checking that the endpoint vends the expected text: Re-energize yourself with a slice of pepperoni!
spoof.go:114: Spoofing service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com -> service-pdanhqhr.serving-tests.apps.cvp-28-cvp.openshift-aws.rhocf-dev.com
prober.go:205: Stopping all probers
service_test.go:159: CheckSLO() = SLI for "TestService" = 0.979167, wanted >= 1.000000
Failed in https://ocf-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/smokes/job/cvp/28/consoleFull