When an update of ApplicationName happens, new deployment is created and the old deployment is not deleted. Is it a behaviour which we want?

It created multiple problems... e.g. when webserver is exported to yaml file and imported back, not the same objects are created as webserver config does not contain any information about old deployments.