TL;DR today we just bind mount /etc/ceph directly into the containers instead we need to copy them so we can change the ownership.

To do this we should bind mount /etc/ceph to /var/lib/openstack/nova/ceph
and then modify the kolla config to have it copy those files to /etc/ceph in the container and update the owner and permission so that nova and qemu can access them correctly

this should probably be done by setting the owner to nova:qemu

this affect both the nova_compute and libvirt _virtqemud containers.