When setting up additional network configurations on the nodes using NMState Operator with NNCP CRs everything works. However once we delete these NNCP, nothing gets removed on the nodes leaving the configurations present. This lead in my case (once for now) for my nodes to be completely dead after powering off and on my cluster. The only solution was to entire rebuild the nodes.
I understand perhaps why this happens, due to the increase usage on NMstate for nodes' network setup, so not sure how easy this can be done, but I don't think it is safe to leave all network configurations in the nodes for post-installation user created NNCPs, for example when you want to configure additional networks that are not part of the cluster CNI main network.


    

    All NMState versions from 4.12 to 4.14
    

    Everytime
    

    1. Create NNCP for some additional NIC
    2. Confirm on the nodes, that NMState configured everything as expected.
    3. Delete the NNCP and recheck on the nodes, the configurations are still present