mmarosi123 came up with away to have both preview and stable builds in the same container. The idea is so simple and elegant I'm deeply ashamed to have not thought of it myself though I've mulled over this problem many times over the months.

We just need the preview build to live in a preview directory, and modify the webserver config to serve out preview from that directory. That's it. Just basic, bog standard, old school webserver config.