As part of the testsuite smoke tests, validate any config files we ship.

There is already a smoke test that does something like this, but it is validating example files. It should validate the real files.