With all the migration slowness/issues lately we really want to put some test automation round this.

Testing thoughts

• Ingest data set on the commit that the current version of production is running.
• Run test (i.e. raw calc)
• Do code upgrade with migration
• Re-run API verification step from the previous raw calc test
• Roll back commit
• Re-run API verification step one last time

Other thoughts:

We could have a job running with bonfire to deploy, run, update, run, downgrade then run the tests one last time.