LocalIndexProvider seems to do extensive work at every startup, even if shutdown properly

After updating to 4.1 I noticed a mayor delay at every startup. With 100k nodes about 90 seconds.

Is seems the LocalIndexProvider or any component feeding it nodes is triggering a reindex at every startup. The files on disc change their size quite a lot during that time.

So I went back to 4.0 and the behaviour is not existent there, a cleanly shutdown repository starts up fast without reindexing.

Both tests were done on a cleanly shutdown repository.