I tried the "Search runtimes" and it asked me for a directory, I pointed to one with multiple runtimes in it press Ok and then it returned immediatly back to the preference page as if nothing had happened.

Then I looked under the runtimes and it seem to have picked them all up - very impressive BUT as a new user I would have no idea what just happend.

There shuold be some feedback to the user wether the search found anything or not, i.e. "The search found 4 runtimes while searching <thedir>." and then list their names.
And similar if nothing were found say "The search found 0 runtimes while searching <thedir>."