We recently updated Railo and found the admin to be in a broken state, but only on some pages. Thankfully resources.customtags was not affected so we could toggle "Search in the caller directory for the custom tag" back on temporarily. Usually we would have this setting off.
The error we get on several pages is: custom tag "admin_coding_tip.[cfm|cfc]" is not defined in directory "zip://D:\websites\taco\WEB-INF\railo\context\railo-context.ra!/admin/" and directories "D:\websites\taco\WEB-INF\railo\customtags, D:\websites\taco\framework\cftags, D:\websites\taco\WEB-INF\railo\customtags"