(7.0.x) jboss-cli.bat script is unable to start on WIndows, if JBOSS_HOME folder ends with '!' character

Pasting the comment of Jiri Bilek from JBEAP-10229 :

If name of folder is "jboss!eap" (as in description) jboss-cli.bat starts correctly.
But if exclamation mark is on the end of the name e.g. "jboss-eap!" jboss-cli.bat gets error and does not start.

C:\Users\Administrator\Desktop\jboss-eap-7.0.6.CP.CR2-full-build\jboss-eap-7.0!\bin>jboss-cli.bat

org.jboss.as.cli.CommandHandlerProvider: Error reading configuration file: C:\Users\Administrator\Desktop\jboss-eap-7.0.6.CP.CR2-full-build\jboss-eap-7.0 (The system cannot find the file specified)