Uploaded image for project: 'WildFly Elytron'
  1. WildFly Elytron
  2. ELY-2354

Failing tests on latest IBM Semeru Runtime Certified Edition 11.0.15.0

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 2.2.0.Final
    • None
    • None
    • None

      Some tests fail on latest IBM Semeru Runtime Certified Edition 11.0.15.0

      WildFly Elytron - Tests:

      Tests in error: 
        MaskedPasswordSSLAuthenticationTest.testTwoWay:162->getKeyManager:88 » NoSuchAlgorithm
        Gs2SuiteChild.init:120 » Login No LoginModule found for com.ibm.security.auth....
        CommunicationSuiteChild.initialize:128 » Login No LoginModule found for com.ib...
        GSSSecurityFactorySuiteChild.testCreate:51 » GeneralSecurity ELY01121: Unable ...
        SSLAuthenticationTest.testCRLMaxCertPathFails:530->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testCRLMaxCertPathSucceeds:516->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testClientSideOcsp:753->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testCrlBlank:441->getKeyManager:135 » NoSuchAlgorithm Ib...
        SSLAuthenticationTest.testOcspGood:701->getKeyManager:135 » NoSuchAlgorithm Ib...
        SSLAuthenticationTest.testOcspMaxCertPath0:721->ocspMaxCertPathCommon:737->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testOcspMaxCertPathNeg1:716->ocspMaxCertPathCommon:737->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testOcspMaxCertPathOkay:731->ocspMaxCertPathCommon:737->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testOcspMaxCertPathTooLong:726->ocspMaxCertPathCommon:737->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testOneWay:432->getKeyManager:135 » NoSuchAlgorithm IbmX...
        SSLAuthenticationTest.testOneWayServerAcceptedWithMultipleCRL:502->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testOneWayServerRejectedWithMultipleCRL:487->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testOneWayServerRejectedWithSingleCRL:473->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testServerIcaRevoked:459->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testServerRevoked:450->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testTwoWay:540->getKeyManager:135 » NoSuchAlgorithm IbmX...
        SSLAuthenticationTest.testTwoWayClientAcceptedWithMultipleCRL:681->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testTwoWayClientAcceptedWithSingleCRL:622->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testTwoWayClientRejectedWithMultipleCRL:652->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testTwoWayClientRejectedWithSingleCRL:594->getKeyManager:135 » NoSuchAlgorithm
        SSLAuthenticationTest.testTwoWayIca:553->getKeyManager:135 » NoSuchAlgorithm I...
        SSLv2HelloAuthenticationTest.testTwoWaySSLv2HelloNoClientSupport:258->getKeyManager:378 » NoSuchAlgorithm
        SSLv2HelloAuthenticationTest.testTwoWaySSLv2HelloNotEnabled:229->getKeyManager:378 » NoSuchAlgorithm
        TLS13AuthenticationTest.testClientTLS12Only:154->getKeyManager:241 » NoSuchAlgorithm
        TLS13AuthenticationTest.testDifferentPreferredTLS13Suites:133->getKeyManager:241 » NoSuchAlgorithm
        TLS13AuthenticationTest.testServerTLS12Only:171->getKeyManager:241 » NoSuchAlgorithm
        TLS13AuthenticationTest.testTwoWayTLS13:114->getKeyManager:241 » NoSuchAlgorithm
      
      Tests run: 593, Failures: 0, Errors: 31, Skipped: 10
      

      WildFly Elytron Tool:

      Failed tests: 
        VaultCommandTest.arabicCharsTest:252->executeVaultCommandWithParams:506->executeVaultCommandWithParams:510->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_arabic_chars/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --salt 12345678 --iteration 34 --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit11621342126937990432/test_-1929930405.store --alias test} should succeeded but it failed
        VaultCommandTest.chineseCharsTest:223->executeVaultCommandWithParams:506->executeVaultCommandWithParams:510->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_chinese_chars/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --salt 12345678 --iteration 34 --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit18431019670634007662/test_1349087102.store --alias test} should succeeded but it failed
        VaultCommandTest.japaneseCharsTest:281->executeVaultCommandWithParams:506->executeVaultCommandWithParams:510->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_japanese_chars/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --salt 12345678 --iteration 34 --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit5840592433299115352/test_325910955.store --alias test} should succeeded but it failed
        VaultCommandTest.singleConversionBasicTest:116->executeVaultCommandWithParams:506->executeVaultCommandWithParams:510->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_ibm/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --salt 12345678 --iteration 34 --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit6706693610853698479/test_2053474387.store --alias test} should succeeded but it failed
        VaultCommandTest.singleConversionInvalidRequiredOptionTest:304->executeVaultCommandWithParams:535 Command output should contain "ELYTOOL00008: Cannot locate admin key with alias "wrongAliasName" or it is of improper type"
        VaultCommandTest.singleConversionRewriteConvertedFileTest:146->executeVaultCommandWithParams:506->executeVaultCommandWithParams:510->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_ibm/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --salt 12345678 --iteration 34 --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit12551314677508184628/test_14950830.store --alias test} should succeeded but it failed
        VaultCommandTest.singleConversionSummaryMaskedPasswordTest:379->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_ibm/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --salt 12345678 --iteration 34 --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit15858441386749503517/test_648210043.store --alias test --summary} should succeeded but it failed
        VaultCommandTest.singleConversionSummaryTest:358->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_ibm/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password secretsecret --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit8169891778903422679/test_-277637701.store --alias test --summary} should succeeded but it failed
        VaultCommandTest.specialCharsTest:194->executeVaultCommandWithParams:506->executeVaultCommandWithParams:510->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_special_chars/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --salt 12345678 --iteration 34 --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit14402584912649650809/test_1244183838.store --alias test} should succeeded but it failed
        VaultCommandTest.testConvertOperationSaltAndIteration:322->executeVaultCommandWithParams:510->executeVaultCommandWithParams:532 Execution of vault command with arguments {--enc-dir target/test-classes/vault-v1/vault_data_ibm/ --keystore target/test-classes/vault-v1/vault-jceks-ibm.keystore --keystore-password MASK-2hKo56F1a3jYGnJwhPmiF5 --alias test --location /Users/chaowan/work/git/wildfly-security/wildfly-elytron/tool/target/junit10424517418863655294/test_-1185676223.store --salt 12345678 --iteration 34} should succeeded but it failed
      Tests in error: 
        VaultCommandTest.bulkConversionBasicTest:395->AbstractCommandTest.executeCommandAndCheckStatusAndGetOutput:116->AbstractCommandTest.executeCommandAndCheckStatusAndGetOutput:132 » Runtime
        VaultCommandTest.testDuplicateOptions:453->AbstractCommandTest.executeCommandAndCheckStatusAndGetOutput:116->AbstractCommandTest.executeCommandAndCheckStatusAndGetOutput:132 » Runtime
      
      Tests run: 108, Failures: 10, Errors: 2, Skipped: 13
      

      This happens because some IBM security providers and algorithms are no longer available in IBM Semeru Runtime Certified Edition, Version 11. Please see more information in Semeru Runtimes security migration guide

      Since we check the IBM JDK via vendor name like:

      private static final boolean IS_IBM = System.getProperty("java.vendor").contains("IBM");
      

      This has been just revealed in latest IBM Semeru Runtime Certified Edition 11.0.15.0. Because the vendor name changed in this update.

      chaowan@Chaos-MacBook-Pro elytron % mvn -v
      Apache Maven 3.8.5 (3599d3414f046de2324203b78ddcf9b5e4388aa0)
      Maven home: /Users/chaowan/Downloads/software/apache/maven/apache-maven-3.8.5
      Java version: 11.0.15, vendor: IBM Corporation, runtime: /Users/chaowan/Downloads/software/java/jdk/ibm/jdk-11.0.15+10/Contents/Home
      ... ...
      chaowan@Chaos-MacBook-Pro elytron % mvn -v
      Apache Maven 3.8.5 (3599d3414f046de2324203b78ddcf9b5e4388aa0)
      Maven home: /Users/chaowan/Downloads/software/apache/maven/apache-maven-3.8.5
      Java version: 11.0.14.1, vendor: International Business Machines Corporation, runtime: /Users/chaowan/Downloads/software/java/jdk/ibm/jdk-11.0.14.1+1/Contents/Home
      ...

              chaowan@redhat.com Chao Wang
              chaowan@redhat.com Chao Wang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: