unity-idm-discuss

[Unity-idm-discuss] Unity 3.5.1 fails with NoSuchMethod error in bouncycastle

[Sander A. <sa....@fz...>]

Good morning Krzysztof,
we have a serious issue with unity. The last four servers we updated
successful to unity 3.5.1, including our test servers, this morning we
started the migration of the server, which is in production.

We updated from 3.3.4 to 3.5.1 and disabled the admin interface. We
have the following error in startup log:

Jun 21, 2021 7:11:39 AM CEST: Starting UNITY Web Server
Exception in thread "main" org.springframework.context.ApplicationContextException: Failed to start bean 'engineInitialization'; nested exception is java.lang.NoSuchMethodError: org.bouncycastle.asn1.ASN1ObjectIdentifier.equals(Lorg/bouncycastle/asn1/ASN1Primitive;)Z
        at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185)
        at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53)
        at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360)
        at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158)
        at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122)
        at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:894)
        at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:553)
        at pl.edu.icm.unity.engine.server.UnityApplication.run(UnityApplication.java:60)
        at pl.edu.icm.unity.engine.server.UnityApplication.main(UnityApplication.java:69)
Caused by: java.lang.NoSuchMethodError: org.bouncycastle.asn1.ASN1ObjectIdentifier.equals(Lorg/bouncycastle/asn1/ASN1Primitive;)Z
        at eu.emi.security.authn.x509.helpers.DNComparator.normalizeAVA(DNComparator.java:93)
        at eu.emi.security.authn.x509.helpers.DNComparator.preNormalize(DNComparator.java:58)
        at eu.emi.security.authn.x509.impl.X500NameUtils.getComparableForm(X500NameUtils.java:168)
        at pl.edu.icm.unity.saml.metadata.cfg.AbstractMetaToConfigConverter.getCertificateKey(AbstractMetaToConfigConverter.java:195)
        at pl.edu.icm.unity.saml.metadata.cfg.AbstractMetaToConfigConverter.updatePKICerts(AbstractMetaToConfigConverter.java:171)
        at pl.edu.icm.unity.saml.metadata.cfg.MetaToSPConfigConverter.convertToProperties(MetaToSPConfigConverter.java:111)
        at pl.edu.icm.unity.saml.metadata.cfg.AbstractMetaToConfigConverter.convertToProperties(AbstractMetaToConfigConverter.java:93)
        at pl.edu.icm.unity.saml.metadata.cfg.AbstractMetaToConfigConverter.convertToProperties(AbstractMetaToConfigConverter.java:75)
        at pl.edu.icm.unity.saml.metadata.cfg.RemoteMetaManager.reloadSingle(RemoteMetaManager.java:150)
        at pl.edu.icm.unity.saml.metadata.cfg.RemoteMetaManager.access$100(RemoteMetaManager.java:34)
        at pl.edu.icm.unity.saml.metadata.cfg.RemoteMetaManager$MetadataConsumer.updateMetadata(RemoteMetaManager.java:168)
        at pl.edu.icm.unity.saml.metadata.cfg.RemoteMetaManager$MetadataConsumer.access$300(RemoteMetaManager.java:154)
        at pl.edu.icm.unity.saml.metadata.cfg.RemoteMetaManager.lambda$registerMetadataConsumers$0(RemoteMetaManager.java:102)
        at pl.edu.icm.unity.saml.metadata.srv.MetadataSourceHandler.notifyConsumer(MetadataSourceHandler.java:207)
        at pl.edu.icm.unity.saml.metadata.srv.MetadataSourceHandler.feedWithCached(MetadataSourceHandler.java:183)
        at pl.edu.icm.unity.saml.metadata.srv.MetadataSourceHandler.addConsumer(MetadataSourceHandler.java:72)
        at pl.edu.icm.unity.saml.metadata.srv.RemoteMetadataServiceImpl.registerConsumer(RemoteMetadataServiceImpl.java:77)
        at pl.edu.icm.unity.saml.metadata.cfg.RemoteMetaManager.registerMetadataConsumers(RemoteMetaManager.java:101)
        at pl.edu.icm.unity.saml.metadata.cfg.RemoteMetaManager.<init>(RemoteMetaManager.java:59)
        at pl.edu.icm.unity.saml.sp.SAMLVerificator.setSerializedConfiguration(SAMLVerificator.java:185)
        at pl.edu.icm.unity.engine.authn.AuthenticatorLoader.verifyConfiguration(AuthenticatorLoader.java:117)
        at pl.edu.icm.unity.engine.authn.AuthenticatorManagementImpl.verifyConfiguration(AuthenticatorManagementImpl.java:188)
        at pl.edu.icm.unity.engine.authn.AuthenticatorManagementImpl.createAuthenticator(AuthenticatorManagementImpl.java:95)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
        at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88)
        at pl.edu.icm.unity.store.rdbms.tx.SQLTransactionEngine.runInTransaction(SQLTransactionEngine.java:45)
        at pl.edu.icm.unity.store.tx.TransactionalAspect.retryIfNeeded4Method(TransactionalAspect.java:75)
        at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644)
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633)
        at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
        at org.springframework.aop.aspectj.AspectJAfterAdvice.invoke(AspectJAfterAdvice.java:47)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
        at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:62)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:93)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212)
        at com.sun.proxy.$Proxy111.createAuthenticator(Unknown Source)
        at pl.edu.icm.unity.engine.server.EngineInitialization.loadAuthenticatorsFromConfiguration(EngineInitialization.java:924)
        at pl.edu.icm.unity.engine.server.EngineInitialization.initializeAuthenticators(EngineInitialization.java:892)
        at pl.edu.icm.unity.engine.server.EngineInitialization.initializeSystemContentsFromConfigFile(EngineInitialization.java:406)
        at pl.edu.icm.unity.engine.server.EngineInitialization.initializeDatabaseContents(EngineInitialization.java:374)
        at pl.edu.icm.unity.engine.server.EngineInitialization.start(EngineInitialization.java:262)
        at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182)
        ... 8 more


Do you know what could cause this problem? On the four previous servers
we didn't had any problem.

Cheers,
Sander
-- 
Federated Systems and Data
Juelich Supercomputing Centre

phone: +49 2461 61 8847
fax: +49 2461 61 6656
email: sa....@fz...

-----------------------------------------------------------------------
-----------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Volker Rieke
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
Dr. Astrid Lambrecht, Prof. Dr. Frauke Melchior
-----------------------------------------------------------------------
-----------------------------------------------------------------------

Re: [Unity-idm-discuss] Unity 3.5.1 fails with NoSuchMethod error in bouncycastle

[Krzysztof B. <kb...@un...>]

Good morning Sander,

W dniu 21.06.2021 o 07:18, Sander Apweiler pisze:
> Good morning Krzysztof,
> we have a serious issue with unity. The last four servers we updated
> successful to unity 3.5.1, including our test servers, this morning we
> started the migration of the server, which is in production.
>
> We updated from 3.3.4 to 3.5.1 and disabled the admin interface. We
> have the following error in startup log:
>
> Jun 21, 2021 7:11:39 AM CEST: Starting UNITY Web Server
> Exception in thread "main" org.springframework.context.ApplicationContextException: Failed to start bean 'engineInitialization'; nested exception is java.lang.NoSuchMethodError: org.bouncycastle.asn1.ASN1ObjectIdentifier.equals(Lorg/bouncycastle/asn1/ASN1Primitive;)Z
>          at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185)
>          at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53)
>          at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360)
>          at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158)
>          at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122)
>          at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:894)
>          at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:553)
>          at pl.edu.icm.unity.engine.server.UnityApplication.run(UnityApplication.java:60)
>          at pl.edu.icm.unity.engine.server.UnityApplication.main(UnityApplication.java:69)
> Caused by: java.lang.NoSuchMethodError: org.bouncycastle.asn1.ASN1ObjectIdentifier.equals(Lorg/bouncycastle/asn1/ASN1Primitive;)Z
>          at eu.emi.security.authn.x509.helpers.DNComparator.normalizeAVA(DNComparator.java:93)


Can you please paste the exact contents of your unity's installation 
lib/ folder?

Thanks,
Krzysztof

Re: [Unity-idm-discuss] Unity 3.5.1 fails with NoSuchMethod error in bouncycastle

[Sander A. <sa....@fz...>]

Hi Krzysztof,

a attached it in a txt file.

On Mon, 2021-06-21 at 10:44 +0200, Krzysztof Benedyczak wrote:
> Good morning Sander,
> 
> W dniu 21.06.2021 o 07:18, Sander Apweiler pisze:
> > Good morning Krzysztof,
> > we have a serious issue with unity. The last four servers we
> > updated
> > successful to unity 3.5.1, including our test servers, this morning
> > we
> > started the migration of the server, which is in production.
> > 
> > We updated from 3.3.4 to 3.5.1 and disabled the admin interface. We
> > have the following error in startup log:
> > 
> > Jun 21, 2021 7:11:39 AM CEST: Starting UNITY Web Server
> > Exception in thread "main"
> > org.springframework.context.ApplicationContextException: Failed to
> > start bean 'engineInitialization'; nested exception is
> > java.lang.NoSuchMethodError:
> > org.bouncycastle.asn1.ASN1ObjectIdentifier.equals(Lorg/bouncycastle
> > /asn1/ASN1Primitive;)Z
> >          at
> > org.springframework.context.support.DefaultLifecycleProcessor.doSta
> > rt(DefaultLifecycleProcessor.java:185)
> >          at
> > org.springframework.context.support.DefaultLifecycleProcessor.acces
> > s$200(DefaultLifecycleProcessor.java:53)
> >          at
> > org.springframework.context.support.DefaultLifecycleProcessor$Lifec
> > ycleGroup.start(DefaultLifecycleProcessor.java:360)
> >          at
> > org.springframework.context.support.DefaultLifecycleProcessor.start
> > Beans(DefaultLifecycleProcessor.java:158)
> >          at
> > org.springframework.context.support.DefaultLifecycleProcessor.onRef
> > resh(DefaultLifecycleProcessor.java:122)
> >          at
> > org.springframework.context.support.AbstractApplicationContext.fini
> > shRefresh(AbstractApplicationContext.java:894)
> >          at
> > org.springframework.context.support.AbstractApplicationContext.refr
> > esh(AbstractApplicationContext.java:553)
> >          at
> > pl.edu.icm.unity.engine.server.UnityApplication.run(UnityApplicatio
> > n.java:60)
> >          at
> > pl.edu.icm.unity.engine.server.UnityApplication.main(UnityApplicati
> > on.java:69)
> > Caused by: java.lang.NoSuchMethodError:
> > org.bouncycastle.asn1.ASN1ObjectIdentifier.equals(Lorg/bouncycastle
> > /asn1/ASN1Primitive;)Z
> >          at
> > eu.emi.security.authn.x509.helpers.DNComparator.normalizeAVA(DNComp
> > arator.java:93)
> 
> 
> Can you please paste the exact contents of your unity's installation 
> lib/ folder?
> 
> Thanks,
> Krzysztof
> 

-- 
Federated Systems and Data
Juelich Supercomputing Centre

phone: +49 2461 61 8847
fax: +49 2461 61 6656
email: sa....@fz...

-----------------------------------------------------------------------
-----------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Volker Rieke
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
Dr. Astrid Lambrecht, Prof. Dr. Frauke Melchior
-----------------------------------------------------------------------
-----------------------------------------------------------------------

Re: [Unity-idm-discuss] Unity 3.5.1 fails with NoSuchMethod error in bouncycastle

[Krzysztof B. <kb...@un...>]

W dniu 21.06.2021 o 10:51, Sander Apweiler pisze:
> Hi Krzysztof,
>
> a attached it in a txt file.
>
hmm, looks ok.

 From looking into code... this should not happen. Looks like some 
library problem, but looks fine to me.

So most likely something very weird. I'd need to be able to reproduce it 
somehow. From the log it seems that this happened when parsing a 
certificate of one of the trusted SAML IDPs. Can you tell what 
federations you have enabled? I'd need to try to configure the same and 
see if it happens on my end.

Also please provide your java version.

Cheers,
Krzysztof