Has anyone successfully installed CFix.65CR1.2201?

anon-1011 · January 26, 2022, 9:29am

Has anyone successfully installed CFix.65CR1.2201 in their environment? After we install that CFix here, the Pushnotification Cluster is no longer starting correctly.

We see errors like these below. Any idea?

At startup:

[25/01/22 17:39:43:616 CET] 000000b2 Platform E Fail to initialize java.lang.ExceptionInInitializerError at java.lang.J9VMInternals.ensureError(J9VMInternals.java:145) at java.lang.J9VMInternals.recordInitializationFailure(J9VMInternals.java:134) at com.ibm.connections.directory.services.component.VMMUserServices.<clinit>(VMMUserServices.java:42) at com.ibm.connections.directory.services.util.ConfigHelper.findWaltzDSXAdmin(ConfigHelper.java:293) at com.ibm.connections.directory.services.util.ConfigHelper.setConfigByWASSecurity(ConfigHelper.java:2381) at com.ibm.connections.directory.services.util.AutoDetection.providerDetection(AutoDetection.java:42) at com.ibm.connections.directory.services.DSProviderFactory.<init>(DSProviderFactory.java:46) at com.ibm.connections.directory.services.DSProviderFactory.<clinit>(DSProviderFactory.java:33) at com.ibm.connections.highway.common.api.HighwayUserSessionInfo.<clinit>(HighwayUserSessionInfo.java:63) at com.ibm.connections.highway.client.api.HighwaySetup.getAdminUserSessionInfo(HighwaySetup.java:174) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledHighway(HighwayGatekeeperImpl.java:244) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:150) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:75) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledGlobally(HighwayGatekeeperImpl.java:66) at com.ibm.lconn.core.gatekeeper.LCGatekeeper.isEnabledGlobally(LCGatekeeper.java:92) at com.ibm.ventura.internal.config.VenturaConfigurationProviderImpl.initialize(VenturaConfigurationProviderImpl.java:238) at com.ibm.ventura.internal.config.api.VenturaConfigurationProvider$Factory.getInstance(VenturaConfigurationProvider.java:289) at com.ibm.lconn.pushnotification.platform.config.Platform.loadConnectionsConfiguration(Unknown Source) at com.ibm.lconn.pushnotification.platform.config.Platform.init(Unknown Source) at com.ibm.lconn.pushnotification.platform.config.PlatformInitializer.contextInitialized(Unknown Source) at com.ibm.ws.webcontainer.webapp.WebApp.notifyServletContextCreated(WebApp.java:1747) at com.ibm.ws.webcontainer.webapp.WebAppImpl.initialize(WebAppImpl.java:415) at com.ibm.ws.webcontainer.webapp.WebGroupImpl.addWebApplication(WebGroupImpl.java:88) at com.ibm.ws.webcontainer.VirtualHostImpl.addWebApplication(VirtualHostImpl.java:171) at com.ibm.ws.webcontainer.WSWebContainer.addWebApp(WSWebContainer.java:904) at com.ibm.ws.webcontainer.WSWebContainer.addWebApplication(WSWebContainer.java:789) at com.ibm.ws.webcontainer.component.WebContainerImpl.install(WebContainerImpl.java:427) at com.ibm.ws.webcontainer.component.WebContainerImpl.start(WebContainerImpl.java:719) at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:1211) at com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeployedObjectStart(DeployedApplicationImpl.java:1464) at com.ibm.ws.runtime.component.DeployedModuleImpl.start(DeployedModuleImpl.java:642) at com.ibm.ws.runtime.component.DeployedApplicationImpl.start(DeployedApplicationImpl.java:1042) at com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplication(ApplicationMgrImpl.java:795) at com.ibm.ws.runtime.component.ApplicationMgrImpl$5.run(ApplicationMgrImpl.java:2279) at com.ibm.ws.security.auth.ContextManagerImpl.runAs(ContextManagerImpl.java:5536) at com.ibm.ws.security.auth.ContextManagerImpl.runAsSystem(ContextManagerImpl.java:5662) at com.ibm.ws.security.core.SecurityContext.runAsSystem(SecurityContext.java:255) at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:2284) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:436) at com.ibm.ws.runtime.component.CompositionUnitImpl.start(CompositionUnitImpl.java:123) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:379) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.access$500(CompositionUnitMgrImpl.java:127) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl$CUInitializer.run(CompositionUnitMgrImpl.java:985) at com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitializer.run(WsComponentImpl.java:524) at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1892) Caused by: java.lang.IllegalStateException: org.slf4j.LoggerFactory could not be successfully initialized. See also http://www.slf4j.org/codes.html#unsuccessfulInit at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:303) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:269) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:281) at com.ibm.connections.directory.services.cache.impl.CacheUserByPrincipal.<clinit>(CacheUserByPrincipal.java:39) ... 43 more Acessing: [26/01/22 09:25:58:410 CET] 0000014f ServletWrappe E com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0271E: Uncaught init() exception created by servlet [app-login] in application [PushNotification]: java.lang.NoClassDefFoundError: com.ibm.connections.highway.common.api.HighwayUserSessionInfo (initialization failure) at java.lang.J9VMInternals.initializationAlreadyFailed(J9VMInternals.java:95) at com.ibm.connections.highway.client.api.HighwaySetup.getAdminUserSessionInfo(HighwaySetup.java:174) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledHighway(HighwayGatekeeperImpl.java:244) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:150) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:75) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledGlobally(HighwayGatekeeperImpl.java:66) at com.ibm.lconn.core.gatekeeper.LCGatekeeper.isEnabledGlobally(LCGatekeeper.java:92) at com.ibm.ventura.internal.config.VenturaConfigurationProviderImpl.initialize(VenturaConfigurationProviderImpl.java:238) at com.ibm.ventura.internal.config.api.VenturaConfigurationProvider$Factory.getInstance(VenturaConfigurationProvider.java:289) at com.ibm.ventura.internal.config.helper.impl.VenturaConfigurationHelperImpl.getConnectionsConfig(VenturaConfigurationHelperImpl.java:632) at com.ibm.ventura.internal.config.helper.impl.VenturaConfigurationHelperImpl.initService(VenturaConfigurationHelperImpl.java:441) at com.ibm.ventura.internal.config.helper.impl.VenturaConfigurationHelperImpl.<init>(VenturaConfigurationHelperImpl.java:136) at com.ibm.ventura.internal.config.helper.api.VenturaConfigurationHelper$Factory.getInstance(VenturaConfigurationHelper.java:237) at com.ibm.lconn.core.web.login.LoginServlet.init(LoginServlet.java:59) at com.ibm.ws.cache.servlet.ServletWrapper.init(ServletWrapper.java:238) at com.ibm.ws.webcontainer.servlet.ServletWrapper.init(ServletWrapper.java:345) at com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.init(ServletWrapperImpl.java:168) at com.ibm.ws.webcontainer.servlet.ServletWrapper.load(ServletWrapper.java:1378) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1027) at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:87) at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:952) at com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1817) at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:213) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:463) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:530) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:316) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:287) at com.ibm.ws.ssl.channel.impl.SSLConnectionLink.determineNextChannel(SSLConnectionLink.java:1187) at com.ibm.ws.ssl.channel.impl.SSLConnectionLink$MyReadCompletedCallback.complete(SSLConnectionLink.java:694) at com.ibm.ws.ssl.channel.impl.SSLReadServiceContext$SSLReadCompletedCallback.complete(SSLReadServiceContext.java:1833) at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:175) at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217) at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161) at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138) at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204) at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775) at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905) at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1892) Caused by: java.lang.IllegalStateException: org.slf4j.LoggerFactory could not be successfully initialized. See also SLF4J Error Codes at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:303) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:269) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:281) at com.ibm.connections.directory.services.cache.impl.CacheUserByPrincipal.<clinit>(CacheUserByPrincipal.java:39) at com.ibm.connections.directory.services.component.VMMUserServices.<clinit>(VMMUserServices.java:42) at com.ibm.connections.directory.services.util.ConfigHelper.findWaltzDSXAdmin(ConfigHelper.java:293) at com.ibm.connections.directory.services.util.ConfigHelper.setConfigByWASSecurity(ConfigHelper.java:2381) at com.ibm.connections.directory.services.util.AutoDetection.providerDetection(AutoDetection.java:42) at com.ibm.connections.directory.services.DSProviderFactory.<init>(DSProviderFactory.java:46) at com.ibm.connections.directory.services.DSProviderFactory.<clinit>(DSProviderFactory.java:33) at com.ibm.connections.highway.common.api.HighwayUserSessionInfo.<clinit>(HighwayUserSessionInfo.java:63) at com.ibm.connections.highway.client.api.HighwaySetup.getAdminUserSessionInfo(HighwaySetup.java:174) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledHighway(HighwayGatekeeperImpl.java:244) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:150) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:75) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledGlobally(HighwayGatekeeperImpl.java:66) at com.ibm.lconn.core.gatekeeper.LCGatekeeper.isEnabledGlobally(LCGatekeeper.java:92) at com.ibm.ventura.internal.config.VenturaConfigurationProviderImpl.initialize(VenturaConfigurationProviderImpl.java:238) at com.ibm.ventura.internal.config.api.VenturaConfigurationProvider$Factory.getInstance(VenturaConfigurationProvider.java:289) at com.ibm.lconn.pushnotification.platform.config.Platform.loadConnectionsConfiguration(Unknown Source) at com.ibm.lconn.pushnotification.platform.config.Platform.init(Unknown Source) at com.ibm.lconn.pushnotification.platform.config.PlatformInitializer.contextInitialized(Unknown Source) at com.ibm.ws.webcontainer.webapp.WebApp.notifyServletContextCreated(WebApp.java:1747) at com.ibm.ws.webcontainer.webapp.WebAppImpl.initialize(WebAppImpl.java:415) at com.ibm.ws.webcontainer.webapp.WebGroupImpl.addWebApplication(WebGroupImpl.java:88) at com.ibm.ws.webcontainer.VirtualHostImpl.addWebApplication(VirtualHostImpl.java:171) at com.ibm.ws.webcontainer.WSWebContainer.addWebApp(WSWebContainer.java:904) at com.ibm.ws.webcontainer.WSWebContainer.addWebApplication(WSWebContainer.java:789) at com.ibm.ws.webcontainer.component.WebContainerImpl.install(WebContainerImpl.java:427) at com.ibm.ws.webcontainer.component.WebContainerImpl.start(WebContainerImpl.java:719) at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:1211) at com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeployedObjectStart(DeployedApplicationImpl.java:1464) at com.ibm.ws.runtime.component.DeployedModuleImpl.start(DeployedModuleImpl.java:642) at com.ibm.ws.runtime.component.DeployedApplicationImpl.start(DeployedApplicationImpl.java:1042) at com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplication(ApplicationMgrImpl.java:795) at com.ibm.ws.runtime.component.ApplicationMgrImpl$5.run(ApplicationMgrImpl.java:2279) at com.ibm.ws.security.auth.ContextManagerImpl.runAs(ContextManagerImpl.java:5536) at com.ibm.ws.security.auth.ContextManagerImpl.runAsSystem(ContextManagerImpl.java:5662) at com.ibm.ws.security.core.SecurityContext.runAsSystem(SecurityContext.java:255) at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:2284) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:436) at com.ibm.ws.runtime.component.CompositionUnitImpl.start(CompositionUnitImpl.java:123) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:379) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.access$500(CompositionUnitMgrImpl.java:127) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl$CUInitializer.run(CompositionUnitMgrImpl.java:985) at com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitializer.run(WsComponentImpl.java:524) … 1 more [26/01/22 09:25:58:416 CET] 0000014f webapp E com.ibm.ws.webcontainer.webapp.WebApp logServletError SRVE0293E: [Servlet Error]-[app-login]: java.lang.NoClassDefFoundError: com.ibm.lconn.core.web.util.lang.I18NFilter (initialization failure) at java.lang.J9VMInternals.initializationAlreadyFailed(J9VMInternals.java:95) at java.lang.J9VMInternals.newInstanceImpl(Native Method) at java.lang.Class.newInstance(Class.java:2062) at java.beans.Beans.instantiate(Beans.java:240) at java.beans.Beans.instantiate(Beans.java:88) at com.ibm.ws.webcontainer.filter.WebAppFilterManager._loadFilter(WebAppFilterManager.java:572) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.loadFilter(WebAppFilterManager.java:514) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.getFilterInstanceWrapper(WebAppFilterManager.java:319) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.getFilterChain(WebAppFilterManager.java:392) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:931) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1107) at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:87) at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:952) at com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1817) at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:213) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:463) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:530) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:316) at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:287) at com.ibm.ws.ssl.channel.impl.SSLConnectionLink.determineNextChannel(SSLConnectionLink.java:1187) at com.ibm.ws.ssl.channel.impl.SSLConnectionLink$MyReadCompletedCallback.complete(SSLConnectionLink.java:694) at com.ibm.ws.ssl.channel.impl.SSLReadServiceContext$SSLReadCompletedCallback.complete(SSLReadServiceContext.java:1833) at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:175) at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217) at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161) at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138) at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204) at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775) at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905) at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1892) Caused by: java.lang.NoClassDefFoundError: com.ibm.connections.highway.common.api.HighwayUserSessionInfo (initialization failure) at java.lang.J9VMInternals.initializationAlreadyFailed(J9VMInternals.java:95) at com.ibm.connections.highway.client.api.HighwaySetup.getAdminUserSessionInfo(HighwaySetup.java:174) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledHighway(HighwayGatekeeperImpl.java:244) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:150) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:75) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledGlobally(HighwayGatekeeperImpl.java:66) at com.ibm.lconn.core.gatekeeper.LCGatekeeper.isEnabledGlobally(LCGatekeeper.java:92) at com.ibm.ventura.internal.config.VenturaConfigurationProviderImpl.initialize(VenturaConfigurationProviderImpl.java:238) at com.ibm.ventura.internal.config.api.VenturaConfigurationProvider$Factory.getInstance(VenturaConfigurationProvider.java:289) at com.ibm.ventura.internal.config.helper.impl.VenturaConfigurationHelperImpl.getConnectionsConfig(VenturaConfigurationHelperImpl.java:632) at com.ibm.ventura.internal.config.helper.impl.VenturaConfigurationHelperImpl.initService(VenturaConfigurationHelperImpl.java:441) at com.ibm.ventura.internal.config.helper.impl.VenturaConfigurationHelperImpl.<init>(VenturaConfigurationHelperImpl.java:136) at com.ibm.ventura.internal.config.helper.api.VenturaConfigurationHelper$Factory.getInstance(VenturaConfigurationHelper.java:237) at com.ibm.lconn.core.web.util.lang.I18NFilter.<clinit>(I18NFilter.java:131) at java.lang.J9VMInternals.newInstanceImpl(Native Method) at java.lang.Class.newInstance(Class.java:2062) at java.beans.Beans.instantiate(Beans.java:240) at java.beans.Beans.instantiate(Beans.java:88) at com.ibm.ws.webcontainer.filter.WebAppFilterManager._loadFilter(WebAppFilterManager.java:572) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.loadFilter(WebAppFilterManager.java:514) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.getFilterInstanceWrapper(WebAppFilterManager.java:319) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.getFilterChain(WebAppFilterManager.java:392) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:931) at com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1107) at com.ibm.ws.webcontainer.webapp.WebApp.handleRequest(WebApp.java:4075) at com.ibm.ws.webcontainer.webapp.WebGroup.handleRequest(WebGroup.java:304) at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:1019) … 17 more Caused by: java.lang.IllegalStateException: org.slf4j.LoggerFactory could not be successfully initialized. See also SLF4J Error Codes at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:303) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:269) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:281) at com.ibm.connections.directory.services.cache.impl.CacheUserByPrincipal.<clinit>(CacheUserByPrincipal.java:39) at com.ibm.connections.directory.services.component.VMMUserServices.<clinit>(VMMUserServices.java:42) at com.ibm.connections.directory.services.util.ConfigHelper.findWaltzDSXAdmin(ConfigHelper.java:293) at com.ibm.connections.directory.services.util.ConfigHelper.setConfigByWASSecurity(ConfigHelper.java:2381) at com.ibm.connections.directory.services.util.AutoDetection.providerDetection(AutoDetection.java:42) at com.ibm.connections.directory.services.DSProviderFactory.<init>(DSProviderFactory.java:46) at com.ibm.connections.directory.services.DSProviderFactory.<clinit>(DSProviderFactory.java:33) at com.ibm.connections.highway.common.api.HighwayUserSessionInfo.<clinit>(HighwayUserSessionInfo.java:63) at com.ibm.connections.highway.client.api.HighwaySetup.getAdminUserSessionInfo(HighwaySetup.java:174) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledHighway(HighwayGatekeeperImpl.java:244) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:150) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabled(HighwayGatekeeperImpl.java:75) at com.ibm.connections.highway.gatekeeper.HighwayGatekeeperImpl.isEnabledGlobally(HighwayGatekeeperImpl.java:66) at com.ibm.lconn.core.gatekeeper.LCGatekeeper.isEnabledGlobally(LCGatekeeper.java:92) at com.ibm.ventura.internal.config.VenturaConfigurationProviderImpl.initialize(VenturaConfigurationProviderImpl.java:238) at com.ibm.ventura.internal.config.api.VenturaConfigurationProvider$Factory.getInstance(VenturaConfigurationProvider.java:289) at com.ibm.lconn.pushnotification.platform.config.Platform.loadConnectionsConfiguration(Unknown Source) at com.ibm.lconn.pushnotification.platform.config.Platform.init(Unknown Source) at com.ibm.lconn.pushnotification.platform.config.PlatformInitializer.contextInitialized(Unknown Source) at com.ibm.ws.webcontainer.webapp.WebApp.notifyServletContextCreated(WebApp.java:1747) at com.ibm.ws.webcontainer.webapp.WebAppImpl.initialize(WebAppImpl.java:415) at com.ibm.ws.webcontainer.webapp.WebGroupImpl.addWebApplication(WebGroupImpl.java:88) at com.ibm.ws.webcontainer.VirtualHostImpl.addWebApplication(VirtualHostImpl.java:171) at com.ibm.ws.webcontainer.WSWebContainer.addWebApp(WSWebContainer.java:904) at com.ibm.ws.webcontainer.WSWebContainer.addWebApplication(WSWebContainer.java:789) at com.ibm.ws.webcontainer.component.WebContainerImpl.install(WebContainerImpl.java:427) at com.ibm.ws.webcontainer.component.WebContainerImpl.start(WebContainerImpl.java:719) at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:1211) at com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeployedObjectStart(DeployedApplicationImpl.java:1464) at com.ibm.ws.runtime.component.DeployedModuleImpl.start(DeployedModuleImpl.java:642) at com.ibm.ws.runtime.component.DeployedApplicationImpl.start(DeployedApplicationImpl.java:1042) at com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplication(ApplicationMgrImpl.java:795) at com.ibm.ws.runtime.component.ApplicationMgrImpl$5.run(ApplicationMgrImpl.java:2279) at com.ibm.ws.security.auth.ContextManagerImpl.runAs(ContextManagerImpl.java:5536) at com.ibm.ws.security.auth.ContextManagerImpl.runAsSystem(ContextManagerImpl.java:5662) at com.ibm.ws.security.core.SecurityContext.runAsSystem(SecurityContext.java:255) at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:2284) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:436) at com.ibm.ws.runtime.component.CompositionUnitImpl.start(CompositionUnitImpl.java:123) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:379) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.access$500(CompositionUnitMgrImpl.java:127) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl$CUInitializer.run(CompositionUnitMgrImpl.java:985) at com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitializer.run(WsComponentImpl.java:524) … 1 more

[26/01/22 09:25:58:419 CET] 0000014f LotusConnecti E An unexpected exception was caught by HCL Connections. The error page generated for this exception will display the identifier below. [26/01/22 09:25:58:419 CET] 0000014f LotusConnecti E Identifier: LC11AEE528A0A24F2A8ED274B23B6C90C7 [26/01/22 09:25:58:420 CET] 0000014f LotusConnecti E User-Agent: curl/7.29.0 [26/01/22 09:25:58:420 CET] 0000014f LotusConnecti E Request URI: GET https://server.acme.com/push/nav/templates/error.jsp [26/01/22 09:25:58:420 CET] 0000014f LotusConnecti E Request URI: GET /push/login [26/01/22 09:25:58:421 CET] 0000014f LotusConnecti E Remote user: null [26/01/22 09:25:58:421 CET] 0000014f LotusConnecti E Locale: en_GB [26/01/22 09:25:58:421 CET] 0000014f LotusConnecti E Session ID: o-zDY8IxJzoXbucx1Fiq53K [26/01/22 09:25:58:421 CET] 0000014f LotusConnecti E An unexpected exception was caught by HCL Connections. The error page generated for this exception will display the identifier below. javax.servlet.ServletException: Filter [ConnectionsI18N]: com.ibm.lconn.core.web.util.lang.I18NFilter was found, but is missing another required class.

treinheimer · January 26, 2022, 9:49am

Hello Michael,

how did you update? Did you also update the Application Server? The error message above indicating a problem with the Java version. Was there maybe another change for which you also changed from Java 7 to java 8?

Do you also face the problem, when you clean the OSGI- and Class-cache along with the wstemp and temp folder of each connections profile?

Instructions to clean the caches can be found at IBMs page:

https://www.ibm.com/support/pages/how-clear-websphere-class-caches

Thanks for the clarification,

greetings, Thorsten

anon-1011 · January 26, 2022, 10:31am

Hi Thorsten,

what do you mean with "also update the application server"? We install the update via update installer on the Deployment manager and then do a full resync of all application servers.

We delete the temp directories on the application servers as we do normally, but did not try to delete OSGI- and Class-cache (will try that).

We did not change anything Java related before trying to install the Cfix. We currently run the following Java version on all of our servers :

java version "1.8.0_311"
Java(TM) SE Runtime Environment (build 8.0.7.0 - pxa6480sr7-20211025_01(SR7))
IBM J9 VM (build 2.9, JRE 1.8.0 Linux amd64-64-Bit Compressed References 20211022_15212 (JIT enabled, AOT enabled)
OpenJ9 - 6abb372
OMR - b898db9
IBM - 2f2c48b)
JCL - 20210930_01 based on Oracle jdk8u311-b11

What we also see: The updates fails at the first run because "out of space". I assume it is the "/tmp" directory which is here only 2 GB. If we delete everything we can from /tmp and try the update again it restarts at the point it was failing before (it starts with "profiles" and then finishs successfully).

Maybe the failed "profiles" update is not 100% correctly done at the second try.

Unfortunately there is no way to increase "/tmp" here. Is there a config setting somewhere to force update installer to use another temp directory?

treinheimer · January 26, 2022, 10:43am

Hi Michael,

if the first update already failed with "out of space" I highly recommend to rollback first before trying to update Portal, again. So the first step is really to ensure that the update completes successfully. If that already failed it is maybe possible that you already have corrupted files on the system. Usually the Update installer should also take care of it to keep it consistent.

If you need more space for your update installer to do all the actions then you can try to run it with the following parameters:

-Djava.io.tmpdir="/mytemp" -Dtemp.dir="/mytemp"

I hope that helps

Thanks, Thorsten

anon-1011 · January 26, 2022, 10:48am

Hi Thorsten,

deleting the OSGI- and Class-cache did not help.

Thanks for the instruction to move the temp dir to another location. I will rollback and give it a try!

Michael

anon-1011 · January 26, 2022, 11:13am

Thorsten,

could you please give me a hint where to put these parameters? I added it to "updateSilent.sh" to the following location:

java \
-Djava.io.tmpdir="/opt/IBM/tmp" \
-Dtemp.dir="/opt/IBM/tmp" \
-Xmx512m \
-DCURRENT_UPDATE_DIR="${currentDir}" \
-DWAS_PROD_BASE_PATH="$WAS_PROD_HOME" \
-Dwas.home="$WAS_HOME" \
-Dwas.cell="$WAS_CELL" \
-Dcom.ibm.wp.pui.bld.level=20210419_0903 \
-Duser.install.root="$USER_INSTALL_ROOT" \
$WP_JAVA_PARAMS \
${DBG_PROP} \
com.ibm.websphere.update.launch.Launcher \
com.ibm.websphere.update.silent.UpdateInstaller "$@"

However, during uninstall of the CFix I see that the update installer is still creating files into the "/tmp" but not to "opt/IBM/tmp".

Thanks,

Michael

treinheimer · January 26, 2022, 11:22am

Hello Michael,

can you please open a case with our HCL Connections Support Team to get this clarified.
You maybe know that from the product history the updateInstaller was something that was developed earlier from IBM for which also the following technote exist:

https://www.ibm.com/support/pages/how-change-temporary-directory-used-websphere-application-server-updateinstaller-v61-and-v70-unix-or-linux

But it is possible that the code has been modified in the meantime and that we (HCL) changed it when we ship that new updateInstaller with our Connections Product. I think for that it make sense, if our development team take a look at it to verify, if that parameters can still be used. I already tried to find out, if that parameter is also mentioned in our HCL documentation, but I can not find it at the moment.

By the way.. which version of UpdateInstaller do you use? version 2104 should be the latest one.
https://support.hcltechsw.com/csm?id=kb_article&sysparm_article=KB0077140

Thanks, Thorsten

anon-1011 · January 26, 2022, 1:26pm

Hi Thorsten,

the update has been successful now. It seems, although there were some files sill located in /tmp most of the files especially the exctraction process has accepted the new temp directory and there was no out of space error now.

Unfortunately we do still get the same Java exceptions as before now :-(

So I guess we will need to open a new case for that.

Thanks,
Michael

anon-1682 · January 26, 2022, 1:42pm

Hi Michael,

For future reference, if you don't have enough space in the /tmp directory, refer to step 1 here:?
https://help.hcltechsw.com/connections/v7/admin/install/t_preinstall_sys.html?hl=iatemp

Tony Dezanet
HCL Connections Support

treinheimer · January 26, 2022, 1:46pm

Hi Michael,

yes I think it make sense to open a new HCL case for it. Java version build 8.0.7.0 - pxa6480sr7-20211025_01(SR7)) is the newest one shiped with WAS version 9.0.5.10. For details, see URL:

https://www.ibm.com/support/pages/verify-java-sdk-version-shipped-ibm-websphere-application-server-fix-packs

I don't want to exclude yet that the problem is maybe with that newest java version.

You can try to enable detailed classloader traces to check it in detail. Detailed instructions for that can be found at URL:

https://www.ibm.com/support/pages/mustgather-classloader-problems-websphere-application-server

When you open the case, please attach all log- ffdc- and trace-files from such a server startup. At best with clean new logs. Which means at best stop the JVM, then backup/clean the old log- ffdc- and trace-files. Restart the server and reproduce the problem. Finally upload all log- ffdc- and trace-files to the case.

That brings me to another question...

You mentioned earlier that you try to update your Connections 6.5_CR1 to 2201. I assume you still run on WAS v8.5.5.x. But the newest and correct java version for WAS v8.5.5.20 is:

pxa6480sr6fp31-20210510_01-1103 (SR6FP31)

Do you also see the problem, when you used the correct java version that is shipped with your latest Application server 8.5 release? That could be a potential problem. For details, please also check:

https://support.hcltechsw.com/csm?id=kb_article&sysparm_article=KB0073758#application

Thanks, Thorsten

anon-1769 · January 27, 2022, 7:26am

65CR1.CFix2201 installs properly as recent CFixes but unfortuntaly breaks PushNotifications. As a temporary workaround until an official Fix is released please try the following:

On each PushNotification Node:

cd <WAS_HOME>/profiles/<profile_name>/installedApps/ConnectionsCell
find -name *slf4j*1.7.5* | grep PushNotification
returns:
./PushNotification.ear/slf4j-api-1.7.5.jar
./PushNotification.ear/slf4j-jdk14-1.7.5.jar
./PushNotification.ear/slf4j-log4j12-1.7.5.jar
move to a temporary directory outside and restart PushNotfication servers.

anon-1011 · January 27, 2022, 3:47pm

Thanks Wickerl, and also Christoph, who forwarded me that workaround already this morning! It worked for us as well.

Max_1393 · January 31, 2022, 7:46pm

Here is also the Defect Article:https://support.hcl-software.com/csm?id=kb_article&sysparm_article=KB0096292