Crashes after installing Domino 8.5 fp1

Hi hello, since we added the fp1 to Domino 8.4 we´ve had a lot of crashes, mainly on busy mailservers.The Domino-server crashes and restarts itself, inall it takes some 20-25 minutes until it´s up&running again, some 1700 active users.

Users get redirected to the other cluster-member.

We got a case ongoing with IBM, but they put the blame on 3rd party-tools.

Has anyone else seen the same?

Subject: Do you have a pmr # or nsd ?

--Steveswatts@us.ibm.com

Subject: Be interested in seeing the nsd files as well

jpaganet@us.ibm.com

Subject: Crashes after installing Domino 8.5 fp1…Any FATAL THREAD?

Hi,

Can you post the FATAL THREAD section of the NSD files with the few lines under it

For example:

############################################################

FATAL THREAD 1/2 [ domdsm:107a8:67076]

FP=0x0012a34c, PC=0x60069a86, SP=0x0012a2f0, stksize=92

EAX=0x01a3088c, EBX=0x01a48650, ECX=0x0000bffe, EDX=0x01a325e6

ESI=0x00004000, EDI=0x0032ff78, CS=0x0000001b, SS=0x00000023

DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00010206

Exception code: c0000005 (ACCESS_VIOLATION)

############################################################

@[ 1] 0x60069a86 nnotes._fdDelete@4+118 (4000,12a368,608770ef,4000)

@[ 2] 0x60069a0c nnotes._OSFileClose@4+12 (4000,12adc0,12a380,60872ea7)

@[ 3] 0x608770ef nnotes._sqloclose+15 (4000,12b59c,5010,0)

@[ 4] 0x60872ea7 nnotes._sqlpgclf+71 (12adc0,1aaa2cb,70,1aaa2f3)

@[ 5] 0x60885458 nnotes._sqlpgfdl+616 (12b9a4,1aaa2cb,41,12be44)

@[ 6] 0x60876a6f nnotes._sqlpgcdl+927 (12bf44,12b9a4,0,12be44).

Date

Topic

Frequently asked question - How to analyze Notes/Domino NSDs? (Jean-Yves Riverin)

call IBM support

JYR

Subject: As I wrote…

…IBM is on the case, nad what they say is tthat it might be solved by this spr.SPR# BYAU7Q9HLB - Fixed server adminp task crash when registering new users in the background and applying policies to them

But we are not creating users in the background.

Since you asked for it.

############################################################

thread 183/242: [ nSERVER: 235c: 10d0] FATAL THREAD (Panic)

FP=0x2e7e891c, PC=0x7c8285ec, SP=0x2e7e88ac

stkbase=0x2e7f0000, total stksize=262144, used stksize=30548

EAX=0x00000025, EBX=0x2e7e94ec, ECX=0x00000001, EDX=0x00000025

ESI=0x00006b4c, EDI=0x00000000, CS=0x0000001b, SS=0x00000023

DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00000293

############################################################

[ 1] 0x7c8285ec ntdll.KiFastSystemCallRet+0 (6b4c,927c0,0,2e7e90cc)

[ 2] 0x77e61c8d kernel32.WaitForSingleObject+18 (6b4c,927c0,2e7e9860,2e7e94fd)

@[ 3] 0x601a28c5 nnotes.FRSendCommandToService+789 (2e7e90ec,2e7e94ec,2e7e94fd,5)

@[ 4] 0x601a34ff nnotes.OSRunExternalScript@8+1055 (258,1)

@[ 5] 0x601a3a7f nnotes.FRTerminateWindowsResources+975 (1,1010,1,0)

@[ 6] 0x601a3e48 nnotes.OSFaultCleanupExt@24+888 (a36a14,1010,0,0,0,2e7e9b88)

@[ 7] 0x601a3eca nnotes.OSFaultCleanup@12+26 (0,1010,0)

@[ 8] 0x601af374 nnotes.OSNTUnhandledExceptionFilter@4+276 (2e7eabc0)

@[ 9] 0x60173b26 nnotes.Panic@4+534 (60c85ff8)

@[10] 0x60177faa nnotes.LockHandleExt@16+410 (1bc,2e7eac08,2e7eac0c,0)

@[11] 0x601780a3 nnotes.OSLockObjectExt@8+35 (60f35de8,60f35e9a)

@[12] 0x6000296e nnotes.OSLockObject@4+14 (1bc)

@[13] 0x60a931e8 nnotes.InitializeReturnBuffer@8+56 (2e7eb1fd,4a26)

@[14] 0x60094935 nnotes.Lookup@32+853 (4a26,1,60efca14,1,0,2e7eb298,f10f10,ffffffff)

@[15] 0x6009bff2 nnotes.NAMELookup2@36+386 (0,4826,1,60efca14,0,2e7eb2dc,f10f10,ffffffff,0)

@[16] 0x60786556 nnotes.AddGroupsContainingNameExtended@24+214 (0,13b,2e7ec99c,4826,0,2e7eb648)

@[17] 0x60786fc8 nnotes.AddGroupsContainingName@20+56 (0,13b,2e7ec99c,4822,0)

@[18] 0x60787913 nnotes.UAFGetAccessGroupsExtend2@12+1939 (0,13b,0)

@[19] 0x60a3d2b2 nnotes.NAMESwitchToNLThread@4+338 (2e7edd2c)

@[20] 0x6078730a nnotes.UAFGetAccessGroupsExtend2@12+394 (2e7ee038,13b,0)

@[21] 0x60787d12 nnotes.UAFGetAccessGroupsExtend@8+18 (2e7ee038,13b)

@[22] 0x6033d8eb nnotes.AdminpReturnAccessLevelFlagsAndPrivileges@32+219 (2e7ee038,178b,2e7ee174,2e7ee288,0,2e7ee140,f10f10,ffffffff)

@[23] 0x60727410 nnotes.CPolicy::CheckPolicySignerRoles+112 (358d7018,1c7,2e7ee4b8,358d7018)

@[24] 0x6072aaba nnotes.CPolicy::CheckSignature+746 (358d7018,1c7,0,1)

@[25] 0x6072ddb7 nnotes.CPolicy::ProcessMPLookupForSPUNID+1127 (57018,b0,4,2e7eee08)

@[26] 0x6072fab8 nnotes.CPolicy::BuildEffectivePolicy+1224 (178b,2e7ef318,60cac544,0)

@[27] 0x60731426 nnotes.CPolicy::GetPolicy+1606 (358d7018,2e7ef8d8,0,2e7ef544)

@[28] 0x60731e71 nnotes.NAMEGetPolicyExt2@60+321 (2e7ef8d8,0,2e7ef544,0,0,2e7ef484,f10f10,ffffffff,0,0,0,0,0,0,0)

@[29] 0x60732032 nnotes.NAMEGetPolicyExt@56+66 (2e7ef8d8,2e7ef544,0,0,0,2e7ef4c8,f10f10,ffffffff,0,0,0,0,0,0)

@[30] 0x607325b8 nnotes.NAMEGetPolicy@40+56 (2e7ef8d8,2e7ef544,0,0,0,2e7ef508,f10f10,ffffffff,0,0)

@[31] 0x60acce83 nnotes.LookupABPIandKeys@112+803 (2,2e7ef8d8,1f,4162e4e8)

@[32] 0x60acd0b9 nnotes.FindABPIandKeys@112+201 (2e7ef8d8,1f,4162e4e8,60f30088)

@[33] 0x60acd1fd nnotes.CheckABPublicInfo@112+301 (0,54aecff8,2e7efa14,2e7ef8d8)

@[34] 0x60132016 nnotes.LookupABPI@8+646 (fb80,0)

@[35] 0x60131a21 nnotes.Parse_DistName@8+241 (2e7efb80,1)

@[36] 0x60ae233f nnotes.AuthServerDialog@12+2207 (2e7efb80,1,54ae0000)

@[37] 0x600becd6 nnotes.AuthStateMachine@4+342 (2e7efb80)

@[38] 0x60ac0107 nnotes.AUTHProcessNetbfr@16+199 (fec80062,10025190,2e7efe58,2e7efc10)

@[39] 0x10020d3a nserverl.DbServer@8+1226 (dda40493,33c80064)

@[40] 0x10035d1b nserverl.WorkThreadTask@8+1611 (22764944,0)

@[41] 0x10001a2e nserverl.Scheduler@4+750 (0)

@[42] 0x600fe5af nnotes.ThreadWrapper@4+175 (0)

[43] 0x77e64829 kernel32.GetModuleHandleA+223 (0,0,0,0)

Virtual Thread ID: 235c: 00bd

.Mapped To: PThread [ nSERVER: 235c: 10d0]

.Description: Thread pool member on TCPIP

… SOBJ: addr=0x35001c00, h=0xf01042d1 t=0xc93c (BLK_SRV_HASH_TBL)

… SOBJ: addr=0x0103a66c, h=0xf010419e t=0xc130 (BLK_TLA)

… Task: TaskID=[179: 56728], VThread: [ nSERVER: 235c: 00bd]

… using: IOCP h=471597057, VThread [ nSERVER: 235c: 0011]

Virtual Thread ID: 235c: 0115

.Mapped To: PThread [ nSERVER: 235c: 10d0]

… using: Primal Thread [ nSERVER: 235c: 00bd]

… SOBJ: addr=0x01078810, h=0xf010428a t=0xc30a (BLK_LOOKUP_THREAD)

… SOBJ: addr=0x01078638, h=0xf0104289 t=0xc130 (BLK_TLA)

… SOBJ: addr=0x22755544, h=0xf010428b t=0xc275 (BLK_NSFT)

… Database: E:\Notes\sthmail07\names.nsf

… DBH: 305, By: , WasAccessed=Yes

… view: hCol=313, cg=Y, noteID=173446, ($Policies)

… DBH: 466, By: , WasAccessed=Yes

… view: hCol=425, cg=Y, noteID=570, ($ServersLookup)

… DBH: 460, By: , WasAccessed=Yes

… view: hCol=468, cg=Y, noteID=302, ($Groups)

… DBH: 480, By: , WasAccessed=Yes

… view: hCol=453, cg=Y, noteID=1270, ($ServerAccess)

… DBH: 477, By: , WasAccessed=Yes

… view: hCol=485, cg=Y, noteID=458, ($Locations)

… DBH: 475, By: , WasAccessed=Yes

… view: hCol=482, cg=Y, noteID=850, ($Programs)

… DBH: 476, By: , WasAccessed=Yes

… view: hCol=490, cg=Y, noteID=302, ($Groups)

… DBH: 488, By: , WasAccessed=Yes

… view: hCol=491, cg=Y, noteID=290, ($Connections)

… DBH: 2623, By: , WasAccessed=Yes

… view: hCol=2013, cg=Y, noteID=858, ($Users)

… DBH: 2757, By: , WasAccessed=Yes

… view: hCol=2760, cg=Y, noteID=858, ($Users)

… DBH: 9468, By: , WasAccessed=Yes

… view: hCol=9459, cg=Y, noteID=858, ($Users)

… file: fd: 312, E:\Notes\sthmail07\IBM_TECHNICAL_SUPPORT\console.log

Btw, thanks for your response.

Much appreciated.

max

Subject: Apparently a bug in 8.5 &8.5.1

We have requested a HF via PMR.Will post more later.

Subject: On 8.5.1fp1…

…and no crashes.A memory issue, we really should have known.

Subject: adminp crashing domino 8.5 server

Ina,

Have you got any workarounds as we do not have 8.5.1 installed yet?

Regards,

Helle