Server crash on nhttp task

I have installed two servers with Domino server 8.5 and both server keeps rebooting several times based on the nhttp task stack from 1am - 2am every night. I used Lotus Notes Diagnostic tool to analyze the problem and it has sent me to this tech note bellow. I am looking for a solution to stop this. Please help if you have any info.

LO38802: SERVER CRASH ON NHTTP TASK

Subject: SERVER CRASH ON NHTTP TASK- Fatal thread

Hi,

Is your FATAL THREAD identical as the one providided in your link?

Can you post the FATAL THREAD section of the NSD files with the few lines under it

For example:

############################################################

FATAL THREAD 1/2 [ domdsm:107a8:67076]

FP=0x0012a34c, PC=0x60069a86, SP=0x0012a2f0, stksize=92

EAX=0x01a3088c, EBX=0x01a48650, ECX=0x0000bffe, EDX=0x01a325e6

ESI=0x00004000, EDI=0x0032ff78, CS=0x0000001b, SS=0x00000023

DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00010206

Exception code: c0000005 (ACCESS_VIOLATION)

############################################################

@[ 1] 0x60069a86 nnotes._fdDelete@4+118 (4000,12a368,608770ef,4000)

@[ 2] 0x60069a0c nnotes._OSFileClose@4+12 (4000,12adc0,12a380,60872ea7)

@[ 3] 0x608770ef nnotes._sqloclose+15 (4000,12b59c,5010,0)

@[ 4] 0x60872ea7 nnotes._sqlpgclf+71 (12adc0,1aaa2cb,70,1aaa2f3)

@[ 5] 0x60885458 nnotes._sqlpgfdl+616 (12b9a4,1aaa2cb,41,12be44)

@[ 6] 0x60876a6f nnotes._sqlpgcdl+927 (12bf44,12b9a4,0,12be44).

Date

Topic

Frequently asked question - How to analyze Notes/Domino NSDs? (Jean-Yves Riverin)

call IBM support

JYR

Subject: SERVER CRASH ON NHTTP TASK- Fatal thread

the Critical lines are 10,11,12

@[10] 0x60177f50 nnotes.LockHandleExt@16+320 (1740226,12cad8,12cadc,0)

@[11] 0x601780a3 nnotes.OSLockObjectExt@8+35 (1c20014,60fef520)

@[12] 0x6000296e nnotes.OSLockObject@4+14 (1740226)

Thanks for your Help in Advance!


Build: 8.5FP1 (32-bit server

Host Name: SMTP

Date: Tue Sep 15 01:02:13 2009

############################################################

thread 1/2: [ nDesign: 1750: 1204] FATAL THREAD (Panic)

FP=0x0012a7f0, PC=0x77265e74, SP=0x0012a780

stkbase=0x00130000, total stksize=32768, used stksize=22656

EAX=0x00000072, EBX=0x0012b3c0, ECX=0x0012a424, EDX=0x773ab1b0

ESI=0x0012a7c8, EDI=0x00000000, CS=0x0000001b, SS=0x00000023

DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00000297

############################################################

[ 1] 0x77265e74 ntdll.KiFastSystemCallRet+0 (288,493e0,0,12afa0)

[ 2] 0x773a97f2 kernel32.WaitForSingleObject+18 (288,493e0,12b734,12b3ea)

@[ 3] 0x601a28c5 nnotes.FRSendCommandToService+789 (12afc0,12b3c0,12b3ea,5)

@[ 4] 0x601a34ff nnotes.OSRunExternalScript@8+1055 (12c,1)

@[ 5] 0x601a3a7f nnotes.FRTerminateWindowsResources+975 (1,1010,1,0)

@[ 6] 0x601a3e48 nnotes.OSFaultCleanupExt@24+888 (1c66a14,1010,0,0,0,12ba5c)

@[ 7] 0x601a3eca nnotes.OSFaultCleanup@12+26 (0,1010,0)

@[ 8] 0x601af374 nnotes.OSNTUnhandledExceptionFilter@4+276 (12ca94)

@[ 9] 0x60173b26 nnotes.Panic@4+534 (60c85ff7)

@[10] 0x60177f50 nnotes.LockHandleExt@16+320 (1740226,12cad8,12cadc,0)

@[11] 0x601780a3 nnotes.OSLockObjectExt@8+35 (1c20014,60fef520)

@[12] 0x6000296e nnotes.OSLockObject@4+14 (1740226)

@[13] 0x60b6d4b3 nnotes.EnumDesignEntries@20+35 (1740226,1,60b5f950,12d3f0,0)

@[14] 0x60b54acd nnotes.EnumDesignEntryArray@20+45 (ef0023,12d400,60b5f950,12d3f0,0)

@[15] 0x60b632d8 nnotes.ReplaceDesignExtended@80+5176 (170,1f,226a113,174,0,12e510,f10f10,ffffffff,0,0,0,0,0,0,0,0,0,0,0,0)

@[16] 0x60b55816 nnotes.RefreshReplaceEnumProc@8+262 (12f100,12e590)

@[17] 0x608aa2b6 nnotes.TraverseIndex@12+150 (12e6d0,226a140,2260000)

@[18] 0x6068003f nnotes.traverse@8+175 (12e69c,22a9001)

@[19] 0x606800c3 nnotes.traverse@8+307 (12e69c,2085401)

@[20] 0x606800c3 nnotes.traverse@8+307 (12e69c,2104c01)

@[21] 0x606800c3 nnotes.traverse@8+307 (12e69c,1bdc01)

@[22] 0x6068000a nnotes.traverse@8+122 (12e69c,2030001)

@[23] 0x606801a4 nnotes.IndexTraverse@24+84 (12e6d0,2,1200f8,1,0,12e6ac)

@[24] 0x608aad3d nnotes.NSFDbIndexEnumExt@16+77 (2,60b55710,12f100,0)

@[25] 0x608aada6 nnotes.NSFDbIndexEnum@12+22 (2,60b55710,12f100)

@[26] 0x60b561c9 nnotes.RefreshDatabase@20+505 (12f100,174,169,226b475,0)

@[27] 0x60b567c3 nnotes.RefreshEnumProc@8+163 (12f100,12eec0)

@[28] 0x608aa2b6 nnotes.TraverseIndex@12+150 (12f078,226b4a0,2260000)

@[29] 0x6068003f nnotes.traverse@8+175 (12f044,3df001)

@[30] 0x606800c3 nnotes.traverse@8+307 (12f044,289801)

@[31] 0x606800c3 nnotes.traverse@8+307 (12f044,a9801)

@[32] 0x6068000a nnotes.traverse@8+122 (12f044,3e7401)

@[33] 0x6068000a nnotes.traverse@8+122 (12f044,27801)

@[34] 0x6068000a nnotes.traverse@8+122 (12f044,b9801)

@[35] 0x606800c3 nnotes.traverse@8+307 (12f044,16001)

@[36] 0x606800c3 nnotes.traverse@8+307 (12f044,2030001)

@[37] 0x606801a4 nnotes.IndexTraverse@24+84 (12f078,2,1200f8,1,0,12f054)

@[38] 0x608aad3d nnotes.NSFDbIndexEnumExt@16+77 (2,60b56720,12f100,0)

@[39] 0x608aada6 nnotes.NSFDbIndexEnum@12+22 (2,60b56720,12f100)

@[40] 0x60b5693c nnotes.DesignRefreshAllInt@12+284 (0,60c83b41,12f100)

@[41] 0x60b56b0c nnotes.DesignRefreshAll@20+108 (0,0,0,401000,0)

@[42] 0x004014bf nDesign.AddInMain@12+959 (400000,1,19570f4)

@[43] 0x0040190f nDesign.NotesMain@8+47 (1,400000)

@[44] 0x00401a44 nDesign.notes_main+212 (0,0,0,1)

@[45] 0x00401936 nDesign.main+22 (1,1931390,19313d0,94)

@[46] 0x00401d73 nDesign.mainCRTStartup+364 (7ffdf000,12ffd4,772419bb,7ffdf000)

[47] 0x773ad0e9 kernel32.BaseThreadInitThunk+18 (7ffdf000,76b5e714,0,0)

[48] 0x772419bb ntdll.RtlInitializeExceptionChain+99 (401c07,7ffdf000,0,0)

[49] 0x7724198e ntdll.RtlInitializeExceptionChain+54 (401c07,7ffdf000,0,78746341)

Subject: That NSD shows the Design Task as the Crash

thread 1/2: [ nDesign: 1750: 1204] FATAL THREAD (Panic)

Looks like same problem as this SPR to me

JSDW7PSD4L: Mail85: replace design from Domino server with SLP installed for more than 4 languages, Notes Client will crash.

I suggest opening PMR with Lotus Support, send them the nsd and reference the SPR above and ask for a Hot Fix for that issue… It has been fixed in Release 8.5.1 which has not shipped yet but should sometime in October…

For now, you could also comment out the Design Task in ServerTasksAt1=

and that should keep you from crashing until you get the fix…

jpaganet@us.ibm.com

Subject: commented out the Design Task

I commented out the Design Task now my servers and now they are stable. I will wait for 8.5.1 for a full fix. I just hope 8.5.1 fixes the problem.

Thanks for your help!!!

Subject: 2nd server - SERVER CRASH ON NHTTP TASK- Fatal thread

I have a another server with the same issueIt’s has the same Critical problems on lines 10,11 and 12.

@[10] 0x60177f50 nnotes.LockHandleExt@16+320 (1520113,12cae8,12caec,0)

@[11] 0x601780a3 nnotes.OSLockObjectExt@8+35 (af0014,60fef520)

@[12] 0x6000296e nnotes.OSLockObject@4+14 (1520113)

Thanks for Help in advance.


Build: 8.5FP1 (32-bit server

Host Name: XMAIL

Date: Tue Sep 15 01:21:04 2009

############################################################

thread 1/4: [ nDesign: 10d8: 0e50] FATAL THREAD (Panic)

FP=0x0012a800, PC=0x7c82860c, SP=0x0012a790

stkbase=0x00130000, total stksize=36864, used stksize=22640

EAX=0x7ffa2f30, EBX=0x0012b3d0, ECX=0x00000000, EDX=0x7c82860c

ESI=0x000003b0, EDI=0x00000000, CS=0x0000001b, SS=0x00000023

DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00000293

############################################################

[ 1] 0x7c82860c ntdll.KiFastSystemCallRet+0 (3b0,927c0,0,12afb0)

[ 2] 0x77e61c8d kernel32.WaitForSingleObject+18 (3b0,927c0,12b744,12b3fa)

@[ 3] 0x601a28c5 nnotes.FRSendCommandToService+789 (12afd0,12b3d0,12b3fa,5)

@[ 4] 0x601a34ff nnotes.OSRunExternalScript@8+1055 (258,1)

@[ 5] 0x601a3a7f nnotes.FRTerminateWindowsResources+975 (1,1010,1,0)

@[ 6] 0x601a3e48 nnotes.OSFaultCleanupExt@24+888 (b36a14,1010,0,0,0,12ba6c)

@[ 7] 0x601a3eca nnotes.OSFaultCleanup@12+26 (0,1010,0)

@[ 8] 0x601af374 nnotes.OSNTUnhandledExceptionFilter@4+276 (12caa4)

@[ 9] 0x60173b26 nnotes.Panic@4+534 (60c85ff7)

@[10] 0x60177f50 nnotes.LockHandleExt@16+320 (1520113,12cae8,12caec,0)

@[11] 0x601780a3 nnotes.OSLockObjectExt@8+35 (af0014,60fef520)

@[12] 0x6000296e nnotes.OSLockObject@4+14 (1520113)

@[13] 0x60b6d4b3 nnotes.EnumDesignEntries@20+35 (1520113,1,60b5f950,12d400,0)

@[14] 0x60b54acd nnotes.EnumDesignEntryArray@20+45 (ef0023,12d410,60b5f950,12d400,0)

@[15] 0x60b632d8 nnotes.ReplaceDesignExtended@80+5176 (12e,22,113d74b,152,0,12e520,f10f10,ffffffff,0,0,0,0,0,0,0,0,0,0,0,0)

@[16] 0x60b55816 nnotes.RefreshReplaceEnumProc@8+262 (12f138,12e5a0)

@[17] 0x608aa2b6 nnotes.TraverseIndex@12+150 (12e758,113d778,1130000)

@[18] 0x6068003f nnotes.traverse@8+175 (12e724,62fc01)

@[19] 0x6068000a nnotes.traverse@8+122 (12e724,68e001)

@[20] 0x6068000a nnotes.traverse@8+122 (12e724,16b0801)

@[21] 0x606800c3 nnotes.traverse@8+307 (12e724,12e5c01)

@[22] 0x606800c3 nnotes.traverse@8+307 (12e724,10fc801)

@[23] 0x606800c3 nnotes.traverse@8+307 (12e724,15401)

@[24] 0x6068000a nnotes.traverse@8+122 (12e724,35401)

@[25] 0x6068000a nnotes.traverse@8+122 (12e724,10b8401)

@[26] 0x606801a4 nnotes.IndexTraverse@24+84 (12e758,2,1200f8,1,0,12e734)

@[27] 0x608aad3d nnotes.NSFDbIndexEnumExt@16+77 (2,60b55710,12f138,0)

@[28] 0x608aada6 nnotes.NSFDbIndexEnum@12+22 (2,60b55710,12f138)

@[29] 0x60b561c9 nnotes.RefreshDatabase@20+505 (12f138,152,14e,113f02d,0)

@[30] 0x60b567c3 nnotes.RefreshEnumProc@8+163 (12f138,12ef48)

@[31] 0x608aa2b6 nnotes.TraverseIndex@12+150 (12f0b0,113f050,1130000)

@[32] 0x6068003f nnotes.traverse@8+175 (12f07c,7bd401)

@[33] 0x6068000a nnotes.traverse@8+122 (12f07c,1e001)

@[34] 0x6068000a nnotes.traverse@8+122 (12f07c,1aac01)

@[35] 0x6068000a nnotes.traverse@8+122 (12f07c,32c801)

@[36] 0x6068000a nnotes.traverse@8+122 (12f07c,3f6401)

@[37] 0x606800c3 nnotes.traverse@8+307 (12f07c,10b8401)

@[38] 0x606801a4 nnotes.IndexTraverse@24+84 (12f0b0,2,1200f8,1,0,12f08c)

@[39] 0x608aad3d nnotes.NSFDbIndexEnumExt@16+77 (2,60b56720,12f138,0)

@[40] 0x608aada6 nnotes.NSFDbIndexEnum@12+22 (2,60b56720,12f138)

@[41] 0x60b5693c nnotes.DesignRefreshAllInt@12+284 (0,60c83b41,12f138)

@[42] 0x60b56b0c nnotes.DesignRefreshAll@20+108 (0,0,0,401000,0)

@[43] 0x004014bf nDesign.AddInMain@12+959 (400000,1,3c521c)

@[44] 0x0040190f nDesign.NotesMain@8+47 (1,400000)

@[45] 0x00401a44 nDesign.notes_main+212 (0,0,0,1)

@[46] 0x00401936 nDesign.main+22 (1,3d2ae8,3d2b28,94)

@[47] 0x00401d73 nDesign.mainCRTStartup+364 (0,0,7ffdf000,0)

[48] 0x77e6f23b kernel32.ProcessIdToSessionId+521 (401c07,0,78746341,20)