Can’t figure it out why now and then, +/- 10 times a month my domino server on a windows server 2003 SP1 is crashing at a specific time.What I know is dat a domino synchronize agent runs at that time, the agent exports data to a SQL database on an other windows server.
Sometimes the agent runs, sometimes it does not.
What I notice in the dump is: “ACCESS_VIOLATION (3221225477)”.
Hope you can help me.
The NSD log Fatal Error (1 to 6 thread):
############################################################
FATAL THREAD 1/6 [ namgr: 1528: 0efc]
FP=0x0012d818, PC=0x0fd02204, SP=0x0012d810
stkbase=00130000, total stksize=45056, used stksize=10224
EAX=0x6f727245, EBX=0x00000000, ECX=0x00000001, EDX=0x00000003
ESI=0x3cfc00f4, EDI=0x00000000, CS=0x0000001b, SS=0x00000023
DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00010297
Exception code: c0000005 (ACCESS_VIOLATION)
############################################################
@[ 1] 0x0fd02204 NDCAPI.memcpy+308 (0,3cfc00f4,7,e83d48)
@[ 2] 0x0fceb813 NDCAPI.StreamTranslate+419 (e83d48,3cfc00f4,100,12d890)
@[ 3] 0x0fce89cd NDCAPI.LCStreamConvert+157 (12d890,12d8a4,4,100)
@[ 4] 0x0fcf5822 NDCAPI.Native2String+98 (12d8d4,7,102,6f727245)
@[ 5] 0x0fcf58c3 NDCAPI.GetRes+83 (12e390,e83d48,102,0)
@[ 6] 0x0fcf5b1b NDCAPI.CreateLog+203 (e83d48,12e390,12e358,12e358)
@[ 7] 0x0fcf7f2c NDCAPI.SubmitLog+140 (0,1,12e390,0)
@[ 8] 0x0fcf843d NDCAPI.ActivityLog+221 (102,386f98,12e3f4,fcb1e94)
@[ 9] 0x0fcf85b3 NDCAPI.LCActivityLog+35 (102,102,fde0258,12e408)
@[10] 0x0fcb1e94 nlsxlc.LSXRaiseError+100 (102,1,fd53658,12e418)
@[11] 0x0fcb1f32 nlsxlc.LSXRaiseLCError+18 (386f98,102,12e480,fcb6dcd)
@[12] 0x0fcb30a0 nlsxlc.LSXBase::RaiseLCError+16 (102,0,fd53658,12e520)
@[13] 0x0fcb6dcd nlsxlc.Fieldlist::LSXDispatchMethod+2461 (fd53300,12e4f0,fe67b54,12e4ac)
@[14] 0x0fcba23b nlsxlc.LSXClassControl@16+347 (386f98,109,12e4d4,12e520)
@[15] 0x0fcb2fa9 nlsxlc.LSXBase::ClassControl+25 (fd53658,386f98,109,12e4d4)
@[16] 0x6004ecdd nnotes.LSsInstance::AdtCallBack+269 (386f98,fcba0e0,109,fe67b38)
@[17] 0x600644cd nnotes.LScObjCli::ProdMethodCall+61 (fe67af8,301,5de79e4,10003)
@[18] 0x600643d2 nnotes.LSsThread::AdtDoProdCallout+162 (fddfc28,fe67af8,10003,5de7998)
@[19] 0x600642ed nnotes.LSsThread::AdtCallMethod+45 (4,5dea840,1,2)
@[20] 0x60021939 nnotes.LSsThread::NRun+5705 (424fc28,0,4ee2114,0)
@[21] 0x600220a6 nnotes.LSsThread::Run+182 (fddfc28,12e65c,60a0f506,386f98)
@[22] 0x600a5bcd nnotes.LSsInstance::Resume+29 (386f98,4ee2114,12e688,60a0f1b8)
@[23] 0x60a0f506 nnotes.LSIThread::Run+86 (4ee2114,708,1,4ee2114)
@[24] 0x60a0f1b8 nnotes.LSIThread::RunInternal+72 (120002,708,b08b6,c1257402)
@[25] 0x60a0f42c nnotes.LSIThread::RunToCompletion+332 (4ee2114,708,1,4ec7854)
@[26] 0x60a0b28f nnotes.CLSIDocument::RunScript+639 (4eedf94,10,1,60ae0ae5)
@[27] 0x605a167a nnotes.CRawActionLotusScript::Run+554 (2c7d,4eb3394,0,12ee1c)
@[28] 0x6059daea nnotes.CRawAction::Run+58 (0,12f91c,0,12ee48)
@[29] 0x6059e6ad nnotes.CRawAction::Execute+221 (4ec6f54,0,12f624,6059bafb)
@[30] 0x60596b56 nnotes.CAssistant::RunAlone+22 (4ec8014,12f91c,12fb6c,4ecb1d4)
@[31] 0x6059bafb nnotes.CAssistant::Run+3595 (4ec8014,12f99c,12fb64,12fb6c)
@[32] 0x6313433b namgrdll.RunTask@32+2043 (1,2d2,0,0)
@[33] 0x6313466f namgrdll.ProcessRunMessage@4+63 (12fb64,12fc98,631348c5,12fb64)
@[34] 0x631346f1 namgrdll.ProcessMessage@4+33 (12fb64,3863a0,3862a4,3)
@[35] 0x631348c5 namgrdll.ExecutiveMain@4+261 (0,3,3862a4,7ffdc000)
@[36] 0x631395b2 namgrdll.AddInMain@12+306 (400000,3,3862a4,0)
@[37] 0x0040102f nAMgr.NotesMain@8+47 (3,400000,0,0)
@[38] 0x00401164 nAMgr.notes_main+212 (0,0,0,3)
@[39] 0x00401056 nAMgr.main+22 (3,314bb8,312998,403000)
@[40] 0x0040133d nAMgr.mainCRTStartup+323 (0,0,7ffdc000,f772f548)
[41] 0x77e523e5 KERNEL32.IsProcessorFeaturePresent+158 (4011fa,0,78746341,20)
Invalid stack frame detected: Invalid frame pointer (BP): 0
############################################################
PASS 2 : FATAL THREAD with STACK FRAMES 1/6 [ namgr: 1528: 0efc]
FP=0012d818, PC=0fd02204, SP=0012d810
stkbase=00130000, total stksize=45056, used stksize=10224
Exception code: c0000005 (ACCESS_VIOLATION)
############################################################
Disassembly of c. 10 instructions before and after faulting address fd02204:
Invalid stack frame detected: Invalid frame pointer (BP): 0
Generating core dump for [ nAMgr: 1528]
Generated core dump file d:\Lotus\Domino\Data\IBM_TECHNICAL_SUPPORT\core_nAMgr_W32I_thearch01_2008_03_04@02_31_05.dmp
############################################################
thread 2/6: [ namgr: 1528: 1218]
FP=0ab4ff10, PC=7c82ed54, SP=0ab4fea0
stkbase=0ab50000, total stksize=262144, used stksize=352
############################################################
[ 1] 0x7c82ed54 ntdll.KiFastSystemCallRet+0 (148,ffffffff,0,ab4ff54)
[ 2] 0x77e6ba42 KERNEL32.WaitForSingleObject+18 (148,ffffffff,19b36c4,19b3694)
@[ 3] 0x6009a006 nnotes.WaitOnNativeSemaphore@16+150 (141,ffffffff,0,0)
@[ 4] 0x600c6279 nnotes.OSWaitEvent@8+105 (19b36c4,0,3,0)
@[ 5] 0x60937ce3 nnotes.NAMELookupThread@4+195 (0,0,0,0)
@[ 6] 0x60103c30 nnotes.ThreadWrapper@4+208 (0,0,0,0)
[ 7] 0x77e6608b KERNEL32.GetModuleFileNameA+235 (60103b60,0,0,c8)
############################################################
thread 3/6: [ namgr: 1528: 0674]
FP=3854ff24, PC=7c82ed54, SP=3854feb4
stkbase=38550000, total stksize=262144, used stksize=332
############################################################
[ 1] 0x7c82ed54 ntdll.KiFastSystemCallRet+0 (4a4,1f4,0,3854ff68)
[ 2] 0x77e6ba42 KERNEL32.WaitForSingleObject+18 (4a4,1f4,f86f78,f86f78)
@[ 3] 0x6009a006 nnotes.WaitOnNativeSemaphore@16+150 (17c,1f4,1f4,0)
@[ 4] 0x600c6279 nnotes.OSWaitEvent@8+105 (f86f78,1f4,0,60103c30)
@[ 5] 0x6018a34b nnotes.AutoFDGCleanupThreadProc@4+59 (0,0,0,0)
[ 6] 0x77e6608b KERNEL32.GetModuleFileNameA+235 (60103b60,0,0,dddd04d2)
############################################################
thread 4/6: [ namgr: 1528: 1e64]
FP=3834ff84, PC=7c82ed54, SP=3834fe1c
stkbase=38350000, total stksize=4096, used stksize=484
############################################################
[ 1] 0x7c82ed54 ntdll.KiFastSystemCallRet+0 (3834ffac,77c5f7e3,17c598,0)
[ 2] 0x77c5778c RPCRT4.NdrOleFree+965 (17c598,0,0,1726d8)
[ 3] 0x77c5f7e3 RPCRT4.I_RpcTransGetThreadEvent+390 (14ef00,3834ffec,77e6608b,1726d8)
[ 4] 0x77c5de88 RPCRT4.I_RpcLogEvent+3730 (1726d8,0,0,1726d8)
[ 5] 0x77e6608b KERNEL32.GetModuleFileNameA+235 (77c5de6d,1726d8,0,dddd04d2)
Invalid stack frame detected: Return address invalid: NULL
############################################################
thread 5/6: [ namgr: 1528: 0318]
FP=3874ffb8, PC=7c82ed54, SP=3874ff80
stkbase=38750000, total stksize=4096, used stksize=128
############################################################
[ 1] 0x7c82ed54 ntdll.KiFastSystemCallRet+0 (71b268c0,0,0,16c248)
[ 2] 0x77e6608b KERNEL32.GetModuleFileNameA+235 (0,0,0,0)
Invalid stack frame detected: Return address invalid: NULL
############################################################
thread 6/6: [ namgr: 1528: 1b4c]
FP=3840fff4, PC=7c822584, SP=3840ffcc
stkbase=38410000, total stksize=16384, used stksize=52
############################################################
[ 1] 0x7c822584 ntdll.DbgBreakPoint+1 (0,0,0,0)
Invalid stack frame detected: Return address invalid: NULL
Memory check:
<@@ ------ Notes Memory Analyzer (memcheck) → Pool Analysis → Mapping static objects in STATIC POOL Block → Static Pool → Global Object HashTable (Time 02:31:42) ------ @@>
indx [Proc:ProcID:ThreadID] Handle Address Type TypeName NameLen Name
1 [ : 0000] 0xf0240065 0x00000000 0x11c3 BLK_COOKIE_SLCB 0 ‘’
2 [ : 0000] 0xf02401ea 0x00000000 0x3319 BLK_CSU_KFC 0 ‘’
3 [ : 0000] 0xf024004f 0x00000000 0x0a04 BLK_NET 0 ‘’
4 [ : 0000] 0xf02400f3 0x00000000 0x1509 BLK_EVT 0 ‘’
5 [ : 0000] 0xf02401eb 0x00000000 0x330c ??? 0 ‘’
6 [ : 0000] 0xf0240189 0x00000000 0x330a ??? 0 ‘’
7 [ : 0000] 0xf02401c5 0x00000000 0x3311 ??? 0 ‘’
8 [ : 0000] 0xf0240051 0x00000000 0x030f BLK_NIF 0 ‘’
9 [ : 0000] 0xf0240009 0x00000000 0x0f6f BLK_SERVER_ACL 0 ‘’
10 [ : 0000] 0xf02400a4 0x00000000 0x1127 BLK_MAIL_ENV 0 ‘’
11 [ : 0000] 0xf02400a0 0x00000000 0x1130 BLK_MAIL_STORAGE_MGR_CONTEXT 0 ‘’
12 [ : 0000] 0xf02401da 0x00000000 0x337c ??? 0 ‘’
13 [ : 0000] 0xf0240002 0x00000000 0x0416 BLK_MISC 0 ‘’
14 [ : 0000] 0xf024007a 0x00000000 0x0934 BLK_SV_STATS 13 ‘SrvStatistics’
15 [ : 0000] 0xf024027c 0x00000000 0x042c BLK_LSIWRAP 0 ‘’
16 [ : 0000] 0xf02401ed 0x00000000 0x3310 ??? 0 ‘’
17 [ : 0000] 0xf0240230 0x00000000 0x29c9 BLK_SRV_PLATSTATS_CTX 0 ‘’
18 [ : 0000] 0xf0240010 0x00000000 0x024c BLK_NSF 0 ‘’
ERROR (0): exception(0):
NSD thread 1f2c got system exception: ACCESS_VIOLATION (3221225477)
ERROR (0): failed while checking type 0x8141 memory