Complete Domino 8.5.1 Server Crash caused by HTTP task - Reproducible

I’ve been testing dynamic signatures for use in both the Notes client and from the web (iNotes) and came across a reproducible Domino server crash.

I setup the email signature in the CalendarProfile document (from the Notes 8.5.1 FP2 client) using Image Resources instead of Inline Images.

I’ve set the ‘SignatureType’ field in the iNotesProfile document to ‘2’ (ie. Use Notes signature).

When I access my mailfile from a web browser the Domino server crashes immediately!

Alex


############################################################

thread 16/57: [ nHTTP: 07f4: 1178] FATAL THREAD (Panic)

FP=0x11211bb4, PC=0x7c82860c, SP=0x11211b44

stkbase=0x11220000, total stksize=262144, used stksize=58556

EAX=0x0ea20000, EBX=0x00000000, ECX=0x11210eac, EDX=0x00002000

ESI=0x00000a54, EDI=0x00000000, CS=0x0000001b, SS=0x00000023

DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00000293

############################################################

[ 1] 0x7c82860c ntdll.KiFastSystemCallRet+0 (a54,927c0,0,1121213c)

[ 2] 0x77e61c8d kernel32.WaitForSingleObject+18 (a54,927c0,5,11212358)

@[ 3] 0x601b5c94 nnotes.OSRunExternalScript@8+1300 (258,1)

@[ 4] 0x601b611f nnotes.FRTerminateWindowsResources+975 (1,1010,1,0)

@[ 5] 0x601b6548 nnotes.OSFaultCleanupExt@24+984 (eb6a68,1010,0,0,0,11212680)

@[ 6] 0x601b65ca nnotes.OSFaultCleanup@12+26 (0,1010,0)

@[ 7] 0x601c1b74 nnotes.OSNTUnhandledExceptionFilter@4+276 (112136b8)

@[ 8] 0x601847dd nnotes.Panic@4+589 (60d1b2b7)

@[ 9] 0x60002d55 nnotes.LockMemHandle@12+37 (7ff23800,112136f8,0)

@[10] 0x60002e94 nnotes.OSMemoryUnlock@4+20 (7ff23800)

@[11] 0x6000d157 nnotes.OSLocalFree@4+167 (1121682c)

@[12] 0x00485b30 NINOTES.INProcessNotesLocalMemory::Deallocate+16 (1121682c,0,112137d8,50cadd)

@[13] 0x004aadf7 NINOTES.NDatabase::`scalar deleting destructor’+23 (1,11213b64,60fe0998,60fe0948)

@[14] 0x0050cadd NINOTES.RefObject::DelRef+109 (112147fb,1,11213b64,6a5550)

@[15] 0x0041f6ab NINOTES.CDtoHTMLtranslator::ProcessOtherGraphicCDRecords+427 (0,77e620e0,0,1c007d)

@[16] 0x0041fe18 NINOTES.CDtoHTMLtranslator::Process_CDIMAGEHEADER+408 (2c265b3a,11213b64,431179,1)

@[17] 0x0042f664 NINOTES.CDtoHTMLtranslator::Dispatch+804 (112155e4,0,1,1)

@[18] 0x006364f8 NINOTES.ShimmerProfileGetField+728 (18d,16d628e,1121000f,16d62b6)

@[19] 0x005575b3 NINOTES.Haiku::GetProfileField+259 (1121bd20,5,0,a750)

@[20] 0x00550e46 NINOTES.Haiku::AtFuncDispatch::ExecuteDbCommand+118 (11218f80,1121bd20,25,5)

@[21] 0x00551d3a NINOTES.Haiku::ExecuteDbCommand+42 (1121bd20,25,5,1121a6ec)

@[22] 0x005974f9 NINOTES.HuDocNote::AddHaikuDbCommand+1065 (25,3e9431d5,1,0)

@[23] 0x0060beaf NINOTES.ShBuiltInNameSpaceTag::Write+79 (1121bdfe,242198ae,3e986018,1121bd20)

@[24] 0x005b6024 NINOTES.HuLayout::WriteContents+68 (1121bdfe,3e986040,1121ad08,5688f0)

@[25] 0x005938dd NINOTES.HuDocNote::GenerateHTML+109 (3e986040,1121bd20,1121bd18,f85c018)

@[26] 0x005688f0 NINOTES.Haiku::GenerateHtml+544 (f85c018,24215018,f85c0d1,0)

@[27] 0x0058377b NINOTES.Haiku::HandleDominoCmd+363 (f85c018,f85c018,b96d018,77e620e0)

@[28] 0x00578a21 NINOTES.Haiku::HandleCmd+721 (f85c018,b96d018,0,f85c018)

@[29] 0x004453d6 NINOTES.CmdHandlerBase::PrivHandle+102 (f85c018,0,0,b96d018)

@[30] 0x00443a4d NINOTES.CmdHandler::PrivHandle+141 (f85c018,f85c018,24213018,0)

@[31] 0x00444688 NINOTES.CmdHandler::Handler+216 (f85c018,b96d018,f85c034,46)

@[32] 0x0043a4aa NINOTES.Cmd::Execute+58 (148131c,1481030,1481764,6a7ad8)

@[33] 0x00482cc5 NINOTES.InotesHTTPProcessRequestImpl+2005 (148132c,148131c,1481030,1481764)

@[34] 0x0048535f NINOTES.InotesHTTPProcessRequest+47 (148132c,3,1121f5e8,623d5a06)

@[35] 0x10017644 nhttpstack.HTInotesRequest::ProcessRequest+36 (1481030,1480ec4,0,1121f9a4)

@[36] 0x10011e0d nhttpstack.HTRequestExtContainer::ProcessRequest+941 (5,1,1016c2a8,0)

@[37] 0x1002356f nhttpstack.HTRequest::ProcessRequest+1919 (0,f8cb5ba,0,69616d2f)

@[38] 0x10028bac nhttpstack.HTSession::StartRequest+908 (f8cb5c6,f8cb5ba,0,5a0)

@[39] 0x100302ff nhttpstack.HTWorkerThread::CheckForWork+399 (1472ee8,f8cb5ba,3,1002cc8a)

@[40] 0x10030868 nhttpstack.HTWorkerThread::ThreadMain+88 (f8cb5ba,0,0,0)

@[41] 0x6010dadf nnotes.ThreadWrapper@4+175 (0)

[42] 0x77e6482f kernel32.GetModuleHandleA+223 (0,0,0,0)

Subject: (Solved) Similar problem with different log

We had a similar problem recently - when one of our employee tried to login to iNotes - our mail server (v8.5.1 FP4) immediately crushed.

In your case it’s looks like you have a problem with “LockMemHandle”, but I’ll post details of our case anyway - may be it will help someone. :slight_smile:

After a small investigation we’d found out that in our case the reason was that we’d modified a little bit mail template and added a hiding formula to “Signature_Rich” rich-text field in calendar profile document:

@IsNotMember(“LocalDomainAdmins”; @UserNamesList)

So, when employee was entering iNotes, server tried to calculate this formula and crushed with this log:

############################################################

FATAL THREAD 20/59 [ nhttp: 0548: 06d8]

FP=0x20e108b8, PC=0x60001706, SP=0x20e108ac

stkbase=20e20000, total stksize=262144, used stksize=63316

EAX=0x000006d8, EBX=0x000006d8, ECX=0x00000000, EDX=0x20e10988

ESI=0x000000ae, EDI=0x00000548, CS=0x0000001b, SS=0x00000023

DS=0x00000023, ES=0x00000023, FS=0x0000003b, GS=0x00000000 Flags=0x00010202

Exception code: c0000005 (ACCESS_VIOLATION)

############################################################

@[ 1] 0x60001706 nnotes.OSLockWriteSem@4+22 (ae)

@[ 2] 0x00415d6f ninotes.UserInfo::GetGroupList+47 (0)

@[ 3] 0x004c3b04 ninotes.NFormula::SetUpFallbackExtensionInfo+116 (460e3ef4)

@[ 4] 0x004c9b36 ninotes.INotesCompExtProc@36+102 (460e5ef4,20e12708,107,0,0,0,0,0,0)

@[ 5] 0x600bacaa nnotes.CompGeneralContext::ExtensionProc+298 (460e5ef4,107,0,0,0,0,0,0,0)

@[ 6] 0x600bb1e5 nnotes.ExtensionProc::Execute+229 (460e60d8,460e60a0,460e602c,600014a4,0,0,0,0,0)

@[ 7] 0x600463c2 nnotes.AtFunctionNode::ComputeVariants+82 (460e60d8,460e602c,460e602c,0,0,0,0,0,0)

@[ 8] 0x600463a7 nnotes.AtFunctionNode::ComputeVariants+55 (460e610c,460e602c,460e602c,a341,0,0,0,0,0)

@[ 9] 0x60045926 nnotes.MainExpressionNode::ComputeVariants+54 (0,460e5ef4,1,20e10fd8,0,0,0,0,0)

@[10] 0x600465f1 nnotes.RootNode::ComputeVariants+81 (460e3ef4,460e5ef4,20e126ec,4c2ad0,0,0,0,0,0)

@[11] 0x600461df nnotes.Compute::Eval+159 (20e12514,20e12708,77e620e0,0,0,0,0,0,0)

@[12] 0x600ba955 nnotes.NSFComputeEvaluateExt@32+181 (460e5ef4,a341,20e125a1,20e124e4,0,0,0,0)

@[13] 0x004c728d ninotes.NFormula::Evaluate+141 (20e12514,20e126ec,460e3874,2,0,0,0,0)

@[14] 0x004c75a5 ninotes.NFormula::Evaluate+69 (460e3874,460e5ef4,20e17968,60dbca7c,0,0,0,0)

@[15] 0x004a593f ninotes.NCDPabDef::evalHideFormula+111 (227a8282,20e17968,77e620e0,20e13a4c,0,0,0,0)

@[16] 0x004a5aaf ninotes.NCDPabDef::SetHideFormula+63 (227a8282,20e17968,0,40ffbb,0,0,0,0)

@[17] 0x004278f0 ninotes.CDtoHTMLtranslator::Process_CDPABHIDE+64 (227a8282,20e13a4c,431199,1,0,0,0,0)

@[18] 0x0042f654 ninotes.CDtoHTMLtranslator::Dispatch+612 (20e155e4,0,1,1,0,0,0,0)

@[19] 0x00636e38 ninotes.ShimmerProfileGetField+728 (28e,bfdb782,20e1000f,2e14cd1a,0,0,0,0)

@[20] 0x00557b23 ninotes.Haiku::GetProfileField+259 (20e1bd20,5,0,a750,0,0,0,0)

@[21] 0x005513f6 ninotes.Haiku::AtFuncDispatch::ExecuteDbCommand+118 (20e18f80,20e1bd20,25,5,0,0,0,0)

@[22] 0x005522aa ninotes.Haiku::ExecuteDbCommand+42 (20e1bd20,25,5,20e1a6ec,0,0,0,0)

@[23] 0x00597bb9 ninotes.HuDocNote::AddHaikuDbCommand+1065 (25,7a5a97d5,1,0,0,0,0,0)

@[24] 0x0060c70f ninotes.ShBuiltInNameSpaceTag::Write+79 (20e1bdfe,7b1c98ae,7c23c018,20e1bd20,0,0,0,0)

@[25] 0x005b66c4 ninotes.HuLayout::WriteContents+68 (20e1bdfe,7c23c040,20e1ad08,568e60,0,0,0,0)

@[26] 0x00593f0d ninotes.HuDocNote::GenerateHTML+109 (7c23c040,20e1bd20,20e1bd18,7c22a018,0,0,0,0)

@[27] 0x00568e60 ninotes.Haiku::GenerateHtml+544 (7c22a018,6ea16018,7c22a0d1,0,0,0,0,0)

@[28] 0x00583d9b ninotes.Haiku::HandleDominoCmd+363 (7c22a018,7c22a018,45e9d818,77e620e0,0,0,0,0)

@[29] 0x00579071 ninotes.Haiku::HandleCmd+721 (7c22a018,45e9d818,0,7c22a018,0,0,0,0)

@[30] 0x00445456 ninotes.CmdHandlerBase::PrivHandle+102 (7c22a018,0,0,45e9d818,0,0,0,0)

@[31] 0x00443acd ninotes.CmdHandler::PrivHandle+141 (7c22a018,7c22a018,0,0,0,0,0,0)

@[32] 0x00444708 ninotes.CmdHandler::Handler+216 (7c22a018,45e9d818,7c22a034,46,0,0,0,0)

@[33] 0x0043a4aa ninotes.Cmd::Execute+58 (f599020,f598d34,0,6a8b10,0,0,0,0)

@[34] 0x00482da5 ninotes.InotesHTTPProcessRequestImpl+2005 (f599030,f599020,f598d34,0,0,0,0,0)

@[35] 0x0048543f ninotes.InotesHTTPProcessRequest+47 (f599030,3,442f3a44,6e696d6f,0,0,0,0)

@[36] 0x100176c4 nhttpstack.HTInotesRequest::ProcessRequest+36 (f598d34,f598bc8,0,ba20f08,0,0,0,0)

@[37] 0x10011e1d nhttpstack.HTRequestExtContainer::ProcessRequest+941 (5,1,233824cc,0,0,0,0,0)

@[38] 0x1002370f nhttpstack.HTRequest::ProcessRequest+1919 (0,45a56f7f,0,69616d2f,0,0,0,0)

@[39] 0x10028ddc nhttpstack.HTSession::StartRequest+908 (45a56f8b,45a56f7f,0,5e4,0,0,0,0)

@[40] 0x100304df nhttpstack.HTWorkerThread::CheckForWork+399 (1442ee8,45a56f7f,3,1002ceaa,0,0,0,0)

@[41] 0x10030a48 nhttpstack.HTWorkerThread::ThreadMain+88 (45a56f7f,0,0,0,0,0,0,0)

@[42] 0x6010ca0f nnotes.ThreadWrapper@4+175 (0)

[43] 0x77e6482f kernel32.GetModuleHandleA+223

I’ll suggest you to export your calendar profile document with DXL and check the contents of signature field.

If any of @functions are used inside of rich text field - try to remove them and test iNotes.