We have been experiencing an HTTP performance issue for some time, and I’m hoping someone might have some insight as to what is causing it. HTTP response time is generally excellent, except that under moderate load, for approximately every 15 to 20th HTTP request, the server takes several seconds to respond. While the server “waits” to respond to this request, it might respond to 15 to 20 other HTTP requests.
For test purposes, I set up a web page that is simply displaying one document using a simple form. The document has 13 image files (roughly the same size) attached, and the form displays both the “attachment” graphic, as well as the image files themselves (using pass-through HTML). The page itself (HTML) loads very fast, and most of the images load very fast (<0.1 sec), but almost every time the page is loaded, one or two of the image files take several seconds to load, and it’s different files every time. This only occurs when the server is under moderate to heavy load (which is almost all HTTP and is most of the time). Processor (dual Zeon) utilization is around 20%, 2 GB RAM with about 500 MB free. A sample “sh stat” is at the end of this post.
Here is a link to the test page:
http://img.realtytimes.com/newsfiles/images.nsf/files/sponsor2
The link below goes to a Keynote diagnostic report for this page:
http://web504.keynote.com/mykeynote/Post/wtytime_030607_135503.asp
In this case, you can see that the last 2 images to load took over 2 seconds each. Other images which were requested after the requests for these 2 images were served in well under 0.1 second each.
From other tests I have performed, it does not matter that the images come from the same document or even the same database, or even that they are images. It appears that the server just randomly decides to “wait a few seconds” to fulfill certain requests.
Any ideas?
sh stat
Agent.Daily.AccessDenials = 0
Agent.Daily.ScheduledRuns = 22
Agent.Daily.TriggeredRuns = 0
Agent.Daily.UnsuccessfulRuns = 0
Agent.Daily.UsedRunTime = 119 Seconds
Agent.Hourly.AccessDenials = 0
Agent.Hourly.ScheduledRuns = 1
Agent.Hourly.TriggeredRuns = 0
Agent.Hourly.UnsuccessfulRuns = 0
Agent.Hourly.UsedRunTime = 5 Seconds
Database.DAFailoverCount = 0
Database.DARefreshServerInfoCount = 0
Database.DAReloadCount = 0
Database.Database.BufferPool.Maximum.Megabytes = 747
Database.Database.BufferPool.MM.Reads = 9
Database.Database.BufferPool.MM.Writes = 1
Database.Database.BufferPool.Peak.Megabytes = 746
Database.Database.BufferPool.PerCentReadsInBuffer = 92.43
Database.DbCache.CurrentEntries = 259
Database.DbCache.DatabaseLinkEntries = 0
Database.DbCache.HighWaterMark = 262
Database.DbCache.Hits = 94907
Database.DbCache.InitialDbOpens = 98987
Database.DbCache.Lookups = 404329
Database.DbCache.MaxBucketLength = 2
Database.DbCache.MaxEntries = 2241
Database.DbCache.NumBuckets = 2243
Database.DbCache.NumBucketsUsed = 247
Database.DbCache.Size = 7289
Database.DbOpen.FoundInDbCacheExpanded = 94560
Database.DbOpen.FoundInDbCacheUnexpanded = 347
Database.DbOpen.FoundInDBQ.Expanded = 270850
Database.DbOpen.FoundInDBQ.Unexpanded = 2981712
Database.DbOpen.FoundInDBQ.WithRLock = 2981703
Database.DbOpen.FoundInDBQ.WithWLock = 270850
Database.DbOpen.FoundLinkInDbCache = 0
Database.DbOpen.InitialDbOpens = 98987
Database.DbOpen.NameExpansionsNeeded = 369852
Database.DBUCache.Added = 232290
Database.DBUCache.AgedOut = 20
Database.DBUCache.Hits = 232266
Database.DBUCache.MaxEntries = 3735
Database.DBUCache.SecsInCache.Ave = 0
Database.DBUCache.SecsInCache.Max = 858
Database.DBUCache.SecsInCache.Min = 0
Database.ExtMgrPool.Peak = 65,406
Database.ExtMgrPool.Used = 137
Database.FreeHandleStack.FreeHandleStackHits = 5326336
Database.FreeHandleStack.HandleAllocations = 5367905
Database.FreeHandleStack.MissRate = 0
Database.LDAP.NAMELookupBindFailures = 0
Database.LDAP.NAMELookupBinds = 0
Database.LDAP.NAMELookupBytesReceived = 0
Database.LDAP.NAMELookupEntries = 0
Database.LDAP.NAMELookupFailures = 0
Database.LDAP.NAMELookupTotal = 0
Database.NAMELookupCacheCacheSize = 65,784
Database.NAMELookupCacheHashSize = 2,356,360
Database.NAMELookupCacheHits = 408
Database.NAMELookupCacheLookups = 1,809,032
Database.NAMELookupCacheMaxSize = 16,777,216
Database.NAMELookupCacheMisses = 604,953
Database.NAMELookupCacheNoHitHits = 1,203,671
Database.NAMELookupCachePool.Peak = 3,145,728
Database.NAMELookupCachePool.Used = 2,532,384
Database.NAMELookupCacheResets = 0
Database.NAMELookupMisses = 335
Database.NAMELookupTotal = 605757
Database.NAMELookupTotalLookupTime = 428.07
Database.NIFPool.Peak = 1,048,576
Database.NIFPool.Used = 603,168
Database.NSFPool.Peak = 5,242,880
Database.NSFPool.Used = 3,737,184
Database.NSF.ClusterHashTable.EntriesWithSameIndex = 0
Database.NSF.ClusterHashTable.FreedEntriesOnCleanup = 0
Database.NSF.ClusterHashTable.HashedEntries = 0
Database.NSF.ClusterHashTable.HashIsFull = 0
Database.NSF.ClusterHashTable.MissedHashHits = 0
Database.NSF.ClusterHashTable.SuccessfullHashHits = 0
Database.NSF.Replicate.NotesMergedBack = 0
Database.NSF.Replicate.NotesReceived = 0
Database.NSF.Replicate.NotesReopened = 5135
Database.NSF.Replicate.NotesSent = 0
Database.NSF.Replicate.SCR.DbOutOfSync = 0
Database.NSF.Replicate.SCR.DeleteMerge = 0
Database.NSF.Replicate.SCR.Deletions = 0
Database.NSF.Replicate.SCR.FolderUpdates = 0
Database.NSF.Replicate.SCR.HeaderUpdates = 0
Database.NSF.Replicate.SCR.MaxQueuedMemoryMB = 0
Database.NSF.Replicate.SCR.NoteUpdateFolderMerge = 0
Database.NSF.Replicate.SCR.NoteUpdates = 0
Database.NSF.Replicate.SCR.PastConserveMem = 0
Database.NSF.Replicate.SCR.PastMaxMem = 0
Database.NSF.Replicate.SCR.SrvDbMatch = 0
Database.NSF.Replicate.SCR.SrvDbOpens = 0
Database.NSF.Replicate.SCR.SrvDbUseLRU = 0
Database.NSF.Replicate.SCR.SrvSrcSameDb = 0
Database.NSF.Replicate.SCR.SrvTotalOps = 0
Database.NSF.Replicate.SCR.UnreadUpdates = 0
Database.NSF.Replicate.UnreadMarks.ChunkLookups = 0
Database.NSF.Replicate.UnreadMarks.ChunksScanned = 0
Database.NSF.Replicate.UnreadMarks.ChunksSkimmed = 0
Database.NSF.Replicate.UnreadMarks.DroppedFutureEntries = 0
Database.NSF.Replicate.UnreadMarks.DroppedOldEntries = 0
Database.NSF.Replicate.UnreadMarks.FullReplications = 0
Database.NSF.Replicate.UnreadMarks.LocalMaxChunks = 0
Database.NSF.Replicate.UnreadMarks.LocalUnreadOperations = 0
Database.NSF.Replicate.UnreadMarks.MessagesReceived = 0
Database.NSF.Replicate.UnreadMarks.MessagesSent = 0
Database.NSF.Replicate.UnreadMarks.OperationsReceived = 0
Database.NSF.Replicate.UnreadMarks.UsersActive = 0
Database.NSF.Replicate.UnreadMarks.UsersActiveMax = 0
Database.NSF.SignatureCache.Hits = 1202602
Database.NSF.SignatureCache.Tries = 1202791
Database.NSF.UNKS.MemorySaved = 22395562
Database.NSF.UNKS.MemoryUsed = 393216
Database.NSF.UNKS.Shared = 128288
Database.NSF.UNKS.Total = 36703
Database.RM.Current.K.Restart.Redo.Hold = 78618
Database.RM.Current.K.UnCommited.Undo.Hold = 0
Database.RM.Current.MaxChkptScan.msec = 31
Database.RM.Current.UnCommited.Time = 03/06/2007 16:45:11 CST
Database.RM.LastChkpt.Avg.K.Logged.PerTran = 3
Database.RM.LastChkpt.Interval.Sec = 348
Database.RM.LastChkpt.K.Logged = 41302
Database.RM.LastChkpt.Time = 03/06/2007 16:43:15 CST
Database.RM.LastChkpt.Total.DBs = 243
Database.RM.LastChkpt.Trans = 12767
Database.RM.Media.Log.Recs.Read = 0
Database.RM.Peak.Avg.K.Logged.PerTran = 73
Database.RM.Peak.Interval.Sec = 18
Database.RM.Peak.K.Logged = 41303
Database.RM.Peak.Time = 03/06/2007 02:33:25 CST
Database.RM.Peak.Total.DBs = 243
Database.RM.Peak.Trans = 559
Database.RM.Peak.Trans.PerMin = 1863
Database.RM.Restart.Duration.Sec = 0
Database.RM.Restart.Log.Recs.Analyzed = 2
Database.RM.Restart.Log.Recs.Applied = 0
Database.RM.Restart.Log.Recs.Read = 2
Database.RM.Restart.Time = 03/06/2007 02:31:24 CST
Database.RM.Restart.Total.DBs = 0
Database.RM.Restart.Undo.Trans = 0
Database.RM.SinceChkpt.K.Logged = 11041
Database.RM.SinceChkpt.Trans = 3291
Database.RM.SinceStartup.Aborts = 0
Database.RM.SinceStartup.Critical.Log.Times = 0
Database.RM.SinceStartup.Log.DiagRecs.Written = 1115
Database.RM.SinceStartup.Log.Recs.Applied = 0
Database.RM.SinceStartup.Log.Recs.Read = 0
Database.RM.SinceStartup.Log.Recs.Written = 5397566
Database.RM.SinceStartup.M.Logged = 5866
Database.RM.SinceStartup.Trans = 1833080
Database.RM.Sys.Logged = Enabled
Database.RM.Sys.Log.Type = Circular
Database.RM.Sys.M.Chkpt.Interval = 40
Database.RM.Sys.M.Log.Size = 512
Database.RM.Sys.M.Redo.Limit = 120
Database.RM.Sys.Phase = Normal
Disk.C.Free = 63,416,758,272
Disk.C.Size = 73,501,069,312
Disk.C.Type = NTFS
Disk.D.Free = 48,745,082,880
Disk.D.Size = 73,402,363,904
Disk.D.Type = NTFS
Disk.Fixed = 2
Domino.Cache.Command.Count = 0
Domino.Cache.Command.DisplaceRate = 0
Domino.Cache.Command.HitRate = 0
Domino.Cache.Command.MaxSize = 128
Domino.Cache.Design.Count = 12
Domino.Cache.Design.DisplaceRate = 0
Domino.Cache.Design.HitRate = 99.9993146953307
Domino.Cache.Design.MaxSize = 128
Domino.Cache.iNote WA Forms file.Count = 0
Domino.Cache.NNotesID.Count = 0
Domino.Cache.NNotesID.MaxSize = 64
Domino.Cache.Note Cache.HitRate = 0
Domino.Cache.Session Cache.Count = 1
Domino.Cache.Session Cache.MaxSize = 1,000
Domino.Cache.Shimmer Profile Cache.Count = 0
Domino.Cache.User Cache.Count = 1
Domino.Cache.User Cache.DisplaceRate = 0
Domino.Cache.User Cache.HitRate = 99.9838930774503
Domino.Cache.User Cache.MaxSize = 64
Domino.Command.CopyToFolder = 0
Domino.Command.CreateDocument = 0
Domino.Command.DeleteDocument = 0
Domino.Command.DeleteDocuments = 0
Domino.Command.EditDocument = 305
Domino.Command.GetOrbCookie = 0
Domino.Command.MoveToFolder = 0
Domino.Command.Navigate = 0
Domino.Command.OpenAbout = 0
Domino.Command.OpenAgent = 300267
Domino.Command.OpenDatabase = 0
Domino.Command.OpenDocument = 368
Domino.Command.OpenElement = 282275
Domino.Command.OpenFileResource = 12
Domino.Command.OpenForm = 0
Domino.Command.OpenHelp = 0
Domino.Command.OpenIcon = 0
Domino.Command.OpenImageResource = 1
Domino.Command.OpenJavascriptLib = 0
Domino.Command.OpenNavigator = 0
Domino.Command.OpenPreferences = 0
Domino.Command.OpenServer = 0
Domino.Command.OpenView = 141
Domino.Command.OpenWebService = 0
Domino.Command.ReadForm = 141
Domino.Command.Redirect = 0
Domino.Command.RemoveFromFolder = 0
Domino.Command.RequestCert = 0
Domino.Command.SaveDocument = 0
Domino.Command.SearchDomain = 0
Domino.Command.SearchSite = 0
Domino.Command.SearchView = 0
Domino.Command.Total = 583669
Domino.Command.Unknown = 0
Domino.Command.WSDL = 0
Domino.Config.ActiveThreads.Max = 40
Domino.Config.ActiveThreads.Min = 20
Domino.Config.AllowDirectoryLinks = 1
Domino.Config.DNSLookup = 0
Domino.Config.EnforceAccess = 0
Domino.Config.HostName =
Domino.Config.Image.Format = GIF
Domino.Config.Image.Interlaced = 1
Domino.Config.Log.Access = access
Domino.Config.Log.Error = error
Domino.Config.Log.Filter =
Domino.Config.Log.TimeStamp = 0
Domino.Config.PortNumber = 80
Domino.Config.PortStatus = 1
Domino.Config.SSL.PortNumber = 443
Domino.Config.SSL.Status = 1
Domino.Config.Timeout.CGI = 5
Domino.Config.Timeout.IdleThread = 0
Domino.Config.Timeout.Input = 2
Domino.Config.Timeout.Output = 20
Domino.Config.View.Lines = 30
Domino.Requests.Per1Day.PeakTime = 03/06/2007 16:41:46 CST
Domino.Requests.Per1Day.Total = 580,867
Domino.Requests.Per1Hour.Peak = 68,631
Domino.Requests.Per1Hour.PeakTime = 03/06/2007 12:07:21 CST
Domino.Requests.Per1Hour.Total = 47,547
Domino.Requests.Per1Minute.Peak = 1,656
Domino.Requests.Per1Minute.PeakTime = 03/06/2007 11:11:21 CST
Domino.Requests.Per1Minute.Total = 683
Domino.Requests.Per5Minute.Peak = 7,435
Domino.Requests.Per5Minute.PeakTime = 03/06/2007 11:12:21 CST
Domino.Requests.Per5Minute.Total = 3,497
Domino.Requests.Total = 583,350
Domino.ThreadPool.average = 65536
Domino.ThreadPool.max = 1441792
Domino.Threads.Active.Peak = 29
EVENT.EventDispatcher.Queue.Entries = 0
EVENT.EventDispatcher.Queue.MaxEntries = 26
EVENT.EventDispatcher.Queue.TotalEntries = 1,312
EVENT.EVENTLOG.Queue.Entries = 0
EVENT.EVENTLOG.Queue.MaxEntries = 10
EVENT.EVENTLOG.Queue.TotalEntries = 592
EVENT.MaxEventPoolSize = 10,485,760
EVENT.MsgCache.Time.Empty = 03/06/2007 02:31:34 CST
EVENT.PROBEMGR.Queue.Entries = 0
EVENT.PROBEMGR.Queue.MaxEntries = 26
EVENT.PROBEMGR.Queue.TotalEntries = 1,312
Http.Accept.ConnectionsAccepted = 425784
Http.Accept.ConnectionsDenied = 0
Http.Accept.Errors = 0
Http.Accept.Polls = 564710
Http.Accept.PollTimeouts = 138925
Http.Accept.ServerBusy = 0
Http.CurrentConnections = 31
Http.JavaCache.Enabled = 1
Http.JavaCache.Entries.Current = 0
Http.JavaCache.Entries.Maximum = 1000
Http.JavaCache.Prune.Run.Interval = 10
Http.JavaCache.Prune.Run.Next = 03/06/2007 16:45:12 CST
Http.JavaCache.Prune.Time.Locked.Avg = 0
Http.JavaCache.Prune.Time.Locked.Max = 0
Http.JavaCache.Prune.Time.Locked.Min = 0
Http.JavaCache.Prune.Time.Total.Avg = 0
Http.JavaCache.Prune.Time.Total.Max = 0
Http.JavaCache.Prune.Time.Total.Min = 0
Http.JavaCache.Size.Current = 0
Http.JavaCache.Size.Maximum = 4000000
Http.JavaCache.Total.Adds = 0
Http.JavaCache.Total.Adds.Missed = 0
Http.JavaCache.Total.Errors = 0
Http.JavaCache.Total.Hits = 0
Http.JavaCache.Total.Misses = 0
Http.MaxConnections = 560
Http.PeakConnections = 90
Http.Workers = 40
Http.Worker.Total.BytesRead = 254,236,315
Http.Worker.Total.BytesWritten = 2,024,436,714
Http.Worker.Total.Cgi.Requests = 3
Http.Worker.Total.DomWS.Requests = 0
Http.Worker.Total.DomWS.RequestTime = 0
Http.Worker.Total.Dsapi.Requests = 0
Http.Worker.Total.Dsapi.RequestTime = 0
Http.Worker.Total.File.Requests = 220
Http.Worker.Total.File.RequestTime = 140
Http.Worker.Total.Http.Requests = 493
Http.Worker.Total.Http.RequestTime = 62
Http.Worker.Total.IdleSessionTimeouts = 3581429
Http.Worker.Total.InputTimeouts = 50087
Http.Worker.Total.Notes.Requests = 583155
Http.Worker.Total.Notes.RequestTime = 89,326,253
Http.Worker.Total.OutputTimeouts = 45
Http.Worker.Total.QuickPlace.Requests = 0
Http.Worker.Total.QuickPlace.RequestTime = 0
Http.Worker.Total.RequestsProcessed = 583871
Http.Worker.Total.TotalRequestTime = 89,326,471
Mail.CurrentByteDeliveryRate = 0
Mail.CurrentByteTransferRate = 0
Mail.CurrentMessageDeliveryRate = 0
Mail.CurrentMessageTransferRate = 0
Mail.DBCacheAged = 0
Mail.DBCacheEntries = 0
Mail.DBCacheForcedOut = 0
Mail.DBCacheHighWaterMark = 0
Mail.DBCacheHits = 0
Mail.DBCacheMaxEntries = 2241
Mail.DBCacheReads = 0
MAIL.Dead = 79
Mail.DeliveryThreads.Total = 0
Mail.Domain = RTIMES
MAIL.Hold = 0
Mail.Mailbox.AccessConflicts = 0
Mail.Mailbox.Accesses = 0
Mail.Mailbox.AccessWarnings = 0
Mail.Mailbox.CurrentAccesses = 0
Mail.Mailbox.MaxConcurrentAccesses = 0
Mail.Mailbox.Opens = 0
Mail.TotalPending = 79
Mail.TransferThreads.Concurrent.Highest = 0
Mail.TransferThreads.Concurrent.Max = 12
Mail.TransferThreads.Max = 25
Mail.TransferThreads.Total = 0
MAIL.Waiting = 0
MAIL.WaitingForDIR = 0
MAIL.WaitingForDNS = 0
MAIL.WaitingRecipients = 0
Mem.Allocated = 854597406
Mem.Allocated.Process = 8447854
Mem.Allocated.Shared = 846149552
Mem.Availability = Plentiful
Mem.Free = 3,473,801,216
Mem.MaxAddressableMemory_MB = 4095
Mem.MaxSharedMemory_MB = 2047
Mem.PhysicalRAM = 2,146,435,072
Mem.PhysicalRAM_MB = 2047
Mem.Reallocs.Down = 2092725
Mem.Reallocs.Same = 1050718
Mem.Reallocs.Up = 4170473
Monitor.Last.EVENT MONITOR.Warning(High) = 13350
Monitor.Last.EVENT MONITOR.Warning(High)Text = Database review for ‘names.nsf’ has completed.
Monitor.Last.ROUTER.Fatal = 13207
Monitor.Last.ROUTER.FatalText = Router: DNS Resolver failed to initialize.: DNS resolver error
Monitor.Last.Server.Warning(High) = 5661
Monitor.ROUTER.Fatal = 1
Monitor.Server.Warning(High) = 2
NET.GroupCache.Hits = 1,140
NET.GroupCache.Misses = 38
NET.GroupCache.NumEntries = 12
NET.GroupCache.Size = 65,406
NET.GroupCache.Used = 3,587
NET.Log.Venus/RealtyTimes.PeakUnwrittenEntries = 9
NET.Log.Venus/RealtyTimes.UnwrittenEntries = 2
NET.Sessions.DeferredClosed.Current = 0
NET.Sessions.DeferredClosed.Peak = 0
NET.TCPIP.BytesReceived = 57,882,256
NET.TCPIP.BytesSent = 211,925,446
NET.TCPIP.Sessions.Established.Incoming = 1694
NET.TCPIP.Sessions.Established.Outgoing = 1626
NET.TCPIP.Sessions.Limit = 65535
NET.TCPIP.Sessions.LimitMax = 65535
NET.TCPIP.Sessions.LimitMin = 10
NET.TCPIP.Sessions.Peak = 52
NET.TCPIP.Sessions.Recycled = 0
NET.TCPIP.Sessions.Recycling = 0
Platform.LogicalDisk.1.AssignedName = C
Platform.LogicalDisk.1.AvgQueueLen = 0
Platform.LogicalDisk.1.AvgQueueLen.Avg = 0
Platform.LogicalDisk.1.AvgQueueLen.Peak = 0.3
Platform.LogicalDisk.1.PctUtil = 3.2
Platform.LogicalDisk.1.PctUtil.Avg = 3.1
Platform.LogicalDisk.1.PctUtil.Peak = 31.4
Platform.LogicalDisk.2.AssignedName = D
Platform.LogicalDisk.2.AvgQueueLen = 0
Platform.LogicalDisk.2.AvgQueueLen.Avg = 0.1
Platform.LogicalDisk.2.AvgQueueLen.Peak = 3.6
Platform.LogicalDisk.2.PctUtil = 2.2
Platform.LogicalDisk.2.PctUtil.Avg = 10.8
Platform.LogicalDisk.2.PctUtil.Peak = 100
Platform.LogicalDisk.TotalNumofDisks = 2
Platform.Memory.PagesPerSec = 4.8
Platform.Memory.PagesPerSec.Avg = 30.2
Platform.Memory.PagesPerSec.Peak = 2,169.6
Platform.Memory.RAM.AvailMBytes = 689.1
Platform.Memory.RAM.AvailMBytes.Avg = 711.9
Platform.Memory.RAM.AvailMBytes.Min = 462.9
Platform.Memory.RAM.AvailMBytes.Peak = 1,461.5
Platform.Memory.RAM.PctUtil = 66
Platform.Memory.RAM.TotalMBytes = 2048
Platform.Network.1.AdapterName = Intel[R] PRO_100 S Server Adapter _2
Platform.Network.1.BytesRecvdPerSec = 1,146.1
Platform.Network.1.BytesSentPerSec = 3,620.4
Platform.Network.1.CurrBandwidthMbitsPerSec = 100
Platform.Network.1.TotalBytesPerSec = 4,766.5
Platform.Network.2.AdapterName = Intel[R] PRO_1000 MT Network Connection
Platform.Network.2.BytesRecvdPerSec = 10,639.2
Platform.Network.2.BytesSentPerSec = 45,996.9
Platform.Network.2.CurrBandwidthMbitsPerSec = 100
Platform.Network.2.PctUtilBandwidth = 0.5
Platform.Network.2.TotalBytesPerSec = 56,636.1
Platform.Network.3.AdapterName = WAN [PPP_SLIP] Interface
Platform.Network.3.BytesRecvdPerSec = 11.6
Platform.Network.3.BytesSentPerSec = 5.3
Platform.Network.3.CurrBandwidthMbitsPerSec = 0.0192
Platform.Network.3.PctUtilBandwidth = 0.7
Platform.Network.3.TotalBytesPerSec = 16.9
Platform.Network.TotalNumofAdapters = 3
Platform.Network.Total.BytesRecvdPerSec = 11,796.9
Platform.Network.Total.BytesSentPerSec = 49,622.6
Platform.Network.Total.CurrBandwidthMbitsPerSec = 200.0192
Platform.Network.Total.NetworkBytesPerSec = 61,419.5
Platform.Network.Total.PctUtilBandwidth = 0.2
Platform.PagingFile.Total.PctUtil = 6.2
Platform.PagingFile.Total.PctUtil.Avg = 8.2
Platform.PagingFile.Total.PctUtil.Peak = 13.5
Platform.Process.ActiveDomino.TotalCpuUtil = 39.4
Platform.Process.ActiveNumOfDominoProc = 16
Platform.Process.adminp.1.PctCpuUtil = 0
Platform.Process.adminp.1.ProcessID = 2000
Platform.Process.amgr.1.ProcessID = 1024
Platform.Process.amgr.2.PctCpuUtil = 0
Platform.Process.amgr.2.ProcessID = 664
Platform.Process.amgr.3.PctCpuUtil = 0
Platform.Process.amgr.3.ProcessID = 2596
Platform.Process.cldbdir.1.PctCpuUtil = 0
Platform.Process.cldbdir.1.ProcessID = 2896
Platform.Process.clrepl.1.PctCpuUtil = 1.1
Platform.Process.clrepl.1.ProcessID = 3740
Platform.Process.event.1.PctCpuUtil = 0
Platform.Process.event.1.ProcessID = 796
Platform.Process.http.1.PctCpuUtil = 37.8
Platform.Process.http.1.ProcessID = 3816
Platform.Process.logasio.1.PctCpuUtil = 0.1
Platform.Process.logasio.1.ProcessID = 1260
Platform.Process.procmon.1.PctCpuUtil = 0
Platform.Process.procmon.1.ProcessID = 2880
Platform.Process.replica.1.PctCpuUtil = 0
Platform.Process.replica.1.ProcessID = 1748
Platform.Process.replica.2.PctCpuUtil = 0
Platform.Process.replica.2.ProcessID = 3964
Platform.Process.router.1.PctCpuUtil = 0
Platform.Process.router.1.ProcessID = 1364
Platform.Process.server.1.PctCpuUtil = 0.3
Platform.Process.server.1.ProcessID = 3476
Platform.Process.update.1.PctCpuUtil = 0
Platform.Process.update.1.ProcessID = 3968
Platform.Process.update.2.PctCpuUtil = 0.1
Platform.Process.replica.2.ProcessID = 3964
Platform.Process.router.1.PctCpuUtil = 0
Platform.Process.router.1.ProcessID = 1364
Platform.Process.server.1.PctCpuUtil = 0.3
Platform.Process.server.1.ProcessID = 3476
Platform.Process.update.1.PctCpuUtil = 0
Platform.Process.update.1.ProcessID = 3968
Platform.Process.update.2.PctCpuUtil = 0.1
Platform.Process.update.2.ProcessID = 960
Platform.System.ContextSwitchesPerSec = 1,530.5
Platform.System.ContextSwitchesPerSec.Avg = 1,276.7
Platform.System.ContextSwitchesPerSec.Min = 640.7
Platform.System.ContextSwitchesPerSec.Peak = 3,763
Platform.System.PctCombinedCpuUtil = 10.3
Platform.System.PctCombinedCpuUtil.Avg = 9.5
Platform.System.PctCombinedCpuUtil.Peak = 23.3
Platform.System.PctTotalPrivilegedCpuUtil = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Avg = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Peak = 4.9
Platform.System.PctTotalUserCpuUtil = 9.6
Platform.System.PctTotalUserCpuUtil.Avg = 8.8
Platform.System.PctTotalUserCpuUtil.Peak = 21.1
Platform.Time.LastSample = 03/06/2007 16:44:44 CST
Platform.Time.SampleRateInMins = 1
Replica.Cluster.Docs.Added = 2
Replica.Cluster.Docs.Updated = 97147
Replica.Cluster.Failed = 3
Replica.Cluster.Files.Local = 28
Platform.Process.replica.2.ProcessID = 3964
Platform.Process.router.1.PctCpuUtil = 0
Platform.Process.router.1.ProcessID = 1364
Platform.Process.server.1.PctCpuUtil = 0.3
Platform.Process.server.1.ProcessID = 3476
Platform.Process.update.1.PctCpuUtil = 0
Platform.Process.update.1.ProcessID = 3968
Platform.Process.update.2.PctCpuUtil = 0.1
Platform.Process.update.2.ProcessID = 960
Platform.System.ContextSwitchesPerSec = 1,530.5
Platform.System.ContextSwitchesPerSec.Avg = 1,276.7
Platform.System.ContextSwitchesPerSec.Min = 640.7
Platform.System.ContextSwitchesPerSec.Peak = 3,763
Platform.System.PctCombinedCpuUtil = 10.3
Platform.System.PctCombinedCpuUtil.Avg = 9.5
Platform.System.PctCombinedCpuUtil.Peak = 23.3
Platform.System.PctTotalPrivilegedCpuUtil = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Avg = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Peak = 4.9
Platform.System.PctTotalUserCpuUtil = 9.6
Platform.System.PctTotalUserCpuUtil.Avg = 8.8
Platform.System.PctTotalUserCpuUtil.Peak = 21.1
Platform.Time.LastSample = 03/06/2007 16:44:44 CST
Platform.Time.SampleRateInMins = 1
Replica.Cluster.Docs.Added = 2
Replica.Cluster.Docs.Updated = 97147
Replica.Cluster.Failed = 3
Replica.Cluster.Files.Local = 28
Platform.Process.replica.2.ProcessID = 3964
Platform.Process.router.1.PctCpuUtil = 0
Platform.Process.router.1.ProcessID = 1364
Platform.Process.server.1.PctCpuUtil = 0.3
Platform.Process.server.1.ProcessID = 3476
Platform.Process.update.1.PctCpuUtil = 0
Platform.Process.update.1.ProcessID = 3968
Platform.Process.update.2.PctCpuUtil = 0.1
Platform.Process.update.2.ProcessID = 960
Platform.System.ContextSwitchesPerSec = 1,530.5
Platform.System.ContextSwitchesPerSec.Avg = 1,276.7
Platform.System.ContextSwitchesPerSec.Min = 640.7
Platform.System.ContextSwitchesPerSec.Peak = 3,763
Platform.System.PctCombinedCpuUtil = 10.3
Platform.System.PctCombinedCpuUtil.Avg = 9.5
Platform.System.PctCombinedCpuUtil.Peak = 23.3
Platform.System.PctTotalPrivilegedCpuUtil = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Avg = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Peak = 4.9
Platform.System.PctTotalUserCpuUtil = 9.6
Platform.System.PctTotalUserCpuUtil.Avg = 8.8
Platform.System.PctTotalUserCpuUtil.Peak = 21.1
Platform.Time.LastSample = 03/06/2007 16:44:44 CST
Platform.Time.SampleRateInMins = 1
Replica.Cluster.Docs.Added = 2
Replica.Cluster.Docs.Updated = 97147
Replica.Cluster.Failed = 3
Replica.Cluster.Files.Local = 28
Platform.Process.replica.2.ProcessID = 3964
Platform.Process.router.1.PctCpuUtil = 0
Platform.Process.router.1.ProcessID = 1364
Platform.Process.server.1.PctCpuUtil = 0.3
Platform.Process.server.1.ProcessID = 3476
Platform.Process.update.1.PctCpuUtil = 0
Platform.Process.update.1.ProcessID = 3968
Platform.Process.update.2.PctCpuUtil = 0.1
Platform.Process.update.2.ProcessID = 960
Platform.System.ContextSwitchesPerSec = 1,530.5
Platform.System.ContextSwitchesPerSec.Avg = 1,276.7
Platform.System.ContextSwitchesPerSec.Min = 640.7
Platform.System.ContextSwitchesPerSec.Peak = 3,763
Platform.System.PctCombinedCpuUtil = 10.3
Platform.System.PctCombinedCpuUtil.Avg = 9.5
Platform.System.PctCombinedCpuUtil.Peak = 23.3
Platform.System.PctTotalPrivilegedCpuUtil = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Avg = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Peak = 4.9
Platform.System.PctTotalUserCpuUtil = 9.6
Platform.System.PctTotalUserCpuUtil.Avg = 8.8
Platform.System.PctTotalUserCpuUtil.Peak = 21.1
Platform.Time.LastSample = 03/06/2007 16:44:44 CST
Platform.Time.SampleRateInMins = 1
Replica.Cluster.Docs.Added = 2
Replica.Cluster.Docs.Updated = 97147
Replica.Cluster.Failed = 3
Replica.Cluster.Files.Local = 28
Platform.Process.replica.2.ProcessID = 3964
Platform.Process.router.1.PctCpuUtil = 0
Platform.Process.router.1.ProcessID = 1364
Platform.Process.server.1.PctCpuUtil = 0.3
Platform.Process.server.1.ProcessID = 3476
Platform.Process.update.1.PctCpuUtil = 0
Platform.Process.update.1.ProcessID = 3968
Platform.Process.update.2.PctCpuUtil = 0.1
Platform.Process.update.2.ProcessID = 960
Platform.System.ContextSwitchesPerSec = 1,530.5
Platform.System.ContextSwitchesPerSec.Avg = 1,276.7
Platform.System.ContextSwitchesPerSec.Min = 640.7
Platform.System.ContextSwitchesPerSec.Peak = 3,763
Platform.System.PctCombinedCpuUtil = 10.3
Platform.System.PctCombinedCpuUtil.Avg = 9.5
Platform.System.PctCombinedCpuUtil.Peak = 23.3
Platform.System.PctTotalPrivilegedCpuUtil = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Avg = 0.7
Platform.System.PctTotalPrivilegedCpuUtil.Peak = 4.9
Platform.System.PctTotalUserCpuUtil = 9.6
Platform.System.PctTotalUserCpuUtil.Avg = 8.8
Platform.System.PctTotalUserCpuUtil.Peak = 21.1
Platform.Time.LastSample = 03/06/2007 16:44:44 CST
Platform.Time.SampleRateInMins = 1
Replica.Cluster.Docs.Added = 2
Replica.Cluster.Docs.Updated = 97147
Replica.Cluster.Failed = 3
Replica.Cluster.Files.Local = 28
Platform.Process.replica.2.ProcessID = 3964
Platform.Process.router.1.PctCpuUtil = 0
Platform.Process.router.1.ProcessID = 1364
Platform.Process.server.1.PctCpuUtil = 0.3
Platform.Process.server.1.ProcessID = 3476
Platform.Process.update.1.PctCpuUtil = 0
Platform.Process.update.1.ProcessID = 3968
Platform.Process.update.2.PctCpuUtil = 0.1
Platform.Process.update.2.ProcessID = 960