"Notes is Slow" - What to check from a server standpoint

Our notes environement/performance seems to decline after time, even weeks after a fresh reboot.We have 2 domino servers, clustered, 1500 mail db’s, 80 of the users are replicating to server 1 of the 2 servers.

We just shut down the server and restarted beginning of last week. Today we are receiving word that performance is extremly slow. I monitor the “Server, Monitor” to watch work depth queue and availability index.

What other areas should I be watching on a regular basis for “Flags” of poor performance? As for the server resources, all are well within the limits (CPU and memory).

Any input would be greatly appreciated.

Subject: “Notes is Slow” - What to check from a server standpoint

Hi,

For you clusters, how many cluster replicator do you have?

Issue this command on both servers of your cluster:

show stat replica.cluster*

It will give you something similar:

Replica.Cluster.Docs.Added = 5022

Replica.Cluster.Docs.Deleted = 62226

Replica.Cluster.Docs.Updated = 162746

Replica.Cluster.Failed = 4149

Replica.Cluster.Files.Local = 1057

Replica.Cluster.Files.Remote = 2066

Replica.Cluster.Retry.Skipped = 592538 <–check this

Replica.Cluster.Retry.Waiting = 0

Replica.Cluster.SecondsOnQueue = 0 <–check this

Replica.Cluster.SecondsOnQueue.Avg = 18 <–check this

Replica.Cluster.SecondsOnQueue.Max = 1894 <–check this

Replica.Cluster.Servers = 2

Replica.Cluster.SessionBytes.In = 378840196

Replica.Cluster.SessionBytes.Out = 1747925166

Replica.Cluster.Successful = 433515

Replica.Cluster.WorkQueueDepth = 0 <–check this

Replica.Cluster.WorkQueueDepth.Avg = 7 <–check this

Replica.Cluster.WorkQueueDepth.Max = 363 <–check this

Also, you should read this :

*  Title: Notes/Domino Best Practices: Master Checklist

  URL:  http://www.ibm.com/support/docview.wss?rs=203&uid=swg27008523

* Title: Notes/Domino Best Practices: Performance

  URL:  http://www.ibm.com/support/docview.wss?rs=203&uid=swg27008849

* Title: Notes/Domino Best Practices: Sizing

  URL:  http://www.ibm.com/support/docview.wss?rs=203&uid=swg27008851

* Title: Notes/Domino Best Practices: Transaction Logging

  URL:  http://www.ibm.com/support/docview.wss?rs=203&uid=swg27009309

* Title: Notes/Domino Best Practices: Domino Web Access

  URL:  http://www.ibm.com/support/docview.wss?rs=203&uid=swg27009330

* Title: Notes/Domino Best Practices: Upgrade and Migration

  URL:  http://www.ibm.com/support

and this:

http://publib-b.boulder.ibm.com/Redbooks.nsf/RedbookAbstracts/SG245602.html

Do you have a lot of agents?

1500 users. Any big mail db?

Lots of full-text index?

Is it a big server (CPU, disk space)?

JYR

Subject: RE: “Notes is Slow” - What to check from a server standpoint

Excellent resources/links.

One other question:

Are these users connecting to the Domino server locally or over a WAN/VPN? If the latter, MTU size may be the issue.

URL: http://www-1.ibm.com/support/docview.wss?uid=swg21086718

  • Title: How to ping by packet size to establish MTU

URL: http://www-1.ibm.com/support/docview.wss?uid=swg27003388

  • Title: Troubleshooting Script: How to Diagnose Notes and Domino TCP/IP Issues (a little dated, but a great script, nonetheless)

You can tell that I usually start by looking at the network. My Domino servers are always performing flawlessly. :slight_smile:

Gregg

Subject: RE: “Notes is Slow” - What to check from a server standpoint

Hi Gregg,

The links comes from :

Best Practice Makes Perfect

A collaboration with Domino developers about how to do it and how to get it right in Domino

http://www-10.lotus.com/ldd/bpmpblog.nsf/

Ron,

Domino Server Performance Troubleshooting Cookbook

JYR

Subject: “Notes is Slow” - What to check from a server standpoint

Wow, alot of good resources… I thank you all.

Let me ask everyone this. Given our environment, what would be your recommended Domino setup? Meaning how many servers would you recommend, clustered ?, replication ?

We have 1500 mailboxes, all but about 250 are in other remote offices with 512k connection back to main office.

We are running version 6.5.5 (dom and client).

Currently we have 2 servers (IBM X345 series server, Xeon 2.8, 2.6GB ram).

I am curious to hear from others as to a good benchmark for equipment and basic setup.

Thank you

ron

Subject: RE: “Notes is Slow” - What to check from a server standpoint

Ron,

I have a slightly different take because my background is in troubleshooting performance problems. My inclination is to do a bit of logging and troubleshooting so that you get a sense of where the problem is coming from, and then you know what configuration to tweak.

For example, perhaps you have replication running continuously, which probably means the indexer is running continuously. Well, that’d be a great place to start thinking about your setup or hardware.

just my 2c,

raphael