To many databases on server

Receiving the below error. Anyone know of a notes.ini that can be used to increase the database list pool?

AMgr: Problem enumerating through the database list to search for agent documents: Insufficient memory - too many databases on server - Database List Pool is full

We have 107,000 databases on the server. Yes one hundred and seven thousand databases. 64bit version of RHEL with 8gb of ram ( only 4gb can be addressed by Domino R7 - 8.0.1 is not 64bit on Linux - Boo! ) dual xeon processors etc. We have never had processor bottlenecks only disk & ram.

Before anyone asks these are not notes mail databases and users only access the databases on this server if one of the other servers go down or for some reason the database does not exist elsewhere. Primary purpose is redundancy & failover.

I think my workaround at this point is to use program documents to trigger the maintenance tasks. Being able to increase the list pool would be a solution though.

So question is posed “Does anyone know of a setting that can be used to increase the database list pool?”

Subject: To many databases on server

Hi Rick,

  wanna work for your company ))) Could be really challenge )))

Sorry is off topic.

Stefan

Subject: RE: To many databases on server

Stefan,

Yes it is off topic. Having said that I will work for anybody if the $$$ is right. As far as challenges are concerned one does not grow by taking the easy path. If we all did that we would still be flingin crap at each other in the trees.

~R

Subject: RE: To many databases on server

… If we all did that we would still be flingin crap at each other in the trees. …

Ah yes - the Good Old Days … sigh

Subject: To many databases on server

Rick,

Unfortunately, this particular pool cannot be configured.

Subject: RE: To many databases on server

Thank you Scott for your reponse. I thought that might be the case. Would you happen to know if this is the case with 64bit 8.0.1 or if the pool is larger in that environment? My guess is that the pool scales up to available ram which would solve my issue in a 64bit environment ( RAM = hundreds of $$ and servers = thousands of $$ ).

Although I really really don’t want to go back to windows servers due to licensing costs, extraneous - unremovable software installed and ongoing security problems it may become necessary as I have not heard of any plans for a 64bit Linux version of Domino.

Either way I guess I better finish modifying the app to utilize multiple failover servers and stick with program documents for now.

Subject: RE: To many databases on server

Rick,

This pool is sized statically, so I don’t think you’d see any difference on 64-bit Domino. I have to say that I’ve not come across another environment with that many databases on a single server instance. I would think you would have severe indexing and I/O issues, among other things.

Subject: RE: To many databases on server

Like I said users generally do not access the server it is more like a hub to the spokes.

I am positive that you have not come across another environment with that many databases because people primarily use Domino as a corporate mail server. Also people primarily use the Notes client for access to application databases.

Our application on the otherhand does not use the overly complex notes mail databases and it has been designed to only be accesible via the web and driven by Views, LotusScript & JSON which means that many of the standard design elements are neither used nor are they needed. Of course the proof is in the pudding and thousands of users love the system and use it everyday.

I will be sure to post a feature request regarding modification of that particular pool. The alternative is going to be a long, painfull and expensive process.

thx again

Subject: To many databases on server

I suggest you can read this URL:IBM Developer

and pay attention to

NSF_Buffer_Pool_Size

and

NSF_Buffer_Pool_Size_MB

Also, with so many databases / volumes, it may be interesting for you to look at a utility like ZipMail (www.zipmail.com)

Subject: RE: To many databases on server

Dan,

Thank you I am familiar with those settings however neither of them relate to the number of databases that the Agent manager can load for monitoring scheduled agents.

Those pools are described as “memory dedicated to buffering I/O transfers between Domino and disk storage”. Not the same thing. Incidentally we have tweaked those pools because of a high volume of disk activity in our clustered environment.

Regarding ZipMail we are aware of that particular product however our users use digitally signed PDF’s almost exclusively. As such we feel that the additional CPU load isn’t justified for the small amount of space recovered with PDF’s (typicaly 10% or less).

Thx

~R

Subject: SPR CSCT7DSPFQ created

I created an SPR to allow the database list pool to be configurable via a notes.ini parameter.