Error during FT indexing: Exceeded max configured index size

HCL Domino Domino Forum
,
1

I full text indexed some very large mail databases and saw numerous errors like this: Full Text Error (FTG): Exceeded max configured index size while indexing document NTnnnnnnnn...

Mail server is R9.0.1FP8. Can't find any references anywhere to this error message. Is it complaining about the size of the FTI? Or of the document in the DB? Or of an attachment? Is there a fix or a workaround? Any ideas?

2

Please check this: https://www.twblogs.net/a/5b8e4ad32b71771883442750
Looks very similar to your case.

In general, There are lot of FTI/indexing enhancements in current (11 and 12) versions, so it is recommended to upgrade from 9.0.1.8, because it can resolve your problem out of the box

3

Thanks for providing the link @Aleksandr Korolkov. I think it covers the topic nicely.

@Rob Kirkland the limit applies to (document text bytes + attachment text bytes). The default limit mentioned was a compromise between index completeness vs. the size of the index on disk. If you increase the limit, expect your .ft directories to balloon in size.

And just FYI, the default limit of 6291456 bytes remains the same in all versions.

4

Hello @Rob Kirkland ,

About Error:

“Full Text Error (FTG): Exceeded Max Configured Index Size While Indexing Document”
This error shows up on the console and in the log.nsf when creating a FTI on a database with large attachments. This error can also hang the server.
The error is the result of the 6MB default limit to indexing a document.

Solution:

The limit can be increased by using the INI parameter FTG_INDEX_LIMIT=X.
The value of X can be calculated as follows:
8MB is done as 8*1024*1024= 8388608
12MB is done as 12*1024*1024=12582912

Thanks & Regards,

Chaitanya Y

5

Thank you Alexandr, Josh, and Chaitanya. Very helpful explanations.