LotusScript GetUnformattedText error with big (40M) Rich Text fields

When I use RTItem.GetUnformattedText (and GetFormattedText also) on big Rich Text fields I get a strange “Out of memory” error. And sometimes I get “Out of string space” instead. It seems to start somewhere around here because it works with 38M.When I try to open the document it says “document has too many paragraphs”.

Which might be true - there are 100 characters per lines in the longest lines and 20 in the shortest.

Anyone seen this error? Or have a workaround, please?

Subject: I refer you to this list of Limits in Notes… Specifically 21509 Paragraphs seems to be the MAX

Credit given to Mike Woolsey for assembling this List.

Limit

R5 (LotusScript 4)

R6

What is the maximum size of a database?

64 GB (gigabyte) or the OS file system’s limit (2 GB on some older UNIX platforms)

64 GB (gigabyte) or the OS file system’s limit (2 GB on some older UNIX platforms)

What is the maximum size of plain text fields?

(What is the maximum size of a group Members field?)

15KB per (summary) text field;

30KB of fields per document (storage); 15KB displayed in a view’s column

15KB per (summary) text field;

30KB of fields per document (storage); 15KB displayed in a view’s column

What is the maximum size of a computed text field?

?64,363 characters

?64,363 characters

What is the maximum size of a single paragraph in a rich text field?

64KB (this is approximately 35k of text, though)

64KB (this is approximately 35k of text, though)

What is the maximum number of paragraph styles?

64,000 unique paragraph styles in a single document

64,000 unique paragraph styles in a single document

How many sublevels in a hierarchical view; how many documents at each level?

31 levels; 300,000 documents

31 levels; 300,000 documents

What is the maximum number of windows you can have open simultaneously?

limited by memory; 35(?) accessible from keyboard

limited by memory; 35(?) accessible from keyboard

How many characters are allowed in names for views, forms, and so on?

Database Title: 32

Filename: limited by OS’s file system

Field names: 32

View names: 64

Form names: 32

Macro names: 32

Database Title: 32

Filename: limited by OS’s file system

Field names: 32

View names: 64

Form names: 32

Macro names: 32

How many aliases are allowed for views?

Up to 130 characters for all view aliases per view, including vertical-bar separators (“|”), including the view name

Up to 130 characters for all view aliases per view, including vertical-bar separators (“|”), including the view name

What is the maximum size for Mail recipient names?

2MB of recipient names (based on fully qualified names, for example, Les Kaplan @ Marketing).

2MB of recipient names (based on fully qualified names, for example, Les Kaplan @ Marketing).

How many mail rules in a mail DB?

50

100

What’s the maximum password length allowed on an ID?

63 characters

63 characters

fields in a database

~ 3000 (limited to ~ 64K total length for all field names). You can enable the database property “Allow more fields in database” to get up to 22,893 uniquely-named fields in the database.

~ 3000 (limited to ~ 64K total length for all field names). You can enable the database property “Allow more fields in database” to get up to 22,893 uniquely-named fields in the database.

How many fields in a form?

10MB memory (6MB memory for OS/2)

10MB memory (6MB memory for OS/2)

columns in one table

64

64

rows in one table

255

255

views in a database

No limit; however, as the number of views increases, the length of time to display other views also increases

No limit; however, as the number of views increases, the length of time to display other views also increases

forms in a database

Unlimited

Unlimited

columns in a view

289 ten-character columns; dependent upon # or characters per column

289 ten-character columns; dependent upon # or characters per column

How wide can a column be (# of inches)?

?15KB displayed in a view’s column (5.0.3 release notes)

?15KB displayed in a view’s column (5.0.3 release notes)

What’s the largest view column title allowed?

50 characters

80 characters

What is the total size of computable simple text fields?

63K

63K

How many paragraphs in a document?

21,509 (19,004 for OS/2)

21,509 (19,004 for OS/2)

What is the maximum size of a rich text field?

Limited only by available disk space up to 1GB

Limited only by available disk space up to 1GB

What is the maximum number of inserted page breaks?

Unlimited

Unlimited

How many documents can be imported into a view?

?(the original (col. 2) has something wrong, syntactically, maybe it’s)

Individual documents: up to 350K;

from a spreadsheet, 8192 rows;

5000 separate documents

?(the original (col. 2) has something wrong, syntactically, maybe it’s)

Individual documents: up to 350K;

from a spreadsheet, 8192 rows;

5000 separate documents

cascading views in a database

200

200

How many copies of a document can be printed at once?

65,535

65,535

What is the maximum value allowed in “Start page numbers at” field?

65,535

65,535

margin size (in inches)

46

46

page cropping size (in inches)

46

46

point size to select/print

250

250

maximum number of soft-deleted documents in a database

1000

32,768

documents in a view

Maximum of 128 GB for a view index.

(16 Mpage of B-tree space, 8kB/page)

Also limited by available disk space (2 GB on some UNIX platforms).

View containers in R5 databases (ODS 3.1 up) do not have a container size limit. The view size limit is now determined by the maximum number of pages that can be created which is 16,777,214. A page holds 8 KB so that means the maximum size for a view is 137,438,937,088 bytes (128 GB).

Maximum of 128 GB for a view index.

(16 Mpage of B-tree space, 8kB/page)

Also limited by available disk space (2 GB on some UNIX platforms).

View containers in R5 databases (ODS 3.1 up) do not have a container size limit. The view size limit is now determined by the maximum number of pages that can be created which is 16,777,214. A page holds 8 KB so that means the maximum size for a view is 137,438,937,088 bytes (128 GB).

What’s the maximum number of profile documents allowed in a database?

6000-6100 per database : s/w limitation

around 6000-6100 per database: s/w limitation

What is the maximum number of documents that can be exported to Tabular Text?

Limited only by available disk space

Limited only by available disk space

How many levels of responses will display in a view?

31 levels of response to 1 main document

31 levels of response to 1 main document

How many responses per parent document?

(bug:15,796 responses per document in R5 to 5.0.10)

??

What is the maximum number of entries in an Access Control List?

950 names

(I don’t know if this has changed at all)

950 names

(I don’t know if this has changed at all)

What is the maximum number of roles in an access control list?

75 Roles

75 Roles

What is the maximum number of ACL groups a user can be member of?

4096 5.0.9 up (pre-5.0.9, a bug may crash server over 3000 groups)

4096

What is the maximum number of groups that can be nested?

20 levels or up to 64k of group name and person name characters, whichever is lower (~30k of data using @UserNamesList or @UserRoles)

(in R4: 6 levels)

?20 levels or up to 64k of group name and person name characters, whichever is lower (~30k of data using @UserNamesList or @UserRoles)

What is the maximum size of a single paragraph you can cut or copy to the Clipboard?

Unlimited (64K for UNIX)

Unlimited (64K for UNIX)

What is the maximum number of documents you can cut or copy to the clipboard?

2335 (Win32)

2335 (Win32)

What is the maximum number of users to have authorized passwords on a multiple password ID?

8 users

8 users

What’s the maximum amount of storage that can be used for strings in a LotusScript module?

2 GB or available memory.

2 GB or available memory.

What’s the maximum length of an environment variable value?

255 characters

255 characters

What’s the maximum length of a string constant in @function formulas?

~2k characters

~2k characters

What’s the maximum number of results that can be returned from a full text search

4,999

4,999

What’s the largest URL HTTP will accept?

1024 (2048 5.0.10 up)

2048 (?)

What’s the largest richtext field HTTP will update?

~64k?

~64k?

What’s the maximum size of variable-length strings in a LotusScript module?

2 GB (1 GB of characters) per module, or available memory.

2 GB (1 GB of characters) per module, or available memory.

How many variable-length strings can be defined in LotusScript?

Limited by available memory and module definitions. Can be limited by symbol table to 64k of symbol names per module.

Limited by available memory and module definitions. Can be limited by symbol table to 64k of symbol names per module.

What’s the maximum size of fixed-length strings in LotusScript?

64k (this is a BASIC language limitation)

64k (this is a BASIC language limitation)

What’s the maximum length of a string literal in LotusScript?

32k (16k characters) (this is a BASIC language limitation)

32k (16k characters) (this is a BASIC language limitation)

What’s the maximum line length of a line written by LotusScript Write statement?

255 characters

255 characters

How many characters can be in path in MkDir, RmDir, or ChDir statement?

  1. This includes the drive specifier, if any.

  2. This includes the drive specifier, if any.

How many items can be in a Print, Write, or Input statement?

255

255

What’s the maximum recLen in Open statement?

32767

32767

How many symbols can LotusScript handle?

64k of text in symbol names

64k of text in symbol names

How many data elements can be in a LotusScript array?

Determined by memory available for data, and by the storage size of each element of the array, which varies with the array data type. For example, a Long one-dimensional fixed array declared in type scope can have 16,128 elements. (The total storage size available for fixed-size data in module scope is 64K bytes, and a Long element requires 4 bytes for storage.)

Determined by memory available for data, and by the storage size of each element of the array, which varies with the array data type. For example, a Long one-dimensional fixed array declared in type scope can have 16,128 elements. (The total storage size available for fixed-size data in module scope is 64K bytes, and a Long element requires 4 bytes for storage.)

What’s the maximum size of a LotusScript executable module’s code?

limited by available memory; 64k of source without LSS include files

limited by available memory; 64k of source without LSS include files

How many outline entries can an outline have?

~21,000 entries

~21,000 entries

How long can a remote-console command be, and still display properly in Administrator?

77 characters. Some commands may handle more; others don’t. The command itself is neither displayed nor logged as more than 77 characters.

More than 77 characters (documented as “addressed” in K-Base, but no new maximum value is documented).

Subject: Re: I refer you to this list of Limits in Notes… Specifically 21509 Paragraphs seems to be the MAX

OK I see this limit, but what this has to do with GetUnformattedText’s “Out of memory”?

Subject: Well, if you can not open it in the Notes Client, because of too many paragraphs, How…

do you expect the GetUnformattedText function to handle it any better? You have too many paragraphs in one field. Either make more fields or make your paragraphs bigger.

Subject: RE: Well, if you can not open it in the Notes Client, because of too many paragraphs, How…

Thank you for the tip, but I cannot :(The text is created by Oracle’s dbms_xmlgen, so I cannot change it. And I tried to loop through it with the other tool I know, NotesRichTextNavigator, but that one also failed (see http://www-10.lotus.com/ldd/nd6forum.nsf/DateAllThreadedweb/0B74FC5EBACF130085256E77004A210E FindNextElement in NotesRichTextNavigator returns not the next paragraph)