DominIQ and the Remote Embedded Model

Please complete the details below then remove this line:


Domino/Notes Version: 14.5.1FP1
Operating System:Rocky 10.2
Client: Notes


Problem/Query:

Hi. I need help. I’m setting up DominoIQ for remote use RAG (I use ollama for testing), but when i initializing the vector (updall -w), I get the error: Error: Vector host not specified.

My config:

And error:

image

Who knows what’s wrong?

Have you configured the vector database on that tab so it points to localhost ?

Hi. Yes. Default settings.

Have you also done these steps

Hi. Yes.

Step 1 - Ok.

Step 2 - error

Have you also followed / tried the steps in section
Maintaining a RAG-enabled vector database

Because as far as I know indexing/reindexing of Rag databases must be done manually

Excuse me, what maintenance are you talking about if vectorization doesn’t complete based on the instructions?
Maintenance should be performed once vectorization is already in place, but the problem is that with the Remote RAG, vectorization DOESN’T OCCUR for some reason (

You can try to remove it first
load updall -w -d

And then reenable it

Also try to add
DEBUG_DOMIQ=1
If you haven’t and look in the IBM Technical Support folder for logs about the vector store.

Have you enabled some commands to point to the rag database and added what fields it should use?

Unfortunately, -w -d doesn’t work either (

The DEBUG_DOMIQ=1 parameter is already set. And the errors reported are only displayed because of it.

There are no LLM logs in the IBM Technical Support folder. Try setting up a remote RAG yourself. What behavior will you get?
Unfortunately, the documentation doesn’t describe how to set up a remote embedded model. Maybe it still doesn’t work and I’m wasting my time researching?

Hello,

I’m realy sure, RAG is currently only possible with an LLM running on the DominoIQ server, not with a remote LLM.

In Domino 14.5.1, RAG support is available only when the Domino IQ server is configured in Local mode, so the LLM handling RAG source content is running on the Domino IQ servers configured for RAG.

Source:

DS Academy Tutorial

That should have been a fix in 14.5.1 fp1 according to this.

Open a support ticket with HCL they can help you pinpointing your issue.
Please write here when you find the solution.

No, I have only tested rag with a local LLM so far

Thankx Fredrik, that was new for me.