Hi
We have a sit built on top of HCL DX, and we've prepared sitemap.xml files using WCM Navigator component. We want to crawl all pages of this sitemap.xml file using HCL DX Search Service. We tried Content as a service (caas) URLs inside Search Service, but its not visiting any of the URLs.
Want to know if its feasible to crawl all the URLs from inside sitemap.xml using HCL DX Search Service or not? If feasible, how?
HCL DX Version: HCL DX v9.5 CF216
Hi Mohammad,
so far I know you can do something similar by using the Search Sitemap Portal. For details, please check:
Configuring the Search Sitemap portlet for search by external search engines
Or is there something specific, because you want to crawl only the sitemap.xml file?
Thanks for the clarification
with best regards
Thorsten
Hi Thorsten
There is specific requirement to crawl only sitemap.xml file only. I had gone through the above link but it doesn't seems to useful for this requirement.
Hi Ashfaq,
Can you elaborate on what is happening when you mentioned - its not visiting any of the URLs ?
I believe you have referred the following for Caas URLs:
https://opensource.hcltechsw.com/digital-experience/CF220/manage_content/wcm_delivery/content_as_a_service/
Did you also refer the links on the bottom of that page and checked if they are helpful?:-
Writing links to web content
https://opensource.hcltechsw.com/digital-experience/CF220/manage_content/wcm_authoring/authoring_portlet/content_management_artifacts/tags/wcm_dev_writing-links/
URL Addressability
https://opensource.hcltechsw.com/digital-experience/CF220/build_sites/create_sites/url_addressing/
Hi Anushree
The caas URLs are working and I am able to get the expected outcome which is sitemap xml file, but when I configure caas URLs in Service Provider its not collection the document.
I want to know if any of the Content Source Type i.e. Web Site, Seedlist, Portal Site or Web Content supports crawling of the document with sitemap.xml or not? If Yes, how?
For example: I have portal www.portalsite.com, and I have placed sitemap.xml file on URL www.portalsite.com/sitemap. This sitemap.xml contains only limited URLs that I wanted to be crawled using Portal's search service. How should I configure Portal search service so that it can crawl all the URLs present in www.portalsite.com/sitemap
Hi Ashfaq,
For crawling the URLs from the sitemap.xml, you might want to visit the documentation here:
https://help.hcltechsw.com/digital-experience/9.5/admin-system/srtcfgsitemap1.html?hl=sitemap