Indexing Problem ---- All the documents are not getting indexed.

[former_member787462]

Hello All,

In our portal almost 40,000 thousand documents are there in one particular folder.

I have created one index and assigned the date source( which contains 40,000 documents) to that index.

Almost all the 39,000 documents are got indexed and there are 1000 documents are not got indexed.We have tried re - indexing to get those documents to indexed , but only 50 documents are got indexed , still we have 950 documents needs to be indexed.

I have seen whether we can see which are all the documents is not got indexed from the Monitoring -> TREX monitor -> Display Queue.But there also those documents are not showed.

Could you please help me , how we can achieve this documents to got index and also advise whether we can develop any custom component to find out all the documents which does not have status is "Ok :Index Operation" , so that we can flush all the documents which is not indexed to got index, so that this will be available in search.

Please help me in this, it will be a great help for me.

Thank you.

Best Regards,

Manoj K

[Former Member · Accepted solution]

Check Index logs. are those 950 documents which are not indexed are password ptrotected?

If possible check log on trex server.

Nitesh

[former_member787462 · Accepted solution]

Hi Nitesh,

Thanks for the reply.

If the documents are password protected, will that documents are not get indexed ??.And also advise where to check the TREX logs in portal itself.

Thanks!

Best Regards,

Manoj K

[Former Member · Accepted solution]

Hi,

from SAP support I got the information that indexing password protected files should work with the last TREX patch...

Bye Steve

[former_member787462 · Accepted solution]

Hi,

Thanks for the reply.But Can you please let me know, whether we can develop any custom component to achieve this requirement.

Thanks

Best Regards,

Manoj K

[former_member787462 · Accepted solution]

Hello All,

Do you have any update on my above query ?

Best Regards,

Manoj K

[duncanspeidel · Accepted solution]

Hi Manoj K,

In the TREX Admin tool (OS tool) goto the Queue Topic and select Content. In the content area select the queue and change status to something other than optimized. This step assumes that documents were sent to TREX. On the Admin tab you can get a break down of the different status. You can use this information on the content tab.

If the documents are not sent to TREX from KM you should check the crawler log (System Administration > Monitoring > KM > Crawler Monitor. You will have to change the status value to a timeframe during which a crawl was attempted.

Cheers,

Duncan

[Former Member · Accepted solution]

Hi,

Documents will not be indexed if,

1. Documents are in folder on which workflow is enabled, and documents are not in approved status

2. If folder has time based publishing on, and document has already expired

3. If folder is not added to index, it will be silly to miss this

On reindexing, you can either reindex everything or allow delta indexing to take place. If these documents you have added recently then may be its delta indexing issue. What is indexing status on this documents? In progess or pending or failed?

Your queue parameters might be incorrect, it may be waiting for 1000> new docs to get added or time based delta might be not working..

Regarding custom component, It is perfectly possible to write a KM report to identify what all documents are not yet index. But if indexing has failed, you will find the failed document list in index logs and from there you can reporocess errored documents. Moreover in trex server log you can find more details on why indexing has failed.

Nitesh