Nutch is not crawling all outlinks

View: New views

1 Messages — Rating Filter: Alert me

Nutch is not crawling all outlinks

by Pravin Karne-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Some parts of this message have been removed. Learn more about Nabble's security policy.

Nutch is not crawling all outlinks even with following property

<name>db.max.outlinks.per.page</name>

<description>The maximum number of outlinks that we'll process for a page.

If this value is nonnegative (>=0), at most db.max.outlinks.per.page outlinks

will be processed for a page; otherwise, all outlinks will be processed.

</description>

</property>

Any help regarding this.

Thanks in advance.

DISCLAIMER ========== This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.