« Return to Thread: Plugins: when to perform web service requests, on fetch or on index?

Re: Plugins: when to perform web service requests, on fetch or on index?

by joel gump :: Rate this Message:

If only the urls is used, how about save urls to a database.
Then, another app check the database, call webservices.
Personally , i dont like mix something with crawl/index process.

On Thu, Jun 18, 2009 at 10:28 PM, caezar<caezaris@...> wrote:

>
> I don't think it will be faster: crawling is performed on cluster.
>
> joel gump wrote:
>>
>> how about write standalone app. analyze data after crawl and index.
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Plugins%3A-when-to-perform-web-service-requests%2C-on-fetch-or-on-index--tp24089858p24092992.html
> Sent from the Nutch - Dev mailing list archive at Nabble.com.
>
>

« Return to Thread: Plugins: when to perform web service requests, on fetch or on index?