what is diff between "mapred.map.tasks" and "mapred.tasktracker.map.tasks.maximum"

View: New views
1 Messages — Rating Filter:   Alert me  

what is diff between "mapred.map.tasks" and "mapred.tasktracker.map.tasks.maximum"

by Pravin Karne-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Some parts of this message have been removed. Learn more about Nabble's security policy.

Hi,

I am using nutch with 10 node cluster.

I want to configure nutch-site.xml

What is difference between “mapred.map.tasks”  and  “mapred.tasktracker.map.tasks.maximum”

Or

“mapred.reduce.tasks” and “mapred.tasktracker.reduce.tasks.maximum”

 

Thanks

-Pravin

 

From: Pravin Karne
Sent: Thursday, July 02, 2009 12:16 PM
To: 'nutch-dev@...'
Subject: Nutch is very slow....what does following graph shows

 

Hi,

I have 10 node Nutch cluster.

 

I have following report. Cluster have very low (slow) performance.(I am not using indexing…using nutch as web crawler)

What following reports shows…

Even I have 10 node  cluster at time shows only # running tasks as 3

Is this expected behavior or have to configure nutch in optimized way if so ..how to do that?

Thanks

 

Pravin

 

DISCLAIMER ========== This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.