« Return to Thread: [jira] Created: (HADOOP-2649) The ReplicationMonitor sleep period should be configurable

[jira] Commented: (HADOOP-2649) The ReplicationMonitor sleep period should be configurable

by JIRA jira@apache.org :: Rate this Message:

Reply to Author | View in Thread


    [ https://issues.apache.org/jira/browse/HADOOP-2649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560569#action_12560569 ]

Hairong Kuang commented on HADOOP-2649:
---------------------------------------

+1 The patch looks good to me.

It would be nicer if the replication monitor can adjust its frequency dynamically. It slows itself down when the namenode becomes busy and replicates more aggressively when the namenode becomes idle.


> The ReplicationMonitor sleep period should be configurable
> ----------------------------------------------------------
>
>                 Key: HADOOP-2649
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2649
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>             Fix For: 0.16.0
>
>         Attachments: configurableReplicationPeriod.patch
>
>
> The HDFS Namenode computes replication work for datanodes once every 3 seconds. This should be a configurable  value. On large clusters, there could be many many blocks in the neededReplication queue and computing replication work for datanodes once every 3 seconds might consume lots of CPU on namenode.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

 « Return to Thread: [jira] Created: (HADOOP-2649) The ReplicationMonitor sleep period should be configurable