[jira] Created: (NUTCH-679) Fetcher2 implementing Tool

Fetcher2 implementing Tool
--------------------------

                 Key: NUTCH-679
                 URL: https://issues.apache.org/jira/browse/NUTCH-679
             Project: Nutch
          Issue Type: Improvement
          Components: fetcher
            Reporter: julien nioche
            Priority: Minor
         Attachments: Fetcher2.Tool.patch

The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
instead of having to modify the *-site.xml files in conf/


--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

     [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

julien nioche updated NUTCH-679:
--------------------------------

    Attachment: Fetcher2.Tool.patch

Patch which makes Fetcher2 implement Tool interface

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665125#action_12665125 ]

Doğacan Güney commented on NUTCH-679:
-------------------------------------

Looks simple enough. I am going to commit it soon if no objections.

Btw, please use 2-space tabs otherwise it messes up patches :)

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665482#action_12665482 ]

Otis Gospodnetic commented on NUTCH-679:
----------------------------------------

I'm not sure, but committing this may mess up Todd's work on merging Fetcher and Fetcher2.

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665791#action_12665791 ]

julien nioche commented on NUTCH-679:
-------------------------------------

I can send a modified version of it once Todd has finished working on the Fetchers. Same for https://issues.apache.org/jira/browse/NUTCH-658 

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

     [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julien Nioche updated NUTCH-679:
--------------------------------

    Attachment: NUTCH-679.patch

Updated version of the patch

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

     [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrzej Bialecki  closed NUTCH-679.
-----------------------------------

       Resolution: Fixed
    Fix Version/s: 1.1
         Assignee: Andrzej Bialecki

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Assignee: Andrzej Bialecki
>            Priority: Minor
>             Fix For: 1.1
>
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764066#action_12764066 ]

Andrzej Bialecki  commented on NUTCH-679:
-----------------------------------------

Fixed in rev. 823600. Thanks!

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Assignee: Andrzej Bialecki
>            Priority: Minor
>             Fix For: 1.1
>
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764295#action_12764295 ]

Hudson commented on NUTCH-679:
------------------------------

Integrated in Nutch-trunk #959 (See [http://hudson.zones.apache.org/hudson/job/Nutch-trunk/959/])
     Fetcher2 implementing Tool.

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Assignee: Andrzej Bialecki
>            Priority: Minor
>             Fix For: 1.1
>
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g.
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.