Hadoop TLP?

[Doug Cutting-4]

I think it is time that we make Hadoop a top level project (TLP) at
Apache, hadoop.apache.org, leaving our current home as a Lucene
subproject.  HBase could become a sub-project, as could Pig (now
incubating) and perhaps others.

Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its
community has considerably less overlap with other Lucene subprojects
than the rest. It also is beginning to have subproject-like things of
its own, like HBase, pushing the boundaries of subproject management.

Many members of the Lucene PMC have little familiarity with the Hadoop
community.  For example, HBase might like to nominate a new committer,
but a majority of the Lucene PMC would find it difficult to evaluate
this candidate, since they do not follow HBase development.  It would be
better if such discussions could be made by a PMC that had
representation from and broad familiarity with HBase.

Diversity is an issue with Hadoop becoming a TLP.  The majority of
Hadoop committers are employed by Yahoo!.  But I think we can construct
an initial PMC that is diverse enough to overcome this, with perhaps
three folks from Yahoo!, two from Powerset, and three or four
independent folks, so that Yahoo! does not have a majority on the PMC.

Would other members of the Hadoop community support this move?

Thanks,

Doug

[Owen O'Malley-2]

On Dec 13, 2007, at 3:21 PM, Doug Cutting wrote:

> I think it is time that we make Hadoop a top level project (TLP) at  
> Apache

+1

[Nigel Daley-2]

On Dec 13, 2007, at 3:21 PM, Doug Cutting wrote:

> I think it is time that we make Hadoop a top level project (TLP) at  
> Apache

+1

[Dennis Kubes-2]

+1

Nigel Daley wrote:
>
> On Dec 13, 2007, at 3:21 PM, Doug Cutting wrote:
>
>> I think it is time that we make Hadoop a top level project (TLP) at
>> Apache
>
> +1

[stack-3]

Doug Cutting wrote:
> I think it is time that we make Hadoop a top level project (TLP) at
> Apache, hadoop.apache.org, leaving our current home as a Lucene
> subproject.  HBase could become a sub-project, as could Pig (now
> incubating) and perhaps others.

+1

[Jim Kellerman]

+1

---
Jim Kellerman, Senior Engineer; Powerset

> -----Original Message-----
> From: Doug Cutting [mailto:cutting@...]
> Sent: Thursday, December 13, 2007 3:22 PM
> To: hadoop-dev@...
> Subject: Hadoop TLP?
>
> I think it is time that we make Hadoop a top level project
> (TLP) at Apache, hadoop.apache.org, leaving our current home
> as a Lucene subproject.  HBase could become a sub-project, as
> could Pig (now
> incubating) and perhaps others.
>
> Hadoop, unlike all other Lucene subprojects, does not use
> Lucene.  Its community has considerably less overlap with
> other Lucene subprojects than the rest. It also is beginning
> to have subproject-like things of its own, like HBase,
> pushing the boundaries of subproject management.
>
> Many members of the Lucene PMC have little familiarity with
> the Hadoop community.  For example, HBase might like to
> nominate a new committer, but a majority of the Lucene PMC
> would find it difficult to evaluate this candidate, since
> they do not follow HBase development.  It would be better if
> such discussions could be made by a PMC that had
> representation from and broad familiarity with HBase.
>
> Diversity is an issue with Hadoop becoming a TLP.  The
> majority of Hadoop committers are employed by Yahoo!.  But I
> think we can construct an initial PMC that is diverse enough
> to overcome this, with perhaps three folks from Yahoo!, two
> from Powerset, and three or four independent folks, so that
> Yahoo! does not have a majority on the PMC.
>
> Would other members of the Hadoop community support this move?
>
> Thanks,
>
> Doug
>
>

[edward yoon]

+1
------------------------------

B. Regards,

Edward yoon @ NHN, corp.
Home : http://www.udanax.org

> Date: Thu, 13 Dec 2007 15:21:38 -0800
> From: cutting@...
> To: hadoop-dev@...
> Subject: Hadoop TLP?
>
> I think it is time that we make Hadoop a top level project (TLP) at
> Apache, hadoop.apache.org, leaving our current home as a Lucene
> subproject. HBase could become a sub-project, as could Pig (now
> incubating) and perhaps others.
>
> Hadoop, unlike all other Lucene subprojects, does not use Lucene. Its
> community has considerably less overlap with other Lucene subprojects
> than the rest. It also is beginning to have subproject-like things of
> its own, like HBase, pushing the boundaries of subproject management.
>
> Many members of the Lucene PMC have little familiarity with the Hadoop
> community. For example, HBase might like to nominate a new committer,
> but a majority of the Lucene PMC would find it difficult to evaluate
> this candidate, since they do not follow HBase development. It would be
> better if such discussions could be made by a PMC that had
> representation from and broad familiarity with HBase.
>
> Diversity is an issue with Hadoop becoming a TLP. The majority of
> Hadoop committers are employed by Yahoo!. But I think we can construct
> an initial PMC that is diverse enough to overcome this, with perhaps
> three folks from Yahoo!, two from Powerset, and three or four
> independent folks, so that Yahoo! does not have a majority on the PMC.
>
> Would other members of the Hadoop community support this move?
>
> Thanks,
>
> Doug
>

_________________________________________________________________
Share life as it happens with the new Windows Live.
http://www.windowslive.com/share.html?ocid=TXT_TAGHM_Wave2_sharelife_122007

[Jeff Hammerbacher]

+1

On Dec 13, 2007 6:18 PM, edward yoon <webmaster@...> wrote:

>
> +1
> ------------------------------
>
> B. Regards,
>
> Edward yoon @ NHN, corp.
> Home : http://www.udanax.org
>
>
> > Date: Thu, 13 Dec 2007 15:21:38 -0800
> > From: cutting@...
> > To: hadoop-dev@...
> > Subject: Hadoop TLP?
> >
> > I think it is time that we make Hadoop a top level project (TLP) at
> > Apache, hadoop.apache.org, leaving our current home as a Lucene
> > subproject. HBase could become a sub-project, as could Pig (now
> > incubating) and perhaps others.
> >
> > Hadoop, unlike all other Lucene subprojects, does not use Lucene. Its
> > community has considerably less overlap with other Lucene subprojects
> > than the rest. It also is beginning to have subproject-like things of
> > its own, like HBase, pushing the boundaries of subproject management.
> >
> > Many members of the Lucene PMC have little familiarity with the Hadoop
> > community. For example, HBase might like to nominate a new committer,
> > but a majority of the Lucene PMC would find it difficult to evaluate
> > this candidate, since they do not follow HBase development. It would be
> > better if such discussions could be made by a PMC that had
> > representation from and broad familiarity with HBase.
> >
> > Diversity is an issue with Hadoop becoming a TLP. The majority of
> > Hadoop committers are employed by Yahoo!. But I think we can construct
> > an initial PMC that is diverse enough to overcome this, with perhaps
> > three folks from Yahoo!, two from Powerset, and three or four
> > independent folks, so that Yahoo! does not have a majority on the PMC.
> >
> > Would other members of the Hadoop community support this move?
> >
> > Thanks,
> >
> > Doug
> >
>
> _________________________________________________________________
> Share life as it happens with the new Windows Live.
>
> http://www.windowslive.com/share.html?ocid=TXT_TAGHM_Wave2_sharelife_122007

[Paul Saab-2]

+1

On Dec 13, 2007 6:26 PM, Jeff Hammerbacher <jeff.hammerbacher@...>
wrote:

> +1
>
> On Dec 13, 2007 6:18 PM, edward yoon <webmaster@...> wrote:
>
> >
> > +1
> > ------------------------------
> >
> > B. Regards,
> >
> > Edward yoon @ NHN, corp.
> > Home : http://www.udanax.org
> >
> >
> > > Date: Thu, 13 Dec 2007 15:21:38 -0800
> > > From: cutting@...
> > > To: hadoop-dev@...
> > > Subject: Hadoop TLP?
> > >
> > > I think it is time that we make Hadoop a top level project (TLP) at
> > > Apache, hadoop.apache.org, leaving our current home as a Lucene
> > > subproject. HBase could become a sub-project, as could Pig (now
> > > incubating) and perhaps others.
> > >
> > > Hadoop, unlike all other Lucene subprojects, does not use Lucene. Its
> > > community has considerably less overlap with other Lucene subprojects
> > > than the rest. It also is beginning to have subproject-like things of
> > > its own, like HBase, pushing the boundaries of subproject management.
> > >
> > > Many members of the Lucene PMC have little familiarity with the Hadoop
> > > community. For example, HBase might like to nominate a new committer,
> > > but a majority of the Lucene PMC would find it difficult to evaluate
> > > this candidate, since they do not follow HBase development. It would
> be
> > > better if such discussions could be made by a PMC that had
> > > representation from and broad familiarity with HBase.
> > >
> > > Diversity is an issue with Hadoop becoming a TLP. The majority of
> > > Hadoop committers are employed by Yahoo!. But I think we can construct
> > > an initial PMC that is diverse enough to overcome this, with perhaps
> > > three folks from Yahoo!, two from Powerset, and three or four
> > > independent folks, so that Yahoo! does not have a majority on the PMC.
> > >
> > > Would other members of the Hadoop community support this move?
> > >
> > > Thanks,
> > >
> > > Doug
> > >
> >
> > _________________________________________________________________
> > Share life as it happens with the new Windows Live.
> >
> >
> http://www.windowslive.com/share.html?ocid=TXT_TAGHM_Wave2_sharelife_122007
>

[Tom White]

+1

On 13/12/2007, Doug Cutting <cutting@...> wrote:

> I think it is time that we make Hadoop a top level project (TLP) at
> Apache, hadoop.apache.org, leaving our current home as a Lucene
> subproject.  HBase could become a sub-project, as could Pig (now
> incubating) and perhaps others.
>
> Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its
> community has considerably less overlap with other Lucene subprojects
> than the rest. It also is beginning to have subproject-like things of
> its own, like HBase, pushing the boundaries of subproject management.
>
> Many members of the Lucene PMC have little familiarity with the Hadoop
> community.  For example, HBase might like to nominate a new committer,
> but a majority of the Lucene PMC would find it difficult to evaluate
> this candidate, since they do not follow HBase development.  It would be
> better if such discussions could be made by a PMC that had
> representation from and broad familiarity with HBase.
>
> Diversity is an issue with Hadoop becoming a TLP.  The majority of
> Hadoop committers are employed by Yahoo!.  But I think we can construct
> an initial PMC that is diverse enough to overcome this, with perhaps
> three folks from Yahoo!, two from Powerset, and three or four
> independent folks, so that Yahoo! does not have a majority on the PMC.
>
> Would other members of the Hadoop community support this move?
>
> Thanks,
>
> Doug
>
>

--
Blog: http://problemsworthyofattack.blogspot.com/

[Enis Soztutar]

+1

Tom White wrote:

> +1
>
> On 13/12/2007, Doug Cutting <cutting@...> wrote:
>  
>> I think it is time that we make Hadoop a top level project (TLP) at
>> Apache, hadoop.apache.org, leaving our current home as a Lucene
>> subproject.  HBase could become a sub-project, as could Pig (now
>> incubating) and perhaps others.
>>
>> Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its
>> community has considerably less overlap with other Lucene subprojects
>> than the rest. It also is beginning to have subproject-like things of
>> its own, like HBase, pushing the boundaries of subproject management.
>>
>> Many members of the Lucene PMC have little familiarity with the Hadoop
>> community.  For example, HBase might like to nominate a new committer,
>> but a majority of the Lucene PMC would find it difficult to evaluate
>> this candidate, since they do not follow HBase development.  It would be
>> better if such discussions could be made by a PMC that had
>> representation from and broad familiarity with HBase.
>>
>> Diversity is an issue with Hadoop becoming a TLP.  The majority of
>> Hadoop committers are employed by Yahoo!.  But I think we can construct
>> an initial PMC that is diverse enough to overcome this, with perhaps
>> three folks from Yahoo!, two from Powerset, and three or four
>> independent folks, so that Yahoo! does not have a majority on the PMC.
>>
>> Would other members of the Hadoop community support this move?
>>
>> Thanks,
>>
>> Doug
>>
>>
>>    
>
>
>  

[Sanjay Radia]

+1

[Christophe Taton-4]

Doug Cutting wrote:
> I think it is time that we make Hadoop a top level project (TLP) at Apache
+1


Regards

[Konstantin Shvachko]

+1

Is there a link for diversity regulations on apache site?

Doug Cutting wrote:

> I think it is time that we make Hadoop a top level project (TLP) at
> Apache, hadoop.apache.org, leaving our current home as a Lucene
> subproject.  HBase could become a sub-project, as could Pig (now
> incubating) and perhaps others.
>
> Hadoop, unlike all other Lucene subprojects, does not use Lucene.  Its
> community has considerably less overlap with other Lucene subprojects
> than the rest. It also is beginning to have subproject-like things of
> its own, like HBase, pushing the boundaries of subproject management.
>
> Many members of the Lucene PMC have little familiarity with the Hadoop
> community.  For example, HBase might like to nominate a new committer,
> but a majority of the Lucene PMC would find it difficult to evaluate
> this candidate, since they do not follow HBase development.  It would be
> better if such discussions could be made by a PMC that had
> representation from and broad familiarity with HBase.
>
> Diversity is an issue with Hadoop becoming a TLP.  The majority of
> Hadoop committers are employed by Yahoo!.  But I think we can construct
> an initial PMC that is diverse enough to overcome this, with perhaps
> three folks from Yahoo!, two from Powerset, and three or four
> independent folks, so that Yahoo! does not have a majority on the PMC.
>
> Would other members of the Hadoop community support this move?
>
> Thanks,
>
> Doug
>
>

[Doug Cutting-4]

Konstantin Shvachko wrote:
> Is there a link for diversity regulations on apache site?

There is for exiting the incubator:

http://incubator.apache.org/incubation/Incubation_Policy.html#Graduating+from+the+Incubator

That states: "The project is not highly dependent on any single
contributor (there are at least 3 legally independent committers and
there is no single company or entity that is vital to the success of the
project)".

These are generally understood to also apply to subprojects becoming
TLPs.  The letter of the law is thus "3 legally independent committers",
which Hadoop meets, but the spirit is more difficult to interpret.  I
think, if Y! were to cease its contributions to Hadoop that the project
would survive.  It would develop more slowly, especially at first, but I
think it would survive.

Doug