Realtime Map Reduce = Supercomputing for the Masses?

		Martin Jaggi-2 – Realtime Map Reduce = Supercomputing for the Masses? Martin Jaggi-2 Realtime Map Reduce = Supercomputing for the Masses? - Concerning real-time Map Reduce within (and not only between) machines (multi-core & GPU), e.g. the Phoenix and Mars... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Ted Dunning Ted Dunning Hadoop is highly optimized towards handling datasets that are much too large to fit into memory. That means that there... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Martin Jaggi-2 – Re: In memory Map Reduce Martin Jaggi-2 Re: In memory Map Reduce - Thanks for your comments! So in the case that all intermediate pairs fit into the RAM of the cluster, does the... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Ted Dunning Ted Dunning Hadoop goes to some lengths to make sure that things can stay in memory as much as possible. There are still cases,... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Martin Jaggi-2 Martin Jaggi-2 Is there some statistics available to monitor which percentage of the pairs remains in memory, and which percentage... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Brice Arnould Brice Arnould Hi ! With Qt 4.4, Trolltech provides a GPLed implementation of an in memory map/reduce for many languages (at least... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Martin Jaggi-2 – Re: Qt 4.4 / QtConcurrent Martin Jaggi-2 Re: Qt 4.4 / QtConcurrent - Thanks, it's very nice to see that they integrated Map Reduce. But as I understood it this does not work (yet) for... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Christophe Taton-5 Christophe Taton-5 Actually Hadoop could be made more friendly to such realtime Map/Reduce jobs. For instance, we could consider running... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Steve Loughran Steve Loughran Christophe Taton wrote: > Actually Hadoop could be made more friendly to such realtime Map/Reduce > jobs. > For... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Alejandro Abdelnur-2 Alejandro Abdelnur-2 Yes you would have to do it with classloaders (not 'hello world' but not 'rocket science' either). You'll be limited... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Steve Loughran Steve Loughran Alejandro Abdelnur wrote: > Yes you would have to do it with classloaders (not 'hello world' but not > 'rocket... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Christophe Taton-5 Christophe Taton-5 Hi Steve, On Mon, Jun 2, 2008 at 12:23 PM, Steve Loughran <stevel@...> wrote: > Christophe Taton... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Edward Capriolo Edward Capriolo I think that feature makes sense because starting JVM has overhead. On Sun, Jun 1, 2008 at 4:26 AM, Christophe Taton... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink

	‹	Martin Jaggi-2 – Re: other implementations of TaskRunner Martin Jaggi-2 Re: other implementations of TaskRunner - That would indeed be a nice idea, that there could be other implementations of TaskRunner suited for special... Loading...   Reply More Rate this Message: Delete Print Show in classic view Show in list view (by date) Permalink