|

»

»

Hadoop core-user

realtime hadoop

View: Old framed views

14 Messages — Rating Filter: Alert me

Vadim Zaliva realtime hadoop - Hi! I am considering using Hadoop for (almost) realime data processing. I have data coming every second and I would... Loading...

‹

Stefan Groschupf-2 Hadoop might be the wrong technology for you. Map Reduce is a batch processing mechanism. Also HDFS might be ... Loading...

‹

Konstantin Shvachko > Also HDFS might be critical since to access your data you need to close the file Not anymore. Since 0.16 files are... Loading...

‹

Daniel Yu-2 2008/6/24 Konstantin Shvachko <shv@...>: > > Also HDFS might be critical since to access your data you need... Loading...

‹

Konstantin Shvachko Daniel wrote: >>> Also HDFS might be critical since to access your data you need to close >> the file >> >> Not... Loading...

‹

Ian Holsman Interesting. we are planning on using hadoop to provide 'near' real time log analysis. we plan on having files close... Loading...

‹

Matt Kent-2 We use Hadoop in a similar manner, to process batches of data in real-time every few minutes. However, we do... Loading...

‹

Vadim Zaliva Matt, How do you manage your tasks? Do you lauch them periodically or keep them somehow running and feed them... Loading...

‹

Matt Kent-2 We wrote some custom tools that poll for new data and launch jobs periodically. Matt On Tue, 2008-06-24 at 09:27... Loading...

‹

Chris K Wensel-2 On Jun 23, 2008, at 9:54 PM, Matt Kent wrote: > Unless you have a significant amount of work to be done, I... Loading...

‹

Fernando Padilla One use case I have a question about, is using Hadoop to power a web search or other query. So the full job should be... Loading...

‹

Ian Holsman Fernando Padilla wrote: > One use case I have a question about, is using Hadoop to power a web > search or other... Loading...

‹

Ian Holsman Matt Kent wrote: > We use Hadoop in a similar manner, to process batches of data in > real-time every few minutes.... Loading...

‹

Chris Anderson-11 Vadim, Depending on the nature of your data, CouchDB (http://couchdb.org) might be worth looking into. It speaks... Loading...