What are the emerging alternatives to Hadoop?

declanchase2

And what chance do they have?

Tags: Hadoop
Topic: Big Data
Answer this Question

Answers

8 total
jimlynch
Vote Up (36)

Hi Declanchase2,

Here are a few articles with ideas about alternatives to Hadoop.

Hadoop Fatigue -- Alternatives to Hadoop
http://www.bytemining.com/2011/08/hadoop-fatigue-alternatives-to-hadoop/

What are some promising open-source alternatives to Hadoop MapReduce for map/reduce?
http://www.quora.com/What-are-some-promising-open-source-alternatives-to...

Alternatives for Hadoop/MapReduce data storage and management
http://www.dbms2.com/2011/05/14/hadoop-mapreduce-data-storage-management/

Vote Up (33)

Hi Declanchase2,


There are many Hadoop alternatives out there. The HPCC Systems platform is among them for tackling Big Data problems. Unlike Hadoop distributions which have only been available since 2009, HPCC is a mature platform, and provides for a data delivery engine together with a data transformation and linking system equivalent to Hadoop. The main advantages over other alternatives are the real-time delivery of data queries and the extremely powerful ECL language programming model.

 

More at http://hpccsystems.com

jiexiao
Vote Up (25)

welcome to our website:

------- http://www.likesurprise.com/ --------

if you like to order anything you like.

More details,

please just browse our website Quality is our Dignity;

Service is our Lift.

enjoy yourself.

thank you!!

Robert Metzger
Vote Up (17)

Hi,

there are several alternative systems that can solve the same and more problems than Hadoop.

https://stratosphere.eu/ is a project that started out as a research project at a university. It has a novel model that allows for more operators than just map and reduce. (It also natively supports match, cross and more). It additionally allows for arbitrary complex job graphs. So you can compine these operators in any way you like. So you could have three inputs, that are joined, reduced, mapped and reduced (by another key). You can even write to as many outputs as you want.
Additionally, Stratosphere also supports iterative algorithms (often needed for Data Mining/Machine Learning). Since this is "natively" implemented into the system, Stratosphere does way better on those jobs than traditional hadoop systems.

There is an actively developed open source version of it on github: https://github.com/dimalabs/ozone 

Another project is Spark: http://spark.incubator.apache.org/ 

It allows applications to be written in Scala, which is an very powerful and expressive functional programming language (Stratosphere also supports Scala). It is really fast on job setup, hence it is very suited for small and medium sized data and ad-hoc evaluations.

Take also a look into the things Cloudera and its competitors are doing (Impala, Hive Stinger Initiative)

 

Disclaimer: I'm a developer of stratosphere ;)

Lenin Nair
Vote Up (8)

Wrong link, here is the correct link

Lenin Nair
Vote Up (8)
Lenin Nair
Vote Up (8)

Indeed there are. In a recent post at MSys, we had discussed about alternatives for Hadoop. Check it out.

Christian Block
Vote Up (0)

Zillabyte is an alternative that's getting traction trying to make big data easy for developers and data scientists. (Full disclosure I work there).  I think we have a great chance, but it won't be an overnight shift.  Hadoop is well established in this space.  We are trying to make distributed computing available to devs and data scientists who know how to program, but don't want to deal with the difficulties of setting up a Hadoop cluster.  Hadoop is great for analyzing petabytes of data, but the tradeoff is that it's expensive to have a team set up and maintain.  There are companies like HortonWorks that specialize in enterprise Hadoop installation to make it easier.  I think it will be interesting over the next several years to see how the industry changes, and to see how Hadoop adapts. 

Ask a question

Join Now or Sign In to ask a question.
There's a new Wild West to be tamed: all those (uncoordinated) data analytics projects sprouting throughout your organization.
As organizations seek to not simply corral data, but apply it strategically across the business, analytics experts are making their way into the C-suite.
Technology has turned the towing business into an information business, according to Dave Ferrick, CEO of Agero.
Mapping intelligence isn't just for retailers anymore. Advanced analytics uses location data to reveal new insights about customers.
Progressive Insurance deploys open-source data analytics software to optimize its ad strategy.
New job listing data shows that demand for Python developers is up significantly
A new study finds that scripting languages have a performance edge in completing everyday tasks
A new study of GitHub data reveals characteristics of successful open source projects
A study by Accenture finds that many organizations are putting big data initiatives into production and the vast majority of those that do are pleased with the results.
Aiming to eliminate a number of onerous data engineering tasks, MapR today updated its distribution of Hadoop to include Apache Drill 0.5.

White Papers & Webcasts

See more White Papers | Webcasts