Hadoop ready for corporate IT, execs say

Despite some concerns, Hadoop has a growing place in the enterprise, say IT execs from JP Morgan Chase, eBay

By , Computerworld |  Software, big data, Hadoop

Hadoop and Hbase allow EBay to build a far more sophisticated search engine than Voyager. Cassini will deliver more accurate and more context-based results to user search queries, he said.

With more than 100 engineers assigned to Project Cassini full time, the development effort is one of the largest ever at EBay.

Cassini is expected to go live next year.

Hadoop allows companies to store and manage far bigger volumes of structured and unstructured data than can be managed affordably by today's relational database management systems.

Large web companies like Yahoo and Google have been using Hadoop for several years, but the open source technology has only recently started to attract the attention of enterprise IT executives.

"Hadoop is no longer ancillary in the data center. It is the place where data goes first" in a growing number of instances, said Mike Olson, CEO of Cloudera, the host of Hadoop World.

Increasingly, companies are using Hadoop to collect, aggregate and share very large volumes of data from multiple, disparate sources, he said.

"We have spent three years talking speeds and feeds. We have spent three years saying Hadoop is happening," Olson said. "What we will see going forward is much more innovation around business focused solutions,"

According to Feinsmith, there are several considerations that enterprises need to keep in mind when deploying Hadoop.

The marketplace for the technology is still "very confusing" with oft-changing Hadoop vendors, products and standards.

In addition, companies considering Hadoop must be sure that it can integrate with their existing IT investments, he said. The relative of lack of skilled hadoop engineers is also a concern, Feinsmith said.

And the massive data aggregation enabled by Hadoop can raise concerns related to security, data access, data entitlement, monitoring, high availability and business continuity, he said.

Related technologies such as Hbase are just starting to emerge, which raises stability questions, Williams said.

Jaikumar Vijayan covers data security and privacy issues, financial services security and e-voting for Computerworld. Follow Jaikumar on Twitter at @jaivijayan , or subscribe to Jaikumar's RSS feed . His e-mail address is jvijayan@computerworld.com .

Read more about bi and analytics in Computerworld's BI and Analytics Topic Center.


Originally published on Computerworld |  Click here to read the original story.
Join us:
Facebook

Twitter

Pinterest

Tumblr

LinkedIn

Google+

Answers - Powered by ITworld

ITworld Answers helps you solve problems and share expertise. Ask a question or take a crack at answering the new questions below.

Ask a Question
randomness