Cray integrates Hadoop Big Data analytics with supercomputers

CS300 systemspaired with Intel distribution for Apache Hadoop software

Cray is bringing integrated open source Hadoop Big Data analytics software to its supercomputing platforms.

Cray cluster supercomputers for Hadoop will pair Cray CS300 systems with the Intel distribution for Apache Hadoop software.

The Hadoop system will include a Linux operating system, workload management software, the Cray Advanced Cluster Engine (ACE) management software and the Intel distribution.

"More and more organisations are expanding their usage of Hadoop software beyond just basic storage and reporting. But while they're developing increasingly complex algorithms and becoming more dependent on getting value out of Hadoop systems, they are also pushing the limits of their architectures," said Bill Blake, CTO of Cray.

"Organisations can now focus on scaling their use of platform-independent Hadoop software, while gaining the benefits of important underlying architectural advantages from Cray and Intel."

IDC analyst Steve Conway said, "The convergence of data-intensive HPC and high-end commercial analytics is forming a new Big Data market IDC calls High Performance Data Analysis, and most of this work is and will be done on clusters."

The Cray CS300 systems are integrated with software tools compatible with most open source and commercial compilers, tools, schedulers and libraries to run complex applications, Cray said.

Earlier this week IDC predicted a rosy market for supercomputers this year despite a sales slip in the first quarter.

IDC anticipates that through the rest of 2013, the supercomputers segment of the High Performance Computing market will see increased growth driven by the deployment of additional large systems across the world.

"Supercomputer revenues actually accelerated during the global economic downturn, driven by the growing recognition of the crucial role these systems play in economic competitiveness as well as scientific progress," said IDC analyst Earl Joseph.

This story, "Cray integrates Hadoop Big Data analytics with supercomputers" was originally published by Computerworld UK.

Top 10 Hot Internet of Things Startups
Join the discussion
Be the first to comment on this article. Our Commenting Policies