Teradata lets you orchestrate queries across processing engines

By Thor Olavsrud , CIO |  Big Data, data warehouse, teradata

QueryGrid is a software-based service embedded in Teradata Database 15, also announced today, that's designed to allow Teradata Database to intelligently use the functionality and data of multiple heterogeneous processing engines, including Hadoop (via remote, push-down processing), other Teradata Databases and Teradata Aster Databases, as well as RDBMS databases.

"Attempts at federation have been unsuccessful for many reasons," says Scott Gnau, president of Teradata Labs. "To deliver value from big data, customers should create an architecture that allows the orchestration of analytic processes across parallel databases rather than federated servers. After the user selects an analytic engine and a file system, Teradata software seamlessly orchestrates analytic processing across systems with a single SQL query, without moving the data. In addition, Teradata allows for multiple file systems and engines in the same workload."

[Related: Teradata Turns to the Cloud, Offers Data Warehouse as a Service]

Queries can be initiated from a Teradata Database to access, filter and return subsets of data from Hadoop, Aster and other database environments to the Teradata Database for additional processing.

For instance, Gnau says, you might have a fraud analysis that's running in your data warehouse. To supercharge that process, you want to extend the analysis to seek out anomalies in your Web transactions - Web log data that probably resides in your Hadoop cluster. QueryGrid can spawn an algorithm that runs in your Hadoop cluster and then delivers the answer to your data warehouse, which can then incorporate the results into the final analysis.

"Teradata pioneered integration with Hadoop and HCatalog with Aster SQL-H to empower customers to run advanced analytics directly on vast amounts of data stored in Hadoop," says Ari Zilka, CTO of Hortonworks, whose engineering team works closely with Teradata engineers.

"Now they are taking it to the next level with pushdown processing in Hadoop, leveraging the Hive performance improvements from Hortonworks' Stinger initiative, delivering results at unprecedented speed and scale," Zilka says.

Gnau says QueryGrid capabilities will be available in the third quarter.

Read more about applications in CIO's Applications Drilldown.

Don't miss...


18 hot IT certifications for 2014

6 IT hiring tips to weed out the duds

The helpful, handy, FREE programs your new PC needs

  Sign me up for ITworld's FREE daily newsletter!
Email: 
 


Originally published on CIO |  Click here to read the original story.
Join us:
Facebook

Twitter

Pinterest

Tumblr

LinkedIn

Google+

Spotlight on ...
Online Training

    Upgrade your skills and earn higher pay

    Readers to share their best tips for maximizing training dollars and getting the most out self-directed learning. Here’s what they said.

     

    Learn more

Big DataWhite Papers & Webcasts

See more White Papers | Webcasts

Answers - Powered by ITworld

ITworld Answers helps you solve problems and share expertise. Ask a question or take a crack at answering the new questions below.

Ask a Question