"Complimentary" might be a better word. When I chatted with Grant Ingersoll, Chief Scientist at Lucid Imagination, to learn more about this aspect of the data warehousing sector, he outlined several examples of how LucidWorks could be combined with Hadoop tech to deliver useful results.
Because of the fuzzy matching capabilities of enterprise search, Ingersoll explained, it's perfect for performing functions like searching logs generated by web sites, then sending those results into analytic engines driven by Hadoop-related tools, which in turn can be fed back into the web site's control systems. Such a process would be ideal for monitoring an ecommerce site and provide near-real-time feedback on certain products' popularity.
"We're actually everywhere within big data," Ingersoll added. "Lucene has made search a commodity."
And there's little question about Lucene/Solr's ability to scale: Twitter, for instance, uses Lucene for its search functionality. Searches can be run as forensic-type searches, or queries that hone in on very finely grained data.
Last week, Lucid stepped up its game even further, with the general availability release of LucidWorks Cloud, a hosted service that Ingersoll coined as "search-as-a-service." (Because clearly we're all lacking *aaS terms these days.) Still, the concept is intriguing: instead of hosting a local instance of LucidWorks, businesses can now plug their data into this hosted edition and run their enterprise searches from the cloud.
If this takes off, this should greatly increase the visibility of enterprise search in general, since a business' data can be examined now without the overhead of deploying and managing a local Lucene/Solr instance.
Enterprise search may be about to get even bigger.
Read more of Brian Proffitt's Zettatag and Open for Discussion blogs and follow the latest IT news at ITworld. Drop Brian a line or follow Brian on Twitter at @TheTechScribe. For the latest IT news, analysis and how-tos, follow ITworld on Twitter and Facebook.