Explosive growth expected for Hadoop
By Mark Dexter
10th May 2012

The market for software related to the Hadoop and MapReduce programming frameworks for large-scale data analysis will jump from $77 million in 2011 to $812.8 million in 2016, a compound annual growth rate of 60.2%, according to a new report released Monday by analyst firm IDC.

Hadoop is an open-source implementation of the MapReduce framework. It is hosted at the Apache Software Foundation along with a number of supporting software projects, including the Hadoop Distributed File System (HDFS) and Pig programming language.

MapReduce and Hadoop are based on the principle of splitting up large amounts of data and then processing the chunks in parallel across large numbers of nodes. It's closely associated with the industry buzzword "big data," which refers to the ever-larger volumes of information, particularly of unstructured form, being generated by websites, social media, sensors and other sources.

Overall, Hadoop has enjoyed a steady stream of interest from commercial analytics and database vendors in recent years, who have begun offering commercial products and services for it.

While "fantastic and largely unsupportable claims have been made" regarding Hadoop and MapReduce's use cases and benefits, "there can be no doubt that it does provide a relatively low-cost means of deriving considerable value from very large collections of unorganized data," IDC analysts Carl Olofson and Dan Vesset wrote in the report.

Therefore, the conditions are right for significant growth in the Hadoop-MapReduce "ecosystem," according to IDC.

This year, "Leading adopters in the mainstream IT world will move from 'proof of concept' to real value," the report states.

However, lack of qualified talent will limit the technology's rise during the next two to three years, it adds.

The coming years will also see a "battle between open source purists, who believe that the core of Hadoop deployment must be based purely on the Apache project code," according to IDC. However, most IT organizations will use a mix of commercial and open-source components in their Hadoop environments, the report adds.

Still, "competition between open source vendors and their closed source counterparts may force lower license fees from the latter group, resulting in somewhat slower software revenue growth than would be the case if open source projects did not represent so large a component of this market space."

Read at Source: Computerworld

Comments

Currently there are no comments. Be the first to post one!

Post Comment

*
*
*

Top 5 articles of 2017

2018 is almost upon us, and now is a time for looking back over the year that has been 2017. Here at KDR we have a had a very busy year; with our brand-new expansion to the USA , setting up... Read More

Information Matters – Real-time analytics & consumer spending

We are very proud to announce the fourth issue of Information Matters ! As recruiters in the information management and data analytics industry we consider it vital to be in the know about issues and events facing our industry and your... Read More

How the evolution of AI is transforming the e-commerce industry

Artificial Intelligence has unleashed the power for e-commerce businesses to explore countless opportunities to dramatically improve customer experiences, generate new leads and better understand their customers. Businesses are continuing to evolve and are steadily incorporating Artificial Intelligence into their strategies... Read More

Why do I headhunt?

The data and analytics industry is a competitive market, with many of the best candidates not actively looking for roles. This means as a recruiter I have to search and sometimes ‘cold call’ the best candidates. Headhunting calls (and recruiters)... Read More

Where should we send our newsletter?

Close