TDWI Research Report Reveals Hadoop Technologies to Impact Half of BI/DW Environments within Next Three Years
User acceptance and aggressive adoption of open source solutions indicate preparations under way to meet the growing demands of big data and advanced analytics
SEATTLE, WA, April 1, 2013—TDWI Research announced the release of its newest Best Practices Report, Integrating Hadoop into Business Intelligence and Data Warehousing. This original, survey-based research looks at the current state of Hadoop usage and the future impact that this open source family of products will have on business intelligence (BI), data warehousing (DW), data integration (DI), and analytics within the next few years.
“Hadoop is poised to meet some of the toughest challenges in BI—primarily big data, advanced analytics, and the ability to extract valuable business insight from reams of unstructured data,” said Philip Russom, author of the report. “For that reason, TDWI predicts that Hadoop technologies will play a major role in augmenting existing DW, DI, and analytics practices over the next few years,” Russom explains.
It is important to note that although the research report reveals upcoming changes to established BI/DW environments, the emergence of Hadoop technologies should not be considered a replacement for current products or practices.
Survey respondents with Hadoop experience say they have already incorporated Hadoop with an array of analytic tools, DWs, and databases—showing that Hadoop is already a vital component of BI/DW technology stacks. “As adoption of Hadoop technologies increases, we want to prepare users to successfully integrate these potentially transformative technologies into their existing systems to move toward deeper analysis and more powerful business outcomes. Hence, it is important that users prepare for Hadoop implementation now,” Russom concludes.
Despite the current barriers with Hadoop technologies, including lack of maturity and needed improvements to security, administrative tools, and real-time operation, the number of technical users is steadily climbing. The open source community is addressing these challenges and continues to drive innovation and stabilization of Hadoop technologies with the support of a growing number of software vendor firms.
A small percentage (10%) of organizations surveyed has a Hadoop implementation in production today. However, 51% of respondents say they will have one within three years. If this trend plays out, Hadoop technologies will impact BI/DW environments soon.
About the Report:
This report is designed to accelerate users’ understanding of the many new Hadoop-based products that have emerged in recent years. The report includes real-world use cases to demonstrate how newly available Hadoop options can help user organizations successfully integrate these technologies into their BI portfolios and practices for maximum business value.
Report Highlights:
- Impact: According to survey analysis, Hadoop usage will impact at least 50% of all BI/DW environments within the next three years.
- Opportunity: The vast majority of respondents (88%) believe Hadoop presents an opportunity to enable new application types to extract value from large amounts of data.
- Adoption: We can expect aggressive adoption of up-and-coming products; 50% of respondents say they’ll adopt Mahout within three years, with similar adoption projected for R (44%), Zookeeper (42%), HCatalog (40%), and Oozie (40%).
- Barriers: Hadoop’s leading barriers are adjustments to staffing/skills and DW architecture, plus the current immaturity of Hadoop tools. The open source community and software vendor support teams are actively working to address these challenges.
This research was sponsored by Cloudera, EMC Greenplum, Hortonworks, ParAccel, SAP, SAS, Tableau Software, and Teradata.
About the Author
Philip Russom is a well-known figure in data warehousing and business intelligence, having published more than 500 research reports, magazine articles, opinion columns, speeches, Webinars, and more. Today, he’s the TDWI Research Director for Data Management at TDWI, where he oversees many of the company’s research-oriented publications, services, and events. Before joining TDWI in 2005, Russom was an industry analyst covering BI at Forrester Research and Giga Information Group. He also ran his own business as an independent industry analyst and BI consultant and was a contributing editor with leading IT magazines. Before that, Russom worked in technical and marketing positions for various database vendors.
About TDWI
TDWI, a division of 1105 Media, Inc., is the premier provider of in-depth, high-quality education and research in the business intelligence and data warehousing industry. TDWI is dedicated to educating business and information technology professionals about the best practices, strategies, techniques, and tools required to successfully design, build, maintain, and enhance business intelligence and data warehousing solutions. TDWI also fosters the advancement of business intelligence and data warehousing research and contributes to knowledge transfer and the professional development of its members. TDWI offers a worldwide membership program, five major educational conferences, topical educational seminars, role-based training, on-site courses, certification, solution provider partnerships, an awards program for best practices, live Webinars, resourceful publications, and an in-depth research program. For more information, visit tdwi.org or follow us on Twitter @TDWI.
About 1105 Media
1105 Media, Inc., is a leading provider of integrated information and media in targeted business-to-business markets, including specialized sectors of the information technology community; industrial health, safety, and compliance; security; environmental protection; and home healthcare. 1105's offerings span print and online magazines, journals, and newsletters; seminars, conferences, and trade shows; training courseware; and Web-based services. 1105 Media is based in Chatsworth, CA, with offices throughout the United States.
###