When Worlds Collide: Using the Data Lake to Connect Old and New Technologies
TDWI Speaker: David Loshin, President of Knowledge Integrity
Legacy information technology environments usually consist of aging components, typically acquired over time to address specific business needs. While these systems met past needs, emerging opportunities and business pressures have motivated organizations to consider innovative data management technologies:
- Aging platforms require support from a diminishing pool of skilled professionals.
- Information-driven applications need storage for massive data volumes.
- Growing use of unstructured data.
- Sophisticated analytics applications need scalable high-performance computing to perform the necessary complex computations.
- Commodity components are more cost-effective than specialty hardware platforms.
New technologies such as Hadoop, in-memory and columnar databases, and NoSQL databases are increasingly being moved into production; however, few organizations are at the point of completely ripping out their existing data management, data warehousing, and analytics infrastructure. Importantly, there is a business necessity for the environment to provide methods for hybrid data access to transition from the legacy framework to the environment of the future. This webinar explores the motivations for architecting a hybrid environment that uses techniques such as the data lake to straddle the gap between legacy systems and newer technologies. Attendees will learn about:
- Motivations for the hybrid environment
- Architectural approaches that can rapidly adapt to new technologies
- Avoiding dependence on maturing technologies before they are ready
- Challenges of migrating and integrating legacy data
- Incorporating the data lake