TDWI: Data Transformation Techniques

Explore Data Transformation and Integration Content

As data sources grow in size, number, and complexity, your enterprise must learn how to get the most from all its data. This section focuses on techniques and best practices for unifying and integrating your data. It also explains techniques for creating, maintaining, and automating extract/transform/load (ETL) and other data munging processes.

Jump To:

Content »

Events »

Webinars

Expert Panel: Data Management in the Age of AI
In this panel, TDWI senior research director James Kobielus will engage data and analytics experts in an in-depth discussion of how AI is being used to improve data management. July 29, 2024 learn more
Navigating Cloud Change Management: Strategies for Data Modernization and AI Readiness
Join this TDWI webinar with TDWI’s VP of research, Fern Halper, and Paul Lewis, chief technology officer (CTO) at Pythian, as they discuss how to best modernize to the cloud and key strategies for overcoming challenges. July 24, 2024 learn more
Driving Customer-360 Insights with Modern MDM, GenAI, and Cloud Data Platforms
Register today to attend this TDWI webinar and learn how you can use modern cloud data platforms, master data management (MDM), and generative AI to overcome these and other challenges. June 25, 2024 learn more
Making Your Data and AI Ready for Business Transformation
Join us to hear James Kobielus, TDWI senior research director for data management, explore how AI is driving digital business transformation initiatives the world over and how enterprises are accelerating this push by using AI to automate, accelerate, and enhance their data pipelines. June 18, 2024 learn more
Drive Faster Insights from Your Data
Register today to learn how your organization can solve data integration challenges, increase data engineering productivity, and enable cross-functional collaboration. April 16, 2024 learn more
Using Your Lakehouse as a Customer Data Platform
Join TDWI’s senior research director James Kobielus on this webinar to explore the importance of the data lakehouse as the foundation of the enterprise customer data stack. April 10, 2024 learn more

TDWI Webinars

Research & Resources

Digital Dialogue | Using AI to Develop and Optimize Pipelines
In a recent webinar, TDWI VP and senior research director, Fern Halper, Ph.D., spoke to Matillion’s VP of products, Gwendal Vaz Nunes, about using AI to help develop pipelines. learn more
Checklist Report | Unifying Transactional and Analytical Data to Drive Modern Applications and Analytics
This TDWI Checklist focuses on how organizations can gain advantage from unifying data on modern cloud data platforms. learn more
Composable Customer Data Platform (CDP) Market 2023
Discover the future of CDPs in this new guide. Evaluate your current options for composable CDPs and figure out which one is right for your organization. learn more
Build Vs Buy Is Dead: Compose Your Customer Data Platform (CDP) in 2023
Download this white paper now to navigate the shifting landscape of CDPs in 2023 and implement a platform that will scale for your future needs. learn more
TDWI Checklist Report | Six Best Practices for Harnessing Real-Time and Streaming Data Pipelines
This TDWI Checklist Report examines six important considerations and best practices for managing streaming data for real-time use. learn more
How Organizations Can Achieve ESG Data Mastery
Download this white paper now to prepare your organization for robust ESG reporting. learn more

TDWI Research

Podcasts

What's Ahead in 2024 with Fern Halper and David Stodder December 18, 2023
Part Two | Achieving Success with Modern Analytics with Teresa Letlow and Jason Yeung July 24, 2023
DataOps & MLOps Pipeline Integration with James Kobielus April 25, 2023
Strategies for Overcoming Data Silos with David Stodder March 13, 2023

TDWI Podcasts - Speaking of Data

Upside Articles

Three Signs You Might Need a Data Fabric
A data fabric can help you access all your data and reach actionable insights. Here are three indicators that a data fabric may benefit your enterprise. July 12, 2024 read more
Our Cloud Migration Story: Challenges Faced and Lessons Learned
Moving to the cloud brings numerous benefits, but there are challenges you must overcome. Here is one company’s experience. July 11, 2024 read more
Best Practices to Ensure Data Transformation Success
Prophecy’s founder and CEO Raj Bains explains how organizations can overcome the challenges to achieving enterprise-wide data transformation. June 24, 2024 read more
Reducing Time to Insight with Kevin Bohan
How can improving data management result in faster data access and sharper insights? April 18, 2024 read more
Four Tips to Modernize Legacy ETL Processes
Modernizing ETL, especially the underlying infrastructure that supports it, across all your lines of business is vital for enhancing downstream analytics and decision-making. April 11, 2024 read more
How a Universal Semantic Layer Enables Consistent Answers to Business Questions
The proliferation of data models and business logic across different tools has become problematic. The beauty of a universal semantic layer is that it supports many data sources and many BI systems and data applications so teams can continue to use their preferred tools. April 1, 2024 read more

TDWI Data Transformation and Integration Articles

Team Training

TDWI Data Virtualization: Solving Complex Data Integration Challenges
The data integration landscape has changed radically the past few years. What was once a relatively manageable problem of blending and unifying data from enterprise transaction systems has grown to encompass external data, Web data, clickstream data, end-user data, big data, cloud data, and more. learn more
TDWI Data Quality Management: Techniques for Data Profiling, Assessment, and Improvement
Data quality is one of the most difficult challenges for nearly every business, IT organization, and BI program. The most common approach to data quality problems is reactive—a process of fixing problems when they are discovered and reported. learn more
TDWI Data Virtualization: Solving Complex Data Integration Challenges
The data integration landscape has changed radically the past few years. What was once a relatively manageable problem of blending and unifying data from enterprise transaction systems has grown to encompass external data, Web data, clickstream data, end-user data, big data, cloud data, and more. learn more
TDWI Data Quality Management: Techniques for Data Profiling, Assessment, and Improvement
Data quality is one of the most difficult challenges for nearly every business, IT organization, and BI program. The most common approach to data quality problems is reactive—a process of fixing problems when they are discovered and reported. learn more

TDWI Team Training

TDWI Transform 2024 San Diego

TDWI Data Virtualization: Solving Complex Data Integration Challenges
Get ready to expand your data integration capabilities, deliver business-speed information, and make the most of recent advances in data integration technology. Through a combination of lecture, exercises, and case study review you will learn how data virtualization works and how to position it in your data integration architecture and processes. learn more
Modern Data Engineering for Tomorrow's Enterprise Landscape
This half-day course delves into cutting-edge practices to sculpt and refine robust data pipelines. Immerse yourself in the intricacies of data engineering for data meshes, data warehouses, data lakehouses, and data virtualization. learn more
Data Science Bootcamp // Data Sourcing and Preparation for Data Science
This course provides an overview of the data sourcing and preparation activities in data science and predictive analytics projects, highlighting key principles and practices and providing business examples to reinforce each concept. learn more
DataOps: Best Practices for Agile Data Management
DataOps needs to deliver consistent and meaningful data which means automating the data lifecycle of acquisition, understanding, integration, transformation, and deployment. This course will address best practices that contribute to consistent and automated analytics results. learn more
Modernizing Master Data Management to Effectively Support Business Processes
In this course, you will learn how to modernize your program for effective results. By examining the root causes of missed expectations for MDM, we will learn how business data consumers depend on corporate information assets such as customer or product information. learn more

View San Diego Agenda

Upcoming TDWI Virtual Summit Sessions

Spotlight Talk
Who Moved My Data? Trends and Directions for Modernizing Data Integration
In this session, TDWI Research Fellow David Stodder will discuss trends and directions influencing strategies for modernizing data integration. learn more

Upcoming TDWI Virtual Summits

Upcoming TDWI Seminar Courses

Building Your Company’s Data Governance Roadmap
In this class, Evan Levy will review the business drivers for a data governance program and show you how to identify and prioritize program goals and objectives, identify teams and team members (along with their roles and responsibilities), and identify an agenda and process that delivers business value. learn more
Building Your Company’s Data Governance Roadmap
In this class, Evan Levy will review the business drivers for a data governance program and show you how to identify and prioritize program goals and objectives, identify teams and team members (along with their roles and responsibilities), and identify an agenda and process that delivers business value. learn more
Building Your Company’s Data Governance Roadmap
In this class, Evan Levy will review the business drivers for a data governance program and show you how to identify and prioritize program goals and objectives, identify teams and team members (along with their roles and responsibilities), and identify an agenda and process that delivers business value. learn more

Upcoming TDWI Seminars