TDWI: Data Transformation Techniques | Transforming Data with Intelligence

Explore Data Transformation and Integration Content

As data sources grow in size, number, and complexity, your enterprise must learn how to get the most from all its data. This section focuses on techniques and best practices for unifying and integrating your data. It also explains techniques for creating, maintaining, and automating extract/transform/load (ETL) and other data munging processes.

Jump To:

Content »

Events »

Webinars

Driving Customer-360 Insights with Modern MDM, GenAI, and Cloud Data Platforms
Register today to attend this TDWI webinar and learn how you can use modern cloud data platforms, master data management (MDM), and generative AI to overcome these and other challenges. December 14, 2023 learn more
Accelerate Data Sharing with Unified Data and AI Governance
Join this TDWI webinar to learn how to overcome hurdles and accelerate business value from data sharing while having secure governance and lineage. December 12, 2023 learn more
Scale Transformational AI Through Data Estate Modernization
In this webinar, we consider the information requirements for deploying AI, and then review data modernization initiatives that can help your organization achieve the business transformations that AI promises. December 8, 2023 learn more
Data and Application Modernization in the Age of the Cloud
Join this webinar in which James Kobielus, TDWI senior research director for data management, explores how enterprises are modernizing their mainframe data and application infrastructures in the cloud to sustain innovation and drive efficiencies. December 6, 2023 learn more
Building Better AI/ML Applications Faster in the Data Cloud
Join this webinar in which James Kobielus, TDWI senior research director for data management, and expert panelists discuss how enterprises can implement a fast path to superior AI/ML applications in the cloud. November 17, 2023 learn more
Supercharging AI with Data Enrichment
In this webinar, we explore the pivotal role of data enrichment in molding AI models with a specific focus on the intricacies of how data enrichment contributes to the training processes. November 2, 2023 learn more

TDWI Webinars

Research & Resources

Checklist Report | Unifying Transactional and Analytical Data to Drive Modern Applications and Analytics
This TDWI Checklist focuses on how organizations can gain advantage from unifying data on modern cloud data platforms. learn more
Composable Customer Data Platform (CDP) Market 2023
Discover the future of CDPs in this new guide. Evaluate your current options for composable CDPs and figure out which one is right for your organization. learn more
Build Vs Buy Is Dead: Compose Your Customer Data Platform (CDP) in 2023
Download this white paper now to navigate the shifting landscape of CDPs in 2023 and implement a platform that will scale for your future needs. learn more
TDWI Checklist Report | Six Best Practices for Harnessing Real-Time and Streaming Data Pipelines
This TDWI Checklist Report examines six important considerations and best practices for managing streaming data for real-time use. learn more
How Organizations Can Achieve ESG Data Mastery
Download this white paper now to prepare your organization for robust ESG reporting. learn more
TDWI Insight Accelerator | Saving Time and Costs: How Small and Midsize Businesses Can Maximize the Power of Data
This TDWI Insight Accelerator identifies key issues that SMBs need to address and offers recommendations for modernizing data integration and user experiences to maximize business benefits. learn more

TDWI Research

Podcasts

Part Two | Achieving Success with Modern Analytics with Teresa Letlow and Jason Yeung July 24, 2023
DataOps & MLOps Pipeline Integration with James Kobielus April 25, 2023
Strategies for Overcoming Data Silos with David Stodder March 13, 2023

TDWI Podcasts - Speaking of Data

Upside Articles

The House of Data and Data Stewardship with Dr. James Barker
Dr. James Barker, director of professional services for data strategy with Alation, discusses the “House of Data,” including key concepts, stewardship roles, and data councils. November 2, 2023 read more
Five Value-Killing Traps to Avoid When Implementing a Semantic Layer
When architecting and implementing your semantic layer, consider these issues and take steps to avoid them for more actionable, accurate insights from your data and enhanced user satisfaction. October 18, 2023 read more
When Preparing Data for Machine Learning, Avoid These Common Mistakes
Follow these tips to ensure your machine learning training data is the best it can be. October 9, 2023 read more
Executive Q&A: How Generative AI Is Changing How We Think About Analytics
Structured enterprise data may just be generative AI’s next breakthrough area. We asked Nima Negahban, cofounder and CEO of Kinetica, to explain how the technology is being used in a variety of industries. September 11, 2023 read more
How to Succeed with Unifying DataOps and MLOps Pipelines
James Kobielus, TDWI’s senior research director for data management, discusses the opportunities and challenges associated with enterprise unification of DataOps and MLOps pipelines. September 8, 2023 read more
Strategies for Successful Cloud Migration: Lessons from TDWI’s David Stodder
David Stodder, TDWI’s senior director of research for business intelligence, discusses trends and topics in cloud migration and management. August 14, 2023 read more

TDWI Data Transformation and Integration Articles

Team Training

TDWI Data Quality Management: Techniques for Data Profiling, Assessment, and Improvement
Data quality is one of the most difficult challenges for nearly every business, IT organization, and BI program. The most common approach to data quality problems is reactive—a process of fixing problems when they are discovered and reported. learn more
TDWI Data Virtualization: Solving Complex Data Integration Challenges
The data integration landscape has changed radically the past few years. What was once a relatively manageable problem of blending and unifying data from enterprise transaction systems has grown to encompass external data, Web data, clickstream data, end-user data, big data, cloud data, and more. learn more
TDWI Data Integration Principles and Practices: Creating Information Unity from Data Disparity
Today’s business managers depend heavily on data analysis and decision-speed information, raising the stakes for data integration. At the same time, the work of integrating data has become increasingly complex. learn more
TDWI Data Integration Techniques: ETL and Alternatives for Data Consolidation
Data integration is becoming increasingly complex as new expectations and technologies change the face of data warehousing and business intelligence. The design of data integration systems was comparatively straightforward when extract, transform, and load (ETL) was the only option. learn more

TDWI Team Training

Upcoming TDWI Conference Courses

Delivering Data Faster: Innovations in Integration Tools
Topics in this session include self-service data integration, data preparation, exploratory profiling, data virtualization, automation, testing and test data management, making streaming data available to nonprogrammers, and rethinking assumptions about data integration and architecture. This course will include demos of some of the tools discussed. learn more
Modern Data Engineering for Tomorrow's Enterprise Landscape
This half-day course delves into cutting-edge practices to sculpt and refine robust data pipelines. Immerse yourself in the intricacies of data engineering for data meshes, data warehouses, data lakehouses, and data virtualization. learn more
Active Metadata for Data Fabric: Delivering Data Quality, Observability, and Trust
Understanding the best ways to capture metadata automatically at scale can then be followed by activating metadata to increase data observability, improve data quality and governance awareness, and ultimately build a trusted data architecture that can accelerate and improve decision-making in the business. learn more
Data Science Bootcamp // Data Sourcing and Preparation for Data Science
In this session, we will provide an overview of sourcing and preparing data for data science and predictive analytics projects. learn more
Modernizing Master Data Management to Effectively Support Business Processes
In this course, you will learn how to modernize your program for effective results. By examining the root causes of missed expectations for MDM, we will learn how business data consumers depend on corporate information assets such as customer or product information. learn more
TDWI Data Virtualization: Solving Complex Data Integration Challenges
Decision Trees in Machine Learning: Building Explainable Models
DataOps: Best Practices for Agile Data Management

Upcoming TDWI Conferences

Upcoming TDWI Virtual Summit Sessions

Spotlight Talk: The Symbiotic Bonds Between Data, AI, and BI
This spotlight session will shed light on the pivotal role of data integration, governance, and analytics in harnessing the true potential of AI. learn more
Information Consumer Empowerment: A Modernized Perspective on Data Governance
In this talk, David Loshin will explore the modernization of data governance and how the collection of data policy management practices (such as identity management and access control, data protection, and regulatory compliance) can be complemented with data enablement methods (such as data virtualization, data fabric, and data pipelines) to empower information consumers. learn more
Data Integration Today: TDWI Research Perspectives on Challenges, Trends, and Opportunities
In this presentation, we will look at current data integration challenges in TDWI research and discuss opportunities for solving them. learn more
Executive Alignment with Data Transformation: The Diﬀerence Between Top-Down and Bottom-Up Programs (With Audience Q&A)
Richard Hines will compare top-down and bottom-up data transformation programs and provide insight into how to align executive teams. learn more
Case Study: Data Enablement Journey (with Audience Q&A)
This case study shares an enterprise evolution from fragmented data management to data management as a strategic capability. learn more
The Future of Data Integration
In order to keep pace with fast-changing business requirements, enterprises must keep pace with best practices in data integration. Chief among these is migrating data integration pipelines to scalable, resilient, and agile cloud platforms. learn more
Driving Transformation: Key Factors for Successful Enterprise Data Integration and Collaboration (with Audience Q&A)
Matt Florian will discuss the key factors that contribute to the success of data integration initiatives, enabling companies to harness the full potential of their data assets and propel their organizations forward. learn more
Case Study: Highly Scalable and Secure Data Pipelines at MassMutual (with Audience Q&A)
In the era of big data, businesses often face challenges dealing with provisioning and operational overhead. Vijay Raju will discuss how Mass Mutual addressed these challenges through a modernized data platform for data consumers. learn more

Upcoming TDWI Virtual Summits

Upcoming TDWI Seminar Courses

Data Privacy and Protection Fundamentals
During this class, Evan Levy will discuss the details of data privacy and protection and review the activities that go into supporting a data privacy and protection initiative in your analytics environment. learn more
Data Privacy and Protection Fundamentals
During this class, Evan Levy will discuss the details of data privacy and protection and review the activities that go into supporting a data privacy and protection initiative in your analytics environment. learn more

Upcoming TDWI Seminars