May 31, 2011
We all know what is happening to volumes of data. It is no longer unusual to hear about companies storing hundreds of terabytes or even petabytes of data in data warehouses for business intelligence (BI) and analytic processing. Too often there is minimal focus on data integration performance and scalability, and organizations begin to see performance bottlenecks across different areas of the data integration environment.
These bottlenecks can be insidious and difficult to detect, leading to a significant impact on the implementation, maintenance, and enhancement of your data integration environment. Depending on the size and sophistication of your environment, performance bottlenecks can potentially translate into millions of dollars in additional costs. Unfortunately, even when detected, common solutions to these problems may:
- Be too costly to implement with overall high costs of ownership
- Lead to overly complex integration processes that rely on workarounds, manual interventions, etc.
- Simply be ineffective
This TDWI Checklist Report examines these issues and helps you determine if your data integration environment has performance issues. It describes alternative approaches to solving the issues and includes the pros and cons for each.