SSIS ->> Data Flow Design And Tuning

Requirements:

• Source and destination system impact
• Processing time windows and performance
• Destination system state consistency
• Hard and soft exception handling and restartability needs
• Environment architecture model, distributed hardware, or scaled-up servers
• Solution architecture requirements, such as flexibility of change or OEM targeted solutions
• Modular and configurable solution needs
• Manageability and administration requirements

Data Flow Design Practices 

• Limit synchronous processes.
• Monitor the memory use of blocking and semi-blocking transformations.
• Reduce staging and disk I/O.
• Reduce reliance on an RDBMS.

Leveraging the Data Flow

Data Integration and Correlation

Data Cleansing and Transformation

Troubleshooting Data Flow Performance Bottlenecks

The pipeline execution reports (reviewed earlier in the chapter) are a great way to identify which component in your Data Flow is causing a bottleneck. Another way to troubleshoot Data Flow performance is to isolate transformations and sources by themselves.

Windows Performance Monitor