Tag: SSIS

SSIS (SQL Server Integration Services) – Using the Lookup Transformation and cache and how to handle NULL Values

I had a situation where I was using the Lookup transformation and then loading this into the SSIS Cache, but I wanted all rows to be inserted using the SSIS Cache, even if there was a NULL Value. Below explains how I overcame this.   Example: ·         In our Source data we have Products, but they might not be in…

SSIS – Running single SSIS packages in Parallel to get faster performance for multiple data loads

What we are going to show you below, is that by using ONE SSIS package, we can re-use this one SSIS package multiple times to get data from multiple sources, possibly from different databases hosted in different locations around the world. So in effect we are loading our data from one SSIS package in parallel.   NOTE: By completing the…

SSIS – Getting Partition Names for the past 12 months

I had a situation where I was using a conditional split, so that when data was coming in from my source tables it would dynamically go into the correct partitioned table.   Below is the script that I used, as well as for reference the conditional split   — ================================================================================================================== — What we are doing here is to create a…

SCOM (Systems Center Operations Manager) Cube and Data warehouse

What I have done is I have found that it is very handy having all our SCOM data in a data warehouse and then having it in a SSAS (SQL Server Analysis Services). Within the zip file which can be located here below it has all the details for the following: ·         SCOM Data Warehouse and OLAP Documentation.docx o   This…

Data warehousing – Bringing down data twice but avoiding deleting on the data warehouse Fact Table

This is better explained with our example below.   Example: ·         We had a situation where we were getting data down, but due to the nature of the data we were getting is we were missing data. ·         Also another note was the fact that we did not store the granular data, but aggregated the data, so due to this…

SSIS – Stopping an Error from Propagating to its Parent (Enabling an SSIS Package to continue when an error happens)

Due to our environment and packages we create, we have to enable the packages to continue even if it fails for some reason (Cannot connect to a Server for example) so that the rest of the data will be captured. In the past we configured the MaximumError count to be 100, but this is not ideal, because if another component…