Tag: Data Flows

Review of new Features coming to Power BI by Oct 2018 – From Business Applications Summit

I was fortunate to attend my first ever Business Applications Summit in Seattle. I had the pleasure of sharing an Airbnb with Matt Allington, Phil Seamark and Miguel Escobar, it was great to spend time with these Power BI Legends. I also did meet a lot of people and got to chat with people in the Microsoft Power BI team,…

SSIS (SQL Server Integration Services) – Using the Lookup Transformation and cache and how to handle NULL Values

I had a situation where I was using the Lookup transformation and then loading this into the SSIS Cache, but I wanted all rows to be inserted using the SSIS Cache, even if there was a NULL Value. Below explains how I overcame this.   Example: ·         In our Source data we have Products, but they might not be in…

SSIS – Running single SSIS packages in Parallel to get faster performance for multiple data loads

What we are going to show you below, is that by using ONE SSIS package, we can re-use this one SSIS package multiple times to get data from multiple sources, possibly from different databases hosted in different locations around the world. So in effect we are loading our data from one SSIS package in parallel.   NOTE: By completing the…

SSIS – Getting Partition Names for the past 12 months

I had a situation where I was using a conditional split, so that when data was coming in from my source tables it would dynamically go into the correct partitioned table.   Below is the script that I used, as well as for reference the conditional split   — ================================================================================================================== — What we are doing here is to create a…

SCOM (Systems Center Operations Manager) Cube and Data warehouse

What I have done is I have found that it is very handy having all our SCOM data in a data warehouse and then having it in a SSAS (SQL Server Analysis Services). Within the zip file which can be located here below it has all the details for the following: ·         SCOM Data Warehouse and OLAP Documentation.docx o   This…

Data warehousing – Bringing down data twice but avoiding deleting on the data warehouse Fact Table

This is better explained with our example below.   Example: ·         We had a situation where we were getting data down, but due to the nature of the data we were getting is we were missing data. ·         Also another note was the fact that we did not store the granular data, but aggregated the data, so due to this…