How to add current DateTime to existing PySpark data frame in a Fabric Notebook
How to add current DateTime to existing PySpark data frame in a Fabric Notebook In the blog post below, I am going to describe how to add the current Date Time to your existing Spark data frame. This is really useful when I am inserting data into a Fabric Lakehouse table, and I want to know when the data got…
All Fabric Workload Items are now available from the Scanner API
All Fabric Workload Items are now available from the Scanner API I was working with the customer and was looking for some information in the Scanner API. For a change I went into Power Query and expanded the workspaces item. And this is where I found now that all the fabric workload items are available. You might notice in the…
How much data is being stored in my Fabric OneLake (Lakehouse files and tables)
How much data is being stored in my Fabric OneLake (Lakehouse files and tables) I recently had a question from someone in the fabric community asking how much storage was being used by the Lakehouse and tables. This got me thinking that currently there is not an easy way to do this. It is essential to know how much storage…
Did you know you can create DAX measures directly in the Power BI Service using Visual Calculations
There have been some updates to Power BI with Visual Calculations, and as of the March 2024 release you can now create and edit visual calculations in the Power BI Service. Here are details from the blog post: Power BI March 2024 Feature Summary | Visual Calculations Update I then saw an email which made me think, could I then…
Creating a Mirrored Azure SQL Database in Fabric
Creating a Mirrored Azure SQL Database in Fabric This week they announced Announcing the Public Preview of Database Mirroring in Microsoft Fabric | Microsoft Power BI Blog | Microsoft Power BI I decided to see how easy it was to create a mirrored database in Fabric and below are my findings (PS it is AMAZING) I did follow the tutorial,…
How to get Sempy (Semantic-link) to run when being triggered from a data pipeline which runs a Notebook in Fabric
Below is where I had an error when trying to run a notebook via a data pipeline and it failed. Below are the steps to get this working. This was the error message I got as shown below. Notebook execution failed at Notebook service with http status code – ‘200’, please check the Run logs on Notebook, additional details –…
Renaming multiple Column Names in a single step using a PySpark Notebook
Following on from my previous blog post this blog post I’m going to demonstrate how to bulk rename column names in a single step instead of having to rename them individually. The reason this came about is because I had a set of data where the column names had the square brackets which I wanted to remove. As shown below…
Fabric – How to rename a column name when using a Python Notebook
I thought it would be good to help others in terms of my learning journey when working with partner notebooks and Microsoft fabric. In today’s blog post, I am going to show you how to rename a column. In my experience this came up because I had a column name which had a forward slash “/” in it which caused…
How to calculate Microsoft Fabric costs
I was going to update my existing blog post with regards to the fabric costs. I was then fortunate to be contacted by David Brown from the Microsoft Fabric team who gave me additional details in terms of how to correctly calculate the fabric costs. What is a Capacity Unit or CU? You can think of a CU as CPU…
Microsoft Fabric – Comparing Dataflow Gen2 vs Notebook on Costs and usability
In this blog post I am going to compare Dataflow Gen2 vs Notebook in terms of how much it costs for the workload. I will also compare usability as currently the dataflow gen2 has got a lot of built in features which makes it easier to use. The goal of this blog post is to understand which in my opinion…