Loading Fabric Lakehouse Tables with partitions
When loading data, it is always important to load the data with performance and scalability in mind. For lakehouse tables to return queries quickly and to scale it is essential to load your lakehouse tables with partitions. What I am going to show you in my blog post today is how to load data into a Lakehouse table where the…
Easily scale up or scale down your Fabric Capacity using Power Automate (Via email)
Easily scale up or scale down your Fabric Capacity using Power Automate (Via email) Following on from my previous blog post (Stop and start your Fabric Capacity using Power Automate) I got a question from Tristan as shown below! I always enjoy a good challenge and I got it working! In this blog post I will use the same method…
Stop and start your Fabric Capacity using Power Automate
Stop and start your Fabric Capacity using Power Automate With Fabric Capacities trial coming to an end, you need to make sure to stop and start Fabric Capacities. In my blog post below, I am going to show you how I can start or stop my Fabric Capacity by simply sending an email to myself with the details in the…
How to get the TopN rows using Python in Fabric Notebooks
How to get the TopN rows using Python in Fabric Notebooks When working with data there are sometimes weird and wonderful requirements which must be created in order to get to the desired solution. In today’s blog post I had a situation where I wanted to get a single row with the highest duration. This is how I did it…
Looping through data using PySpark notebook in Fabric
Fabric Notebooks – Looping through data using PySpark Continuing with my existing blog series on what I’m learning with notebooks and PySpark. Today, I’m going to explain to you how I found a way to loop through data in a notebook. In this example, I’m going to show you how I loop through a range of dates, which can then…
Using Sempy to Authenticate to Fabric/Power BI APIs using Service Principal and Azure Key Vault
I have been doing a fair amount of work lately with Fabric Notebooks. I am always conscious to ensure that when I am authenticating using a Service Principal, I can make sure it is as secure as possible. To do this I have found that I can use the Azure Key Vault and Azure identity to successfully authenticate. By using…
How to add current DateTime to existing PySpark data frame in a Fabric Notebook
How to add current DateTime to existing PySpark data frame in a Fabric Notebook In the blog post below, I am going to describe how to add the current Date Time to your existing Spark data frame. This is really useful when I am inserting data into a Fabric Lakehouse table, and I want to know when the data got…
All Fabric Workload Items are now available from the Scanner API
All Fabric Workload Items are now available from the Scanner API I was working with the customer and was looking for some information in the Scanner API. For a change I went into Power Query and expanded the workspaces item. And this is where I found now that all the fabric workload items are available. You might notice in the…
How much data is being stored in my Fabric OneLake (Lakehouse files and tables)
How much data is being stored in my Fabric OneLake (Lakehouse files and tables) I recently had a question from someone in the fabric community asking how much storage was being used by the Lakehouse and tables. This got me thinking that currently there is not an easy way to do this. It is essential to know how much storage…
Did you know you can create DAX measures directly in the Power BI Service using Visual Calculations
There have been some updates to Power BI with Visual Calculations, and as of the March 2024 release you can now create and edit visual calculations in the Power BI Service. Here are details from the blog post: Power BI March 2024 Feature Summary | Visual Calculations Update I then saw an email which made me think, could I then…