How to get the TopN rows using Python in Fabric Notebooks When working with data there are sometimes weird and wonderful requirements which must be created in order to get to the desired solution. In today’s blog post I had a situation where I wanted to get a single row with the highest duration. This is how I did it…

Fabric Notebooks – Looping through data using PySpark Continuing with my existing blog series on what I’m learning with notebooks and PySpark. Today, I’m going to explain to you how I found a way to loop through data in a notebook. In this example, I’m going to show you how I loop through a range of dates, which can then…

How to add current DateTime to existing PySpark data frame in a Fabric Notebook In the blog post below, I am going to describe how to add the current Date Time to your existing Spark data frame. This is really useful when I am inserting data into a Fabric Lakehouse table, and I want to know when the data got…