Category: Analytics, BI & Reporting

Power Query – Parameterised Files Loading from a Year-Month-Day folder Hierarchy

In one of my previous blog post, I described an approach to load text files from Azure Data Lake Store to Power BI filtered by the date period specified by users through setting the period start and period end parameters. That approach is capable to load text files located at the same folder. However, there … Continue reading Power Query – Parameterised Files Loading from a Year-Month-Day folder Hierarchy →

Anomaly Detection with Azure Stream Analytics

Anomaly detection is a very common use case in IoT related deployments. A new ANOMALYDETECTION operator has been recently added into Azure Stream Analytics and is currently at public preview. ANOMALYDETECTION operator detects anomalies based on Exchangeability Martingales (EM) that supports online test of the exchangeability of a sequence of event values. When the distribution of the sequence … Continue reading Anomaly Detection with Azure Stream Analytics →

Power Query – Extract Multiple Tags Stored in a Single Text Field

Problem It is not rare to see that multiple attributes are stored in a single text field especially for tagging enabled applications where an unfixed number of tags may associated with an article or post. Those tags are often stored in a single text filed with a delimiter to separate them. When reporting, we often … Continue reading Power Query – Extract Multiple Tags Stored in a Single Text Field →

Power Query – Parameterised Files Loading from Azure Data Lake Store within a Given Date Range

Power BI now supports data load from Azure Data Lake Store. We can connect to a folder in the Azure Data Lake Store and load all files from that folder. However, we often don't want to or aren't able to load all the files in the Azure Data Lake Store folder into Power BI due to … Continue reading Power Query – Parameterised Files Loading from Azure Data Lake Store within a Given Date Range →

Building Power BI Memory Usage Dashboard using DMV

As the VertiPad engine used in Power BI is an in-memory data analytical engine, the key to optimise your Power BI report performance is to reduce the memory usage of your data model. A smaller data model not only increase the data scan speed but also allow you to processing a larger dataset with the … Continue reading Building Power BI Memory Usage Dashboard using DMV →

Things better to do When Working with Power BI

This is the third part in the blog series summarising my experience with Power BI from the real-world projects. Things Better to Know Before Implementing Power BI Service Pain Points of Power BI Things Better to Do When Working with Power BI Create separate QA/UAT app workspace from Dev app workspace Separate QA/UAT app workspace … Continue reading Things better to do When Working with Power BI →

Pain Points of Power BI

This is the second post in the blog series summarising my experience with Power BI from the real-world projects. Things Better to Know Before Implementing Power BI Service Pain Points of Power BI Things Better to Do When Working with Power BI This blog post covers some very interesting topics, namely the pain points of … Continue reading Pain Points of Power BI →

Things Better to Know Before Implementing Power BI Service

I love Power BI, sincerely, since as early as the PowerPivot 1.0 era. However, I must admit Power BI does drive me crazy sometimes. It can play very well when you follow the rules Power BI expecting you to follow, otherwise, it can cause you much pain. This blog series summarises my experience with Power … Continue reading Things Better to Know Before Implementing Power BI Service →

R Visual – Building Component Cycle Timeline

One common approach to detect exceptions of a machine is to monitor the correlative status of components in the machine. For example, in normal condition, two or more components should be running at the same time, or some components should be running in sequential order. When the components are not running in the way as … Continue reading R Visual – Building Component Cycle Timeline →