Author: Linxiao Ma

Building Power BI Memory Usage Dashboard using DMV

As the VertiPad engine used in Power BI is an in-memory data analytical engine, the key to optimise your Power BI report performance is to reduce the memory usage of your data model. A smaller data model not only increase the data scan speed but also allow you to processing a larger dataset with the … Continue reading Building Power BI Memory Usage Dashboard using DMV →

End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 4)

This is the last part of the blog series demonstrating how to build an end-to-end ADF pipeline for data warehouse ELT. Introduction & Preparation Build ADF pipeline for dimension tables ELT Build ADLA U-SQL job for incremental extraction of machine cycle data Build ADF pipeline for fact table ELT In the previous part we created … Continue reading End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 4) →

End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 3)

This is the third part of the blog series to demonstrate how to build an end-to-end ADF pipeline for data warehouse ELT. The part will describe how to build an ADLA U-SQL job for incremental extraction of machine cycle data from Azure Data Lake store and go through the steps for scheduling and triggering the … Continue reading End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 3) →

End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 2)

This is the second part of the blog series to demonstrate how to build an end-to-end ADF pipeline for extracting data from Azure SQL DB/Azure Data Lake Store and loading to a star-schema data warehouse database with considerations on  SCD (slow changing dimensions) and incremental loading. Introduction & Preparation Build ADF pipeline for dimensional tables … Continue reading End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 2) →

End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 1)

This blog series demonstrates how to build an end-to-end ADF pipeline for extracting data from Azure SQL DB/Azure Data Lake Store and load to a star-schema data warehouse database with considerations of  SCD (slow changing dimensions) and incremental loading. The final pipeline will look as: The machine cycle records will be load from the csv … Continue reading End-to-End Azure Data Factory Pipeline for Star Schema ETL (Part 1) →

Things better to do When Working with Power BI

This is the third part in the blog series summarising my experience with Power BI from the real-world projects. Things Better to Know Before Implementing Power BI Service Pain Points of Power BI Things Better to Do When Working with Power BI Create separate QA/UAT app workspace from Dev app workspace Separate QA/UAT app workspace … Continue reading Things better to do When Working with Power BI →

Pain Points of Power BI

This is the second post in the blog series summarising my experience with Power BI from the real-world projects. Things Better to Know Before Implementing Power BI Service Pain Points of Power BI Things Better to Do When Working with Power BI This blog post covers some very interesting topics, namely the pain points of … Continue reading Pain Points of Power BI →

Things Better to Know Before Implementing Power BI Service

I love Power BI, sincerely, since as early as the PowerPivot 1.0 era. However, I must admit Power BI does drive me crazy sometimes. It can play very well when you follow the rules Power BI expecting you to follow, otherwise, it can cause you much pain. This blog series summarises my experience with Power … Continue reading Things Better to Know Before Implementing Power BI Service →

R Visual – Building Component Cycle Timeline

One common approach to detect exceptions of a machine is to monitor the correlative status of components in the machine. For example, in normal condition, two or more components should be running at the same time, or some components should be running in sequential order. When the components are not running in the way as … Continue reading R Visual – Building Component Cycle Timeline →

Power BI Fun – Ninjago Driver Scorecard for Fuel Saving

Just for fun, created the Ninjago driver scorecard dashboard for fuel saving. The idea behind this dashboard is actually from real-world IoT business cases for fuel saving through monitoring drivers' driving styles and behaviours.