When analysing daily usage of a machine that can run across days, we need to split the time of a single machine running cycle into right days. As the example below shows, the second machine (D00002) run across two days and the third machine (D00003) run across three days. To analyse the daily usage of … Continue reading Handling Across-Day Cycle Issue in Daily Usage Analysis using U-SQL
Category: Azure Data Platform
Generate Device Cycle Records from Raw Telemetry Message using Azure Data Lake Analytics
The raw telemetry data collected from IoT sensor is normally event-based, e.g., a "Device On" message when the device starts to run, and a "Device Off" message when the device stops. One common data preprocessing task is to transform the raw "On/Off" telemetry data into device cycle records with the start time, end time and … Continue reading Generate Device Cycle Records from Raw Telemetry Message using Azure Data Lake Analytics
Workaround for Building Azure Data Warehouse using Visual Studio
When creating Azure Data Warehouse, I have found the limitation that the Visual Studio SSDT SQL projects does not support Azure Data Warehouse. It causes much pain to the data warehouse development without support on source control and nice code organisation as those offered by SSDT SQL Projects. Fortunately, I have found a trick to … Continue reading Workaround for Building Azure Data Warehouse using Visual Studio
Setup an Azure Dev VM for Testing Power BI + SQL Server 2016 Integration
This blog post walks through the steps to setup an Azure dev vm for testing Power BI + SQL Server 2016 integration: Provision the Azure VM using SQL Server 2016 developer image Configure the SSAS/SSRS services Install development software Install sample databases Integrate SSRS and Power BI Service Install and configure Personal Power BI Gateway (Optional) … Continue reading Setup an Azure Dev VM for Testing Power BI + SQL Server 2016 Integration
Automating Language Translations using Microsoft Flow and Translator Text Service
I had a quick play on the preview version of Microsoft Flow, one of the newest toys offered by Microsoft for creating automated workflows linking a broad range of online apps and services. One feature interested me is the Microsoft translator service which can automate the translation process between languages. So where can we use … Continue reading Automating Language Translations using Microsoft Flow and Translator Text Service
Data Ninjago (Finsight-Tech Blogs) 
You must be logged in to post a comment.