dbt Incremental part 1: Choosing the Right Strategy
Incremental Strategies & When to Use Them Incremental materialization is an advanced and powerful feature of dbt; however, you don’t need to use it in every single model of your project. Understanding when and how to leverage incremental materialization can be a game-changer for your data workflows. In this blog post, I’ll delve into the […]
Enabling data culture in organizations with purposeful documentation
Documentation is so often taken rather lightly or not always on top of projects’ priorities especially when it comes to tight deadlines to follow. The rooting reason for this problem is how the management team is initially viewing and handling data as assets, leading to an insufficiency of purposeful documentation in the development phase, and the availability of suitable tools to navigate to understand their current data in the launching phase. What could have been done better?
Data Modeling and Why It’s Important
Data transforms global processes, from disease research to revenue strategies, construction, and social media ads. Machine-readable data requires context; e.g., customer data needs to correspond to product purchases or price points. Data Modeling assigns relational rules, simplifying data for strategic decision-making. What is Data Modeling? Data modeling is a process of creating a visual representation […]
Azure data service platforms overview
As you may know, Sql server is one of the first database management systems for both operation and analytical purposes in data warehouses. As time goes by, as more and more cloud service providers start to appear, people seem to forget where they started when first learning about data. I used to be a big […]
SQL do’s and don’ts
Originally posted here SQL do’s and don’ts Why bother? When I first learned SQL, my mindset was mostly “Meh, if it runs, it’s done”. Over time and with some reality checks, I have gone to the opposite of the spectrum and learned to — for lack of a better word —‘scrutinize’ SQL queries, for 2 […]
Data Deduplication with ML
Problem Statement Briefly, we work with a company and they allow their customer to sign up for account. The company has so many branches, and one customer can open one (or more) account(s) at any branch. As a result, duplication happens, so here we are. When signing up, we need this kind of information from […]
RFM model and user segmentation built on Looker
As Data and Business analysts, we have all encountered situations where we need to segment customers based on their engagement with the business. An RFM model has a few benefits. It enables marketers to increase revenue by targeting specific groups of existing customers called “segments”. It also gives the business the ability to send targeted […]
Data modeling pitfalls and where to find them
There are many works related to the data modeling task – technical side and business side of things, below are some important lessons I have learned along the way implementing data projects, as DA and AE. This post aims to draw some conclusions on the common pitfalls in data modeling works, why we (me) may […]
How to migrate dashboards from Tableau to dbt and Looker
Things you need to be aware Workflow Tableau uses structured and unstructured data to create visualizations and has the added features of storyboarding and Spatial File Connector. Looker creates customized visuals and also allows you to choose from a library full of blocks with pre-made dashboard and visualization templates. Being one of the first and […]