We’ve already established the synergy of dbt & Databricks. However, adding data warehouse automation to the mix might be the missing link in the story. The combination of dbt & databricks provides a robust solution for streamlining data workflows and enhancing data lakehouse architectures. It leverages Databricks’ versatility in data processing and machine learning with […]
Organizations are increasingly reliant on data warehouses to store, manage, and analyze vast amounts of information. However, the success of a data warehouse hinges not only on the quality of the data but also on the effectiveness of its underlying data model. Effective data modeling lays the foundation for a robust data warehouse architecture, enabling […]
DBT and Airbyte complement each other perfectly. DBT enables analysts and engineers to easily and efficiently transform their data in their data warehouse environment, but the data first needs to be present in that environment. This is where Airbyte comes into the picture by enabling those same engineers and analysts to easily and reliably transfer data from their […]
Matillion ETL is a cloud ELT solution purpose-built with cloud data warehouses like Snowflake, Azure Synapse and Google BigQuery in mind, with a separate custom version for each provider. The cloud native design with all data jobs running in your cloud environment offers maximum speed, scalability, and efficiency and is optimized for both resource and […]
At DataSense, we believe building a data platform always starts with a well-defined plan. Custom-built solutions tend to be difficult to maintain and are especially not future proof. Therefore, we like to work with an open standard, namely Data Vault 2.0. This standard combines methodology with a modelling approach and architectural guidelines. Automation In Data Vault 2.0, […]
