Built on shortcomings and possible improvement of other tooling in the market, Prefect is an open-source workflow management tool designed to orchestrate data stacks. With Prefect you can build, run, and monitor many different pipelines at a certain schedule. // Why There are two main reasons why orchestration tools have emerged: In the past, different […]
DBT and Airbyte complement each other perfectly. DBT enables analysts and engineers to easily and efficiently transform their data in their data warehouse environment, but the data first needs to be present in that environment. This is where Airbyte comes into the picture by enabling those same engineers and analysts to easily and reliably transfer data from their […]
Matillion ETL is a cloud ELT solution purpose-built with cloud data warehouses like Snowflake, Azure Synapse and Google BigQuery in mind, with a separate custom version for each provider. The cloud native design with all data jobs running in your cloud environment offers maximum speed, scalability, and efficiency and is optimized for both resource and […]
At DataSense, we believe building a data platform always starts with a well-defined plan. Custom-built solutions tend to be difficult to maintain and are especially not future proof. Therefore, we like to work with an open standard, namely Data Vault 2.0. This standard combines methodology with a modelling approach and architectural guidelines. Automation In Data Vault 2.0, […]
