DataOps School

1. Introduction & Overview What is Dagster? Dagster is an open-source data orchestrator for machine learning, analytics, and ETL (Extract, Transform, Load) workflows. It focuses on writing,…

1. Introduction & Overview What is Prefect? Prefect is an open-source data workflow orchestration tool designed to build, run, and monitor complex pipelines with ease. It enables…

1. Introduction & Overview What is dbt (Data Build Tool)? dbt (data build tool) is an open-source command-line tool that enables data analysts and engineers to transform…

1. Introduction & Overview Apache Airflow has become a staple in modern data orchestration and workflow automation. In the DevSecOps paradigm, where automation, traceability, and security are…

1. Introduction & Overview What is Schema Evolution? Schema Evolution refers to the process of managing changes to the structure of data (schemas) in a way that…

📘 Introduction & Overview What is Data Masking? Data Masking is the process of hiding original sensitive data with modified content (characters or other data) that retains…

1. Introduction & Overview What is Tokenization? Tokenization is the process of substituting sensitive data elements with a non-sensitive equivalent—called a token—that has no exploitable value. Unlike…

📌 Introduction & Overview What is Anonymization? Anonymization is the process of transforming personal or sensitive data in a way that prevents the identification of individuals, even…

1. Introduction & Overview What is Normalization? Normalization in the context of DevSecOps refers to the process of transforming data, configurations, logs, or system inputs into a…

1. Introduction & Overview What is Cleansing? In DevSecOps, cleansing refers to the practice of removing, sanitizing, or redacting sensitive data, metadata, or malicious inputs from systems,…

1. Introduction & Overview What is Aggregation? Aggregation in the context of DevSecOps refers to the systematic collection, unification, normalization, and correlation of data from diverse sources…

1. Introduction & Overview What is Enrichment? In the context of DevSecOps, Enrichment refers to the process of augmenting raw security data (logs, alerts, metrics) with contextual…

1. Introduction & Overview What is Transformation? In the context of DevSecOps, Transformation refers to the strategic and operational shift in an organization’s culture, processes, and tooling…

1. Introduction & Overview What is Ingestion? Ingestion refers to the process of collecting, importing, and processing data from various sources into a centralized system for analysis,…

📘 Introduction & Overview What is Agile Data? Agile Data refers to the application of agile methodologies—like iterative development, cross-functional collaboration, and incremental delivery—to data management and…

1. Introduction & Overview What is the DataOps Lifecycle? The DataOps Lifecycle refers to the end-to-end process of managing data workflows—from ingestion and transformation to deployment and…

1. Introduction & Overview What is Data Observability? Data Observability is the ability to fully understand the health, lineage, and performance of data across your infrastructure. In…

1. Introduction & Overview What is Data Lineage? Data Lineage refers to the life cycle of data—its origins, movements, transformations, and how it interacts across systems. It…

1. Introduction & Overview What is Data Orchestration? Data orchestration is the automated process of organizing, coordinating, and managing data workflows across disparate systems and environments. In…