Comparisons · Workflow orchestration

Decim vs Apache Airflow: task state is not the full cause

Apache Airflow orchestrates workflows and records task execution. Decim investigates the evidence behind an ETL incident when the task state alone does not explain the data outcome.

Decim and Apache Airflow: the short answer

Decim investigates ETL incidents using GitHub and scoped Windows evidence. Apache Airflow is an orchestration platform for defining, scheduling and observing workflow tasks and dependencies.

Airflow is the right comparison when teams need workflow orchestration and task-level execution context. Decim addresses the causal investigation that may cross Airflow, a worker, a repository, a database and host-level runtime evidence.

Decim compared with Apache Airflow
Dimension Decim Apache Airflow
Primary questionWhy did this ETL incident produce the observed data outcome?How should this workflow be scheduled, ordered and executed?
Starting pointA known incident, anomaly or unexplained pipeline result.A DAG, task run, dependency or orchestration workflow.
Core scopeEvidence across code, deployment, files and runtime events.Workflow definitions, task state, dependencies and execution scheduling.
Current Decim evidenceGitHub plus scoped Windows directory, file and Event Log tasks.Airflow task and DAG context where the workflow is deployed.
Best use togetherInvestigate the cause after a task or data outcome needs explanation.Orchestrate the workflow and provide task-level execution signals.

Choose Airflow for orchestration and scheduling

A workflow engine should own dependencies, scheduling and task execution state.

Airflow is the direct fit when the problem is coordinating work: defining a DAG, expressing dependencies, scheduling runs and exposing task-level execution state. That context is often the first useful signal in an ETL incident. A failed task, a retry or a downstream skip can narrow the investigation and establish the relevant time window. Decim is not an orchestration engine and should not be presented as one. The comparison is useful because teams may already have an orchestrator while still lacking a structured way to explain why the resulting data was incomplete or unexpected.

Choose Decim when task state is not enough

A task can fail for many reasons, and a successful task can still produce the wrong result.

The orchestrator may tell the team that a task failed, retried or succeeded, but the cause can remain distributed. A worker could use the wrong configuration, a deployed file could differ from the repository, an input could be missing, or a host event could interrupt part of a custom loader. Decim investigates those questions using GitHub and scoped Windows directory, file and Event Log tasks in the current admin. It is particularly relevant when Airflow schedules or invokes a legacy service whose important runtime behavior is outside the DAG definition. The output is an evidence-backed diagnosis rather than another task-state label.

Let Airflow identify the run and Decim explain the outcome

Orchestration context makes a cross-system investigation more precise.

A combined workflow can start with the DAG run, task instance and retry history. Those details provide the run identity and time window for a Decim investigation, which can then compare the relevant repository revision, deployed configuration and host evidence. This division is useful for hybrid environments where Airflow sits above SQL jobs, Windows services or custom loaders. Airflow remains the source of workflow execution context; Decim follows the evidence beyond the orchestrator when the question becomes why the data moved the way it did. The current product boundary is deliberate: Decim does not currently ingest Airflow metadata automatically, and database and scheduler integrations remain planned, even though the investigation model is designed for this class of incident.

Common questions

Is Decim a replacement for Airflow?
No. Airflow orchestrates and schedules workflows; Decim investigates why a workflow or ETL runtime produced an unexpected result.
Can Airflow show why a task failed?
Airflow can provide task state, logs and execution context. Decim is aimed at the broader evidence chain when those signals do not establish the pipeline cause.
Does Decim currently integrate with Airflow?
Not as a current connector. GitHub and the Windows x64 agent are available today; scheduler and third-party telemetry integrations are planned.
Can Decim investigate an Airflow task that calls a Windows service?
That is a relevant use case for the current evidence model, provided the investigation uses the supported GitHub and scoped Windows agent surfaces.
Which product should schedule the remediation?
Airflow or the existing orchestration system should own workflow scheduling. Decim produces a human-reviewed solution path rather than silently changing the workflow.

Get started

Compare from a real incident

Bring an ETL incident and the tools you already use. We will separate detection, evidence collection and diagnosis, then show where Apache Airflow and Decim each fit.