etlplus.workflow

etlplus.workflow package.

Job workflow helpers.

Functions

schedule_validation_issues(schedules, *, ...)

Return semantic validation issues for configured schedules.

topological_sort_jobs(jobs)

Return jobs in topological order based on depends_on.

Classes

ExtractRef(*, source[, options])

Reference to a data source for extraction.

JobConfig(*, name[, description, ...])

Configuration for a data processing job.

JobRetryConfig(*[, max_attempts, ...])

Optional retry policy for DAG-style job execution.

LoadRef(*, target[, overrides])

Reference to a data target for loading.

ProfileConfig(*[, default_target, env])

Configuration for pipeline profiles.

ScheduleBackfillConfig(*[, enabled, ...])

Optional bounded backfill metadata for one schedule.

ScheduleConfig(*, name[, cron, interval, ...])

Portable schedule configuration attached to one ETLPlus config.

ScheduleIntervalConfig(*, minutes)

Interval-based schedule trigger.

ScheduleTargetConfig(*[, job, run_all])

Execution target for one portable schedule entry.

TransformRef(*, pipeline)

Reference to a transformation pipeline.

ValidationRef(*, ruleset[, severity, phase])

Reference to a validation rule set.

Exceptions

DagError(*, message)

Error raised when a workflow dependency graph is invalid.