dbt_airflow_factory.ecs package

Submodules

dbt_airflow_factory.ecs.ecs_operator module

Factories creating Airflow Operators running DBT tasks.

class EcsPodOperatorBuilder(dbt_execution_env_parameters: dbt_airflow_factory.dbt_parameters.DbtExecutionEnvironmentParameters, ecs_execution_parameters: dbt_airflow_factory.ecs.ecs_parameters.EcsExecutionParameters)[source]

Bases: dbt_airflow_factory.operator.DbtRunOperatorBuilder

create(name: str, command: str, model: Optional[str] = None, additional_dbt_args: Optional[List[str]] = None) → airflow.models.baseoperator.BaseOperator[source]

Create Airflow Operator running a single DBT task.

Parameters

name (str) – task name.
command (str) – DBT command to run.
model (Optional[str]) – models to include.
additional_dbt_args (Optional[List[str]]) – Additional arguments to pass to dbt.

Returns

Airflow Operator running a single DBT task.

Return type

BaseOperator

dbt_execution_env_parameters: dbt_airflow_factory.dbt_parameters.DbtExecutionEnvironmentParameters: POD representing DBT operator config file.

ecs_execution_parameters: dbt_airflow_factory.ecs.ecs_parameters.EcsExecutionParameters: POD representing ecs operator config file.

dbt_airflow_factory.ecs.ecs_parameters module

POD representing Kubernetes operator config file.

class EcsExecutionParameters(image: str, **_kwargs: Any)[source]

Bases: object

Parameters: image (str) – tag of Docker image you wish to launch.

dbt_airflow_factory.ecs.ecs_parameters_loader module

POD representing Kubernetes operator config file.

class EcsExecutionParametersLoader[source]

Bases: object

static create_config(dag_path: str, env: str, execution_env_config_file_name: str) → dbt_airflow_factory.ecs.ecs_parameters.EcsExecutionParameters[source]