Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

ETL Parallelization - Apache Airflow
- Activity
- Members
- Labels
- Package registry
- Model registry
- Terraform modules
- Service Desk
- Model experiments

Snippets Groups Projects

Admin message

From 1. 4., DockerHub introduces new very strict rate limitations on docker image pulls.

Consider changing FROM tags in dockerfiles to use altenative providers or add login step at the beginning of CI/CD job as authenticated requests aren't affected.

cea301cf

Commit cea301cf authored 2 years ago by Kristina Zolochevskaia

:call_me_tone1:

Downloads
- Patches
- Plain Diff

aded target operator, db lookup needs refactoring

parent 1b212d5a

No related branches found

No related tags found

No related merge requests found

Changes 5

Hide whitespace changes

Inline Side-by-side

Showing

airflow/plugins/custom_operators/load_to_stage_no_psc_operator.py 20 additions, 48 deletions

...plugins/custom_operators/load_to_stage_no_psc_operator.py
airflow/plugins/custom_operators/load_to_target_operator.py 195 additions, 8 deletions

airflow/plugins/custom_operators/load_to_target_operator.py
airflow/plugins/custom_operators/make_increment_no_psc_operator.py 14 additions, 25 deletions

...lugins/custom_operators/make_increment_no_psc_operator.py
airflow/target_transformations/__init__.py 0 additions, 0 deletions

airflow/target_transformations/__init__.py
airflow/target_transformations/process_data_klasifikace.py 10 additions, 0 deletions

airflow/target_transformations/process_data_klasifikace.py

with 239 additions and 81 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment