Lead Data Engineer - (Datawarehouse) - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow
応募状況をスマホで確認 Whileresume の無料アプリ（iPhone・Android）。
仕事内容
Lead the design and delivery of secure, scalable data pipelines and data warehouse solutions in a Big Data environment using PySpark (Python/Scala) on Hadoop or object storage.
Build and optimize end-to-end data pipelines and petabyte-scale data architectures, leveraging Nifi pipelines when available and Airflow for workflow orchestration.
Work across on-premises and cloud platforms (AWS, Azure, Databricks) and manage Hive external tables, partitions, and multiple file formats.
Collaborate in Agile/Scrum teams, create well-defined user stories, perform SQL tuning (Oracle, Netezza), and implement code quality via Git and CI/CD (Jenkins).
Drive automation and efficiency in data ingestion, movement and access workflows; diagnose production issues and implement robust mitigations.
Demonstrate initiative and strong communication while juggling multiple projects in distributed teams and upholding security standards.
Build and optimize end-to-end data pipelines and petabyte-scale data architectures, leveraging Nifi pipelines when available and Airflow for workflow orchestration.
Work across on-premises and cloud platforms (AWS, Azure, Databricks) and manage Hive external tables, partitions, and multiple file formats.
Collaborate in Agile/Scrum teams, create well-defined user stories, perform SQL tuning (Oracle, Netezza), and implement code quality via Git and CI/CD (Jenkins).
Drive automation and efficiency in data ingestion, movement and access workflows; diagnose production issues and implement robust mitigations.
Demonstrate initiative and strong communication while juggling multiple projects in distributed teams and upholding security standards.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
または
すでにアカウントをお持ちですか？
ログインこちらの求人もおすすめです
近い求人はまだありません — 最新の求人をご紹介します。