Data Engineer II
仕事内容
Design, develop, and optimize batch and real-time data pipelines using Snowflake, Snowpark, Python, and PySpark.
Build robust data transformation workflows with dbt, following Test-Driven Development (TDD) and modular design.
Implement and manage CI/CD pipelines (GitLab/Jenkins) for automated testing, deployment, and monitoring of data workflows.
Administer Snowflake objects, perform performance tuning, access control, cost optimization, and scalability planning via Schema Change.
Develop real-time streaming pipelines (Kafka, Spark Structured Streaming) and establish comprehensive data observability across the platform.
Collaborate with stakeholders to gather data requirements, deliver reliable analytics-ready models, and document architecture and processes.
Build robust data transformation workflows with dbt, following Test-Driven Development (TDD) and modular design.
Implement and manage CI/CD pipelines (GitLab/Jenkins) for automated testing, deployment, and monitoring of data workflows.
Administer Snowflake objects, perform performance tuning, access control, cost optimization, and scalability planning via Schema Change.
Develop real-time streaming pipelines (Kafka, Spark Structured Streaming) and establish comprehensive data observability across the platform.
Collaborate with stakeholders to gather data requirements, deliver reliable analytics-ready models, and document architecture and processes.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
すでにアカウントをお持ちですか？ ログイン
類似の求人
あなたに合いそうな他の職種。