Data Engineer
仕事内容
Design, build, and maintain scalable data pipelines (batch and streaming) delivering high-quality time-series datasets for forecasting use cases.
Develop and optimize data models (star/snowflake schemas, wide feature tables) to support forecasting and planning activities.
Collaborate with Data Science/Forecasting teams to productionize feature engineering, data versioning, and training/inference data readiness workflows.
Build and maintain orchestration workflows (Airflow/Dagster) with CI/CD, automated testing, and environment promotion standards.
Ensure governance and security controls (access management, PII handling, retention policies) while enabling self-service analytics for forecasting stakeholders.
Apply reliability best practices (backfills, idempotency, monitoring, observability) to ensure auditable, fault-tolerant pipelines.
Develop and optimize data models (star/snowflake schemas, wide feature tables) to support forecasting and planning activities.
Collaborate with Data Science/Forecasting teams to productionize feature engineering, data versioning, and training/inference data readiness workflows.
Build and maintain orchestration workflows (Airflow/Dagster) with CI/CD, automated testing, and environment promotion standards.
Ensure governance and security controls (access management, PII handling, retention policies) while enabling self-service analytics for forecasting stakeholders.
Apply reliability best practices (backfills, idempotency, monitoring, observability) to ensure auditable, fault-tolerant pipelines.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
すでにアカウントをお持ちですか？ ログイン
類似の求人
あなたに合いそうな他の職種。