Data Engineer
职位介绍
Design, build, and maintain scalable data pipelines (batch and streaming) delivering high-quality time-series datasets for forecasting use cases.
Develop and optimize data models (star/snowflake schemas, wide feature tables) to support forecasting and planning activities.
Collaborate with Data Science/Forecasting teams to productionize feature engineering, data versioning, and training/inference data readiness workflows.
Build and maintain orchestration workflows (Airflow/Dagster) with CI/CD, automated testing, and environment promotion standards.
Ensure governance and security controls (access management, PII handling, retention policies) while enabling self-service analytics for forecasting stakeholders.
Apply reliability best practices (backfills, idempotency, monitoring, observability) to ensure auditable, fault-tolerant pipelines.
Develop and optimize data models (star/snowflake schemas, wide feature tables) to support forecasting and planning activities.
Collaborate with Data Science/Forecasting teams to productionize feature engineering, data versioning, and training/inference data readiness workflows.
Build and maintain orchestration workflows (Airflow/Dagster) with CI/CD, automated testing, and environment promotion standards.
Ensure governance and security controls (access management, PII handling, retention policies) while enabling self-service analytics for forecasting stakeholders.
Apply reliability best practices (backfills, idempotency, monitoring, observability) to ensure auditable, fault-tolerant pipelines.
查看完整职位
工作职责、任职要求、技能与福利 — 免费创建账号即可查看。
已有账户? 登录
相似职位
其他可能适合您的职位。
远程办公no
城市Markham, 加拿大