Data Engineer II
职位介绍
Design, develop, and optimize batch and real-time data pipelines using Snowflake, Snowpark, Python, and PySpark.
Build robust data transformation workflows with dbt, following Test-Driven Development (TDD) and modular design.
Implement and manage CI/CD pipelines (GitLab/Jenkins) for automated testing, deployment, and monitoring of data workflows.
Administer Snowflake objects, perform performance tuning, access control, cost optimization, and scalability planning via Schema Change.
Develop real-time streaming pipelines (Kafka, Spark Structured Streaming) and establish comprehensive data observability across the platform.
Collaborate with stakeholders to gather data requirements, deliver reliable analytics-ready models, and document architecture and processes.
Build robust data transformation workflows with dbt, following Test-Driven Development (TDD) and modular design.
Implement and manage CI/CD pipelines (GitLab/Jenkins) for automated testing, deployment, and monitoring of data workflows.
Administer Snowflake objects, perform performance tuning, access control, cost optimization, and scalability planning via Schema Change.
Develop real-time streaming pipelines (Kafka, Spark Structured Streaming) and establish comprehensive data observability across the platform.
Collaborate with stakeholders to gather data requirements, deliver reliable analytics-ready models, and document architecture and processes.
查看完整职位
工作职责、任职要求、技能与福利 — 免费创建账号即可查看。
已有账户？ 登录
相似职位
其他可能适合您的职位。