Data Engineer II
Is deze vacature iets voor u?
Mijn cv maken Maak uw cv en ontdek uw matchpercentage met deze functie — en met alle andere.
De functie
Design, develop, and optimize batch and real-time data pipelines using Snowflake, Snowpark, Python, and PySpark.
Build robust data transformation workflows with dbt, following Test-Driven Development (TDD) and modular design.
Implement and manage CI/CD pipelines (GitLab/Jenkins) for automated testing, deployment, and monitoring of data workflows.
Administer Snowflake objects, perform performance tuning, access control, cost optimization, and scalability planning via Schema Change.
Develop real-time streaming pipelines (Kafka, Spark Structured Streaming) and establish comprehensive data observability across the platform.
Collaborate with stakeholders to gather data requirements, deliver reliable analytics-ready models, and document architecture and processes.
Build robust data transformation workflows with dbt, following Test-Driven Development (TDD) and modular design.
Implement and manage CI/CD pipelines (GitLab/Jenkins) for automated testing, deployment, and monitoring of data workflows.
Administer Snowflake objects, perform performance tuning, access control, cost optimization, and scalability planning via Schema Change.
Develop real-time streaming pipelines (Kafka, Spark Structured Streaming) and establish comprehensive data observability across the platform.
Collaborate with stakeholders to gather data requirements, deliver reliable analytics-ready models, and document architecture and processes.
Bekijk de volledige vacature
Taken, profiel, vaardigheden en voordelen — maak gratis een account aan.
Al een account? Inloggen
Vergelijkbare vacatures
Andere functies die kunnen passen.
Thuiswerkenno
StadPune, India