Data Engineer
Is deze vacature iets voor u?
Mijn cv maken Maak uw cv en ontdek uw matchpercentage met deze functie — en met alle andere.
De functie
As a Data Engineer in the Lending Data Engineering team, you will partner with data modelers, product analytics, PMs, software engineers, and regional partners to translate business needs into scalable data solutions.
You will design, build, and manage data assets for acquisition, storage, processing, and access, ensuring availability for both batch and real-time use cases.
Develop scalable ETL/ELT pipelines to ingest data from diverse sources, with a focus on real-time data for accurate metric definitions.
Implement data quality, governance, and lineage practices to cleanse, assure, and monitor data across pipelines.
Optimize data infrastructure performance and design next-gen lifecycle tools for batch, real-time, API-based, and serverless workflows on AWS.
You will work with open-source technologies such as Flink, Spark, Kafka, Airflow, and Trino, and AWS services like Glue, Redshift, Lambda, S3, Kinesis, and EMR to deliver reliable insights.
You will design, build, and manage data assets for acquisition, storage, processing, and access, ensuring availability for both batch and real-time use cases.
Develop scalable ETL/ELT pipelines to ingest data from diverse sources, with a focus on real-time data for accurate metric definitions.
Implement data quality, governance, and lineage practices to cleanse, assure, and monitor data across pipelines.
Optimize data infrastructure performance and design next-gen lifecycle tools for batch, real-time, API-based, and serverless workflows on AWS.
You will work with open-source technologies such as Flink, Spark, Kafka, Airflow, and Trino, and AWS services like Glue, Redshift, Lambda, S3, Kinesis, and EMR to deliver reliable insights.
Bekijk de volledige vacature
Taken, profiel, vaardigheden en voordelen — maak gratis een account aan.
Al een account? Inloggen
Vergelijkbare vacatures
Andere functies die kunnen passen.