Data Engineer
仕事内容
As a Data Engineer in the Lending Data Engineering team, you will partner with data modelers, product analytics, PMs, software engineers, and regional partners to translate business needs into scalable data solutions.
You will design, build, and manage data assets for acquisition, storage, processing, and access, ensuring availability for both batch and real-time use cases.
Develop scalable ETL/ELT pipelines to ingest data from diverse sources, with a focus on real-time data for accurate metric definitions.
Implement data quality, governance, and lineage practices to cleanse, assure, and monitor data across pipelines.
Optimize data infrastructure performance and design next-gen lifecycle tools for batch, real-time, API-based, and serverless workflows on AWS.
You will work with open-source technologies such as Flink, Spark, Kafka, Airflow, and Trino, and AWS services like Glue, Redshift, Lambda, S3, Kinesis, and EMR to deliver reliable insights.
You will design, build, and manage data assets for acquisition, storage, processing, and access, ensuring availability for both batch and real-time use cases.
Develop scalable ETL/ELT pipelines to ingest data from diverse sources, with a focus on real-time data for accurate metric definitions.
Implement data quality, governance, and lineage practices to cleanse, assure, and monitor data across pipelines.
Optimize data infrastructure performance and design next-gen lifecycle tools for batch, real-time, API-based, and serverless workflows on AWS.
You will work with open-source technologies such as Flink, Spark, Kafka, Airflow, and Trino, and AWS services like Glue, Redshift, Lambda, S3, Kinesis, and EMR to deliver reliable insights.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
すでにアカウントをお持ちですか？ ログイン
類似の求人
あなたに合いそうな他の職種。