Data Engineer
职位介绍
As a Data Engineer in the Lending Data Engineering team, you will partner with data modelers, product analytics, PMs, software engineers, and regional partners to translate business needs into scalable data solutions.
You will design, build, and manage data assets for acquisition, storage, processing, and access, ensuring availability for both batch and real-time use cases.
Develop scalable ETL/ELT pipelines to ingest data from diverse sources, with a focus on real-time data for accurate metric definitions.
Implement data quality, governance, and lineage practices to cleanse, assure, and monitor data across pipelines.
Optimize data infrastructure performance and design next-gen lifecycle tools for batch, real-time, API-based, and serverless workflows on AWS.
You will work with open-source technologies such as Flink, Spark, Kafka, Airflow, and Trino, and AWS services like Glue, Redshift, Lambda, S3, Kinesis, and EMR to deliver reliable insights.
You will design, build, and manage data assets for acquisition, storage, processing, and access, ensuring availability for both batch and real-time use cases.
Develop scalable ETL/ELT pipelines to ingest data from diverse sources, with a focus on real-time data for accurate metric definitions.
Implement data quality, governance, and lineage practices to cleanse, assure, and monitor data across pipelines.
Optimize data infrastructure performance and design next-gen lifecycle tools for batch, real-time, API-based, and serverless workflows on AWS.
You will work with open-source technologies such as Flink, Spark, Kafka, Airflow, and Trino, and AWS services like Glue, Redshift, Lambda, S3, Kinesis, and EMR to deliver reliable insights.
查看完整职位
工作职责、任职要求、技能与福利 — 免费创建账号即可查看。
或
已有账户？
登录相似职位
其他可能适合您的职位。