Data Engineer
职位介绍
Design and implement end-to-end scalable data pipelines to ingest, transform, and load data into the data warehouse.
Analyze datasets and implement robust data validation, deduplication, and bias mitigation to ensure high-quality, diverse training data.
Create training sets from existing data using classical computer vision techniques, vision models, and large language models (LLMs).
Optimize data loading, preprocessing, and augmentation workflows to maximize training efficiency and minimize bottlenecks.
Document all data processes, schemas, and transformations to ensure reproducibility and transparency for the research team.
Collaborate with researchers and engineers to understand data needs, provide actionable insights, iterate on pipelines, and source multimodal data from public sources.
Analyze datasets and implement robust data validation, deduplication, and bias mitigation to ensure high-quality, diverse training data.
Create training sets from existing data using classical computer vision techniques, vision models, and large language models (LLMs).
Optimize data loading, preprocessing, and augmentation workflows to maximize training efficiency and minimize bottlenecks.
Document all data processes, schemas, and transformations to ensure reproducibility and transparency for the research team.
Collaborate with researchers and engineers to understand data needs, provide actionable insights, iterate on pipelines, and source multimodal data from public sources.
查看完整职位
工作职责、任职要求、技能与福利 — 免费创建账号即可查看。
已有账户？ 登录
相似职位
其他可能适合您的职位。