Data Engineer
仕事内容
Design and implement end-to-end scalable data pipelines to ingest, transform, and load data into the data warehouse.
Analyze datasets and implement robust data validation, deduplication, and bias mitigation to ensure high-quality, diverse training data.
Create training sets from existing data using classical computer vision techniques, vision models, and large language models (LLMs).
Optimize data loading, preprocessing, and augmentation workflows to maximize training efficiency and minimize bottlenecks.
Document all data processes, schemas, and transformations to ensure reproducibility and transparency for the research team.
Collaborate with researchers and engineers to understand data needs, provide actionable insights, iterate on pipelines, and source multimodal data from public sources.
Analyze datasets and implement robust data validation, deduplication, and bias mitigation to ensure high-quality, diverse training data.
Create training sets from existing data using classical computer vision techniques, vision models, and large language models (LLMs).
Optimize data loading, preprocessing, and augmentation workflows to maximize training efficiency and minimize bottlenecks.
Document all data processes, schemas, and transformations to ensure reproducibility and transparency for the research team.
Collaborate with researchers and engineers to understand data needs, provide actionable insights, iterate on pipelines, and source multimodal data from public sources.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
すでにアカウントをお持ちですか？ ログイン
類似の求人
あなたに合いそうな他の職種。