Data Engineer
応募状況をスマホで確認 Whileresume の無料アプリ(iPhone・Android)。
仕事内容
Design and implement end-to-end scalable data pipelines to ingest, transform, and load data into the data warehouse.
Analyze datasets and implement robust data validation, deduplication, and bias mitigation to ensure high-quality, diverse training data.
Create training sets from existing data using classical computer vision techniques, vision models, and large language models (LLMs).
Optimize data loading, preprocessing, and augmentation workflows to maximize training efficiency and minimize bottlenecks.
Document all data processes, schemas, and transformations to ensure reproducibility and transparency for the research team.
Collaborate with researchers and engineers to understand data needs, provide actionable insights, iterate on pipelines, and source multimodal data from public sources.
Analyze datasets and implement robust data validation, deduplication, and bias mitigation to ensure high-quality, diverse training data.
Create training sets from existing data using classical computer vision techniques, vision models, and large language models (LLMs).
Optimize data loading, preprocessing, and augmentation workflows to maximize training efficiency and minimize bottlenecks.
Document all data processes, schemas, and transformations to ensure reproducibility and transparency for the research team.
Collaborate with researchers and engineers to understand data needs, provide actionable insights, iterate on pipelines, and source multimodal data from public sources.
求人の全文を見る
業務内容、求める人物像、スキル、待遇 — 無料アカウントの作成で閲覧できます。
または
すでにアカウントをお持ちですか?
ログインこちらの求人もおすすめです
近い求人はまだありません — 最新の求人をご紹介します。