Research Engineer, Data Ingestion
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
The role
Line 1: Seeking a Research Engineer to join the Data Ingestion team focused on acquiring open internet data via a large-scale web crawler.
Line 2: Develop and maintain a scalable web crawler infrastructure and related data pipelines.
Line 3: Design and run experiments to evaluate data quality, extraction methods, and crawling strategies.
Line 4: Analyze crawled data to identify patterns, gaps, and opportunities for improvement.
Line 5: Build tailored crawlers for high-value data sources and establish feedback loops with pretraining and data evaluation teams.
Line 6: Collaborate cross-functionally, participate in code reviews, and balance system-building with experimentation in a hybrid role.
Line 2: Develop and maintain a scalable web crawler infrastructure and related data pipelines.
Line 3: Design and run experiments to evaluate data quality, extraction methods, and crawling strategies.
Line 4: Analyze crawled data to identify patterns, gaps, and opportunities for improvement.
Line 5: Build tailored crawlers for high-value data sources and establish feedback loops with pretraining and data evaluation teams.
Line 6: Collaborate cross-functionally, participate in code reviews, and balance system-building with experimentation in a hybrid role.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inYou might also like these jobs
No closely matching jobs yet — here are the most recent ones.
? Full-Stack, Web Development, Software Engineering, Usability, Security, Reliability, Prototyping, Collaboration, Product Design, Front-end, Back-end, Frameworks, Prototyping, Iteration, Usability, Security, Reliability, Product Development, Full-Stack Sol ? Housekeeper,Housekeeping,Senior Living,Cleaning,Laundry,Communication,Interpersonal,Disinfecting,PTO,Health Insurance,Disability Insurance,Senior Housing,Active Adult,Community Living,Housekeeping Management,Resident Services,Teamwork,Time Management ? Plant Manager, Human Resource, HR, Employment, Labor Relations, Union, Collective Bargaining, EEOC, ADA, Civil Rights, Affirmative Action, Workers Compensation, Succession Planning, Recruiting, Selection, Placement, Employee Relations, Employee Safety, Tr ? Go, JavaScript, Node.js, C#, ASP.NET, .NET, SQL Server, RESTful, Microservices, Full-Stack, Software Engineer, Senior, Scalable, Enterprise, Problem-Solving, Leadership, Communication, Architecture, Design, Development, Engineering, Technical ? Software Engineer, Fullstack, Go, Java, C++, React, TypeScript, Backend, Frontend, Cloud, AWS, Docker, PostgreSQL, ML, AI, Fintech, Mortgage, Automation, DevOps, Terraform, Pulumi, Python, Pandas, Numpy, Equity, Ownership, Collaboration, Communication, Pr ? Job Title, Facility Housekeeper, Housekeeper, Housekeeper, Cleaning, Cleaning, Organization, Time Management, Attention to Detail, Safety, Physical Labor, Inventory Management, Supply Chain, Team Player, Communication, Leadership, Career Stability, Advanc