Ifm Us

Ifm Us

Data Engineer

Sunnyvale, CA

H1B sponsorship available$150k-$450kDetected 469 days ago
PythonData StructuresAlgorithmsGitSQLAWSCloud PlatformsKubernetesKafkaDeep LearningSparkData EngineeringData ScienceNLPLLMsResearchCommunicationCollaborationProblem Solving

About the role

  • As a Data Engineer specializing in Natural Language Processing (NLP) and large-scale data processing, you will quickly and effectively gather, curate, and prepare high-quality datasets to support cutting-edge NLP research.
  • Your role will be instrumental in enabling researchers by delivering essential data through efficient and scalable engineering practices, including web crawling, LLM-generated content refinement, and robust data pipelines, primarily leveraging Python and related technologies.

Responsibilities

  • Develop and maintain efficient web crawling solutions, APIs, and automated workflows to continuously improve data collection processes.
  • Implement scalable data pipelines, ensuring efficient data processing, storage, retrieval, and distribution to research teams.
  • Collaborate closely with researchers and engineers to ensure collected data meets specified quality and relevance criteria.
  • Document data collection methodologies, dataset characteristics, and pipeline architecture clearly and effectively.

Requirements

  • Bachelor's degree in Computer Science, Data Science, Engineering, or a related technical field required
  • Demonstrated proficiency in designing and deploying web crawling solutions, automated data extraction, and processing pipelines.
  • Strong understanding of data structures, algorithms, databases, SQL, and performance optimization.
  • Experience with refining outputs from large-scale AI models, such as LLM-generated data.

Nice to have

  • Master's degree or PhD degree or equivalent experience in Computer Science, Data Engineering, or related technical fields preferred.

Compensation

  • $150k-$450k

Benefits

  • Include *Comprehensive medical, dental, and vision benefits *Bonus *401K Plan *Generous paid time off, sick leave and holidays *Paid Parental Leave *Employee Assistance Program *Life insurance and disability

Visa & Work Authorization

  • This position is eligible for visa sponsorship.
Apply directly at Ifm Us →Create a free account for alerts like thisView Ifm Us immigration profile

This listing is sourced directly from Ifm Us's careers page and normalized into a canonical job model.