Genesis10

Genesis10

Data Engineer

New York, New York, USA · full-time

Sponsorship not specified$100k-$115kDetected 41 days ago
PythonGitSQLBigQuerySnowflakeRedshiftDatabricksAWSGCPAzureCloud PlatformsDockerKubernetesCI/CDOAuthMachine LearningSparkAirflowdbtData EngineeringData ScienceLLMs

About the role

  • Enforce data quality and governance through data contracts, validations/tests, lineage, observability, and proactive alerting.
  • Uphold security and compliance (e.g., PII handling, encryption, masking) in line with firm standards.

Responsibilities

  • Ingest and model data from APIs, files/SFTP, and relational sources; implement layered architectures (raw/clean/serving) using PySpark/SQL and dbt, Python.
  • Design and operate pipelines with Prefect (or Airflow), including scheduling, retries, parameterization, SLAs, and welldocumented runbooks.
  • Build on cloud data platforms, leveraging S3/ADLSS for storage and a Spark platform (e.g., Databricks or equivalent) for compute; manage jobs, secrets, and access.
  • Publish governed data services and manage their lifecycle with Azure API Management (APIM) - authentication/authorization, policies, versioning, quotas, and monitoring.
  • Optimize performance and cost via partitioning, clustering, query tuning, job sizing, and workload management.
  • Collaborate with stakeholders (analytics, AI engineering, and business teams) to translate requirements into reliable, productionready datasets.

Requirements

  • Bachelor's or advanced degree in Computer Science, Data Engineering, or a related field.
  • 4-15 years of professional data engineering experience.
  • Experience onboarding datasets to cloud data platforms (storage, compute, security, governance).
  • Familiarity with Azure/AWS/Google Cloud Platform data services (e.g., S3/ADLSS
  • familiarity with frameworks such as LangChain or LlamaIndex.
  • If you have the described qualifications and are interested in this exciting opportunity, please apply!

Nice to have

  • Git-based workflows CI/CD and containerization with Docker (Kubernetes a plus).

Skills

  • This is a 6+ month contract opportunity.

Compensation

  • $100k-$115k

Equal opportunity

  • Equal Opportunity Employer.
  • Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Apply directly at Genesis10 →Create a free account for alerts like thisView Genesis10 immigration profile

This listing is sourced directly from Genesis10's careers page and normalized into a canonical job model.