Judge Group, Inc.

Judge Group, Inc.

Sr Azure Databricks Data Engineer

Las Vegas, Nevada · Senior

Sponsorship not specifiedDetected 14 days ago
PythonCode ReviewGitSQLDatabricksVector DatabasesAzureCI/CDDevOpsPlatform EngineeringMachine LearningSparkAirflowData EngineeringData ScienceNLPLLMsRAGMLOps

About the role

  • The ideal candidate combines strong hands-on expertise in Databricks, Spark, SQL, and Python with experience migrating legacy SQL-based workloads to modern cloud architectures.
  • Message & data rates apply and message frequency may vary.

Responsibilities

  • Design, develop, and maintain scalable ELT/ETL pipelines for enterprise analytics and operational reporting.
  • Build and optimize data workflows using Databricks, Apache Spark, SQL, and Python.
  • Develop and maintain Delta Lake tables and Medallion Architecture (Bronze, Silver, Gold) data models.
  • Lead migration initiatives from legacy/on-premises SQL environments to Azure Databricks and cloud-native platforms.
  • Implement data quality, monitoring, observability, and reliability best practices.
  • Collaborate with business intelligence, analytics, and data science teams to deliver trusted and curated datasets.
  • Support AI/ML and GenAI initiatives by preparing and structuring data for downstream applications, including LLM and RAG-based solutions.
  • Troubleshoot and optimize large-scale Spark processing jobs for performance and cost efficiency.
  • Document data pipelines, architecture designs, data flows, and operational procedures.
  • Support production deployments and ongoing operational excellence through CI/CD and DevOps practices.

Requirements

  • Experience designing and maintaining enterprise ETL/ELT pipelines.
  • Experience with Delta Lake and Medallion Architecture frameworks.
  • Proven experience migrating workloads from SQL Server or other legacy data platforms to cloud-based solutions.
  • Strong understanding of data modeling, data warehousing, and large-scale data processing principles.
  • Experience with Git-based source control and collaborative development workflows.
  • Knowledge of CI/CD, DevOps, and automated deployment practices.
  • Experience tuning Spark workloads for performance and scalability.
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience.
  • 5+ years of experience in Data Engineering, Data Platform Engineering, or related technical roles.

Nice to have

  • Experience with Azure cloud services including Data Factory, Data Lake Storage, Synapse, Azure Functions, and related services.
  • Experience supporting analytics environments within:
  • Highly regulated industries
  • Exposure to AI/ML pipelines and MLOps practices.
  • Experience with:
  • Vector databases
  • Retrieval-Augmented Generation (RAG)
  • Large Language Model (LLM) integrations

Compensation

  • $70.00 USD Hourly - $80.00

Visa & Work Authorization

  • Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Apply directly at Judge Group, Inc. →Create a free account for alerts like thisView Judge Group, Inc. immigration profile

This listing is sourced directly from Judge Group, Inc.'s careers page and normalized into a canonical job model.