DATAMAXIS

DATAMAXIS

Senior Azure Data Engineer

Springfield, IL · Senior

Sponsorship not specifiedDetected 20 days ago
PythonBashPowerShellCode ReviewSQLSnowflakeDatabricksAzureTerraformCI/CDDevOpsPlatform EngineeringRESTMachine LearningPandasSparkData EngineeringKQLIncident ResponseAuditingpytestUnityMentoring

About the role

  • We are seeking a Senior Azure Data Engineer to help design, build, and operate our next-generation enterprise data platform on Microsoft Azure.
  • You will own end-to-end delivery of data pipelines and data products that power analytics, regulatory reporting, operational dashboards, and emerging AI/ML use cases.
  • You will partner closely with data architects, analytics engineers, data scientists, business stakeholders, and platform engineering teams to deliver reliable, performance, secure, and costefficient data solutions.

Responsibilities

  • Pipeline Design & Development Design and build robust, reusable, parameter-driven ingestion and transformation pipeline using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory.
  • Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns.
  • Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate.
  • Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark.
  • Data Modeling & Warehousing Design dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption.
  • Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns.
  • Platform Engineering & DevOps Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments.
  • Migration & Modernization Lead or contribute to legacy-to-cloud migrations - e.g., Informatica PowerCenter to Azure Data Factory, on-premises Teradata / Oracle / SQL Server to Synapse or Fabric.
  • Perform workload assessment, capacity planning, and cost modeling for target-state architectures.

Requirements

  • Deep hands-on expertise with Azure Data Factory: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and all three Integration Runtime types (Azure, Self hosted, SSIS).
  • Strong Experience in Data Bricks and PySpark.
  • Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, Spark Pools) OR Azure Databricks (Delta Lake, Unity Catalog) OR Microsoft Fabric (Warehouse, Lakehouse, OneLake).
  • Strong working knowledge of Azure Data Lake Storage Gen2 (hierarchical namespace, RBAC + ACLs, lifecycle management, security).
  • Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints).
  • familiarity with Spark SQL, KQL, PowerShell, and Bash shell scripting.
  • Deep hands-on expertise with

Nice to have

  • 5+ years of data warehouse development experience.
  • 5+ years of data modeling experience using ERWIN or similar tools.
  • 2+ years of experience with Azure Data Factory and Snowflake.
  • Medicaid Domain Knowledge is a plus.
Apply directly at DATAMAXIS →Create a free account for alerts like thisView DATAMAXIS immigration profile

This listing is sourced directly from DATAMAXIS's careers page and normalized into a canonical job model.