Allied Consultants

Allied Consultants

Senior Data Engineer

Austin, Texas, USA · Senior · Contract

Sponsorship not specifiedDetected 68 days ago
PythonSQLSnowflakeDatabricksAzureCI/CDDevOpsMachine LearningData EngineeringData VisualizationAgile

About the role

  • Client is seeking a hands-on Senior Data Engineer with extensive experience (Hands on) in Azure data services and Databricks.
  • Ensure data solutions are scalable, reliable, and secure.
  • Follow PMO/Scrum master instructions using Agile/Scrum methodologies.

Responsibilities

  • Design and implement data solutions using Azure services (e.g., Synapse Analytics, Databricks, Snowflake, Azure SQL, Azure Blob Storage, ADLS Gen2, Azure Functions, Azure Key Vault, AI/ML).
  • Develop data pipelines and transformations (ETL/ELT).
  • Collaborate with stakeholders to understand data requirements and deliver solutions.
  • Implement CI/CD and DevOps practices.
  • Maintain and publish code to GitHub.

Requirements

  • 10+ years of: IT experience, including a minimum of 5 years as a Data Engineer.
  • 5+ years of: Experience with the Azure cloud platform.
  • Proven experience with Azure data services (e.g., Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions).
  • Experience with Databricks, Microsoft Fabric, Power Automate, Power BI and SQL.
  • Proficiency in Python, SQL, API, and PySpark.
  • Expertise in optimizing ETL processes, data warehouse, and data lake management.
  • Experience with CI/CD and DevOps practices.
  • Experience with structured, unstructured, and semi-structured data.
  • Experience with maintaining and publishing code to GitHub.
  • Ability to work in a cross-functional team and coordinate with Infra/Ops and Information Security departments.

Nice to have

  • Experience with on premises to Azure cloud migration.
  • Knowledge of Snowflake, Microsoft Fabric, Microsoft Purview, AI/ML, streaming data services, and marketplace data services.
  • Relevant certifications.
  • Experience with multiple cloud implementations.
  • Candidates selected for interview will be required to undergo criminal background checks and may be required to complete a drug screen in accordance with Federal and State Law.
  • Offers of Employment are contingent on a successful background check.
  • Allied Consultants is an equal opportunities employer.
  • Experience with requirement gathering and Scrum methodologies Preferred (Optional): Experience with on premises to Azure cloud migration.

Company info

  • Company Overview Allied Consultants has been contracted with the Texas State Government for 34 years, we are a Top Ten ranked vendor, and premier provider of technical and business staffing solutions.
Apply directly at Allied Consultants →Create a free account for alerts like thisView Allied Consultants immigration profile

This listing is sourced directly from Allied Consultants's careers page and normalized into a canonical job model.