Tata Consultancy Services

Tata Consultancy Services

Data Platform Engineering Lead

Irvine, CA

Sponsorship not specified$110k-$140kDetected 8 days ago
PythonGitDatabricksAWSAzureDockerKubernetesTerraformCI/CDGitHub ActionsJenkinsDevOpsSite Reliability EngineeringPlatform EngineeringAirflowdbtComplianceUnity

About the role

  • Data Bricks, EBT,Airflow, Asset Management exp
  • We are seeking a highly skilled EDO Platform Engineering Lead to architect, build, and manage enterprise-scale cloud-native data platforms supporting Asset Management business functions. The role will lead platform engineering,

Responsibilities

  • Lead the design, implementation, and management of enterprise data platforms.
  • Drive cloud-native modernization initiatives across data and analytics ecosystems.
  • Own platform lifecycle management, scalability, availability, and reliability.
  • Lead enterprise-wide Databricks platform architecture and administration.
  • Design and implement Lakehouse architecture leveraging Delta Lake.
  • Manage: Databricks Workflows,Delta Live Tables (DLT),Unity Catalog,
  • Build governance controls across development, test, and production environments

Requirements

  • The ideal candidate will have deep expertise in Databricks, dbt, AWS Cloud, Terraform, Python, DevOps, Platform Engineering, and Data Operations, with strong experience supporting investment management organizations.

Skills

  • Agile | Data Integration
  • Optimize platform performance and cost efficiency.
  • Lead cloud engineering activities using AWS services:S3,ECS,EKS,Lamda.Glue,Cloudwatch
  • Infrastructure as a Code (IaC)
  • Build reusable Terraform modules.
  • Automate environment provisioning.
  • Implement infrastructure standardization and governance.
  • Maintain infrastructure version control.
  • Ensure compliance through Infrastructure-as-Code practices.
  • Design and implement CI/CD pipelines.
  • Automate deployment and release management processes.
  • Enable Infrastructure-as-Code and GitOps methodologies.

Compensation

  • $110,000-$140,000 a year

This listing is sourced directly from Tata Consultancy Services's careers page and normalized into a canonical job model.