Bounteous

Bounteous

Principal Databricks Architect

United States · Principal

Sponsorship not specified$102k-$133kDetected 36 days ago
PythonScalaCode ReviewGitSQLSnowflakeDatabricksAWSGCPAzureCloud PlatformsTerraformCI/CDDevOpsKafkaMachine LearningSparkAirflowdbtData EngineeringData ScienceComplianceTest AutomationUnity

About the role

  • Our clients worldwide benefit from the skills and expertise of over 4,000+ expert team members across the Americas, APAC, and EMEA.
  • You will be a hands-on technical leader: writing production code, mentoring engineers, and shaping standards that the broader data organization will adopt.
  • We invite you to stay connected with us by subscribing to our monthly job openings alert here.

Responsibilities

  • Architect and lead the implementation of an enterprise lakehouse on Databricks (Delta Lake, Unity Catalog, Photon, Workflows) across one or more major clouds (AWS, Azure, or GCP).
  • Design scalable batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and Delta Live Tables; establish patterns for ingestion from operational systems, event streams, and third-party APIs.
  • Lead the governance strategy using Unity Catalog - fine-grained access control, data lineage, audit, and PII handling - in partnership with security and compliance.
  • Partner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving on Databricks.

Requirements

  • Experience with streaming architectures (Kafka, Kinesis, Event Hubs, Pub/Sub) and Structured Streaming at scale.
  • Experience with MLflow, feature stores, and ML model deployment patterns.
  • Familiarity with dbt, Airflow, or other orchestration/transformation tools alongside Databricks.
  • Experience migrating legacy data warehouses (Teradata, Netezza, on-prem Hadoop, Snowflake) to Databricks.
  • Experience operating under regulated frameworks (SOC 2, HIPAA, GDPR, PCI).
  • Comfort operating with ambiguity and shaping problems before solving them.

Nice to have

  • Mentor a team of data engineers
  • raise the bar on engineering practices.
  • Engage with stakeholders across analytics, product, and finance to translate business needs into a roadmap for the data platform.
  • Deep expertise in Apache Spark ( PySpark and Spark SQL) - including performance tuning, partitioning strategy, and the Catalyst/Photon execution model.
  • Strong hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.
  • Production experience on at least one major cloud (AWS, Azure, or GCP), including networking, IAM, storage (S3/ADLS/GCS), and compute primitives.
  • Proficiency in Python and SQL
  • comfort with Scala is a plus.

Compensation

  • $102k-$133k

Visa & Work Authorization

  • Bounteous is willing to sponsor eligible candidates for employment visas
Apply directly at Bounteous →Create a free account for alerts like thisView Bounteous immigration profile

This listing is sourced directly from Bounteous's careers page and normalized into a canonical job model.