Bounteous

Bounteous

Principal Databricks Architect

Canada · Principal

Sponsorship not specifiedCAD 115k-CAD 150kDetected 32 days ago
PythonScalaCode ReviewGitSQLSnowflakeDatabricksAWSGCPAzureCloud PlatformsTerraformCI/CDDevOpsKafkaMachine LearningSparkAirflowdbtData EngineeringData ScienceComplianceAccessibilityTest Automation

About the role

  • Our clients worldwide benefit from the skills and expertise of over 4,000+ expert team members across the Americas, APAC, and EMEA.
  • You will be a hands-on technical leader: writing production code, mentoring engineers, and shaping standards that the broader data organization will adopt.

Responsibilities

  • Architect and lead the implementation of an enterprise lakehouse on Databricks (Delta Lake, Unity Catalog, Photon, Workflows) across one or more major clouds (AWS, Azure, or GCP).
  • Design scalable batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and Delta Live Tables; establish patterns for ingestion from operational systems, event streams, and third-party APIs.
  • Lead the governance strategy using Unity Catalog - fine-grained access control, data lineage, audit, and PII handling - in partnership with security and compliance.
  • Partner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving on Databricks.

Requirements

  • Deep expertise in Apache Spark ( PySpark and Spark SQL) - including performance tuning, partitioning strategy, and the Catalyst/Photon execution model.
  • Strong hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.
  • Production experience on at least one major cloud (AWS, Azure, or GCP), including networking, IAM, storage (S3/ADLS/GCS), and compute primitives.
  • Proficiency in Python and SQL
  • Experience designing medallion (bronze/silver/gold) architectures and dimensional models for analytics.

Nice to have

  • Experience with streaming architectures (Kafka, Kinesis, Event Hubs, Pub/Sub) and Structured Streaming at scale.
  • Experience with MLflow, feature stores, and ML model deployment patterns.
  • Familiarity with dbt, Airflow, or other orchestration/transformation tools alongside Databricks.
  • Experience migrating legacy data warehouses (Teradata, Netezza, on-prem Hadoop, Snowflake) to Databricks.
  • Experience operating under regulated frameworks (SOC 2, HIPAA, GDPR, PCI).
  • What You'll Bring
  • An architect's instinct for trade-offs - balancing speed, cost, complexity, and long-term maintainability.
  • Comfort operating with ambiguity and shaping problems before solving them.

Skills

  • Track record of leading technical projects end-to-end and mentoring engineers.

Compensation

  • CAD 115k-CAD 150k

Visa & Work Authorization

  • Bounteous is willing to sponsor eligible candidates for employment visas
Apply directly at Bounteous →Create a free account for alerts like thisView Bounteous immigration profile

This listing is sourced directly from Bounteous's careers page and normalized into a canonical job model.