ShyftLabs
Data Engineer
Toronto, Ontario
Sponsorship not specified$100k-$140kDetected 111 days ago
PythonScalaSQLDatabricksAWSGCPAzureCloud PlatformsDockerKubernetesCI/CDDevOpsKafkaMachine LearningSparkData EngineeringData VisualizationProblem Solving
About the role
- Leverage Apache Spark for distributed data processing and real-time analytics.
- Monitor and troubleshoot Databricks clusters, jobs, and performance bottlenecks.
Responsibilities
- Design, implement, and optimize big data pipelines in Databricks.
- Develop scalable ETL workflows to process large datasets.
- Implement data governance, security policies, and compliance standards.
- Optimize data lakehouse architectures for performance and cost-efficiency.
- Collaborate with data scientists, analysts, and engineers to enable advanced AI/ML workflows.
- We're building something big, and we want you on the journey with us.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- 5+ years of hands-on experience with Databricks and Apache Spark.
- Proficiency in SQL, Python, or Scala for data processing and analysis.
- Experience with cloud platforms (AWS, Azure, or GCP) for data engineering.
- Strong knowledge of ETL frameworks, data lakes, and Delta Lake architecture.
- Experience with CI/CD tools and DevOps best practices.
- Familiarity with data security, compliance, and governance best practices.
- Strong problem-solving and analytical skills with an ability to work in a fast-paced environment.
- This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP).
Nice to have
- Databricks certifications (e.g., Databricks Certified Data Engineer, Spark Developer).
- Hands-on experience with MLflow, Feature Store, or Databricks SQL.
- Exposure to Kubernetes, Docker, and Terraform.
- Experience with streaming data architectures (Kafka, Kinesis, etc.).
- Strong understanding of business intelligence and reporting tools (Power BI, Tableau, Looker).
- Prior experience working with retail, e-commerce, or ad-tech data platforms.
- Why You'll Love Working at ShyftLabs
Compensation
- Why You'll Love Working at ShyftLabs
- Hybrid Flexibility: 3 days per week in our downtown Toronto office. This role is also open to candidates based out of the Calgary area.
- Inclusion at ShyftLabs
- We're building something big, and we want you on the journey with us. If you're ready to use data and innovation to make an impact, apply today and let's grow together.
- ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse, and inclusive environment.
Benefits
- 100% coverage for health, dental, and vision insurance for you and your dependents from day one.
- Growth & Learning: Continuous learning opportunities and influence over technical direction.
- We encourage applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, and nationality to apply.
Equal opportunity
- If you require accommodation during the interview process, let us know and we'll be happy to support you.
Apply directly at ShyftLabs →Create a free account for alerts like thisView ShyftLabs immigration profile
This listing is sourced directly from ShyftLabs's careers page and normalized into a canonical job model.