Autodesk
Senior Data Engineer
Toronto, ON, CAN · Senior
Stay score
odds of building a lasting career here
Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Green-card filing pattern in this occupation
Green-card follow-through: 86%
Reported a layoff in this occupation
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Autodesk is looking for a skilled and innovative Senior Data Engineer to join our Compliance team, which builds data-driven systems to detect and address non-compliant usage of Autodesk software. This is a key strategic initiative that leverages large-scale data processing and analytics to drive business impact.
- In this role, you will design, build, and optimize scalable data pipelines and distributed processing systems that handle billions of records. You will focus on improving platform reliability, performance, scalability, and operational efficiency while enabling business-critical analytics.
Responsibilities
- Evaluate and validate AI-generated solutions for correctness, performance, maintainability, and security while following responsible AI practices
- Design, develop, and optimize large-scale batch and near-real-time data processing pipelines using Apache Spark, PySpark, and Spark SQL
- Build scalable and efficient ETL/ELT pipelines capable of processing billions of records across distributed data platforms
- Optimize distributed processing workloads through partitioning, efficient joins, query tuning, resource management, and performance analysis
- Develop and maintain data processing solutions using technologies such as Hive, Snowflake, AWS S3, EMR, and Glue
- Build and maintain production-grade data workflows using Apache Airflow, including DAG development, scheduling, dependency management, retries, and failure recovery
- Implement data quality checks, pipeline monitoring, observability, and alerting to ensure reliable data processing
- Design reusable, modular, and fault-tolerant pipelines supporting incremental processing, backfills, and operational scalability
- Develop and maintain scalable, cloud-native data infrastructure on AWS
- Implement automated testing, version control, code reviews, and software engineering best practices
Requirements
- 3+ years of hands-on experience with Apache Spark, including PySpark, Spark SQL, and DataFrame APIs
- 3+ years of strong programming experience in Python and SQL, with demonstrated ability to write clean, modular, maintainable, and testable code
- Strong understanding of distributed computing fundamentals, including parallel processing, partitioning, shuffling, data skew, fault tolerance, and Spark performance tuning
- Hands-on experience with Apache Airflow for building, scheduling, and orchestrating complex data pipelines
- Practical experience using AI-powered coding tools such as GitHub Copilot, Cursor, ChatGPT, Claude, or equivalent solutions in day-to-day software or data engineering development
- Ability to effectively use AI tools for code generation, debugging, refactoring, testing, and accelerating engineering problem-solving
- Experience with AWS data services such as S3, EMR, Glue, or equivalent cloud-based data processing platforms
- Working knowledge of analytical data platforms such as Snowflake, Hive, or Presto/Trino
- Experience with Git, CI/CD pipelines, and automation tools such as Jenkins
- Familiarity with data quality frameworks, pipeline observability, production monitoring, and troubleshooting
Nice to have
- Experience with modern data lake or lakehouse architectures, including Apache Iceberg, Delta Lake, or Apache Hudi
- Familiarity with streaming data processing technologies such as Apache Kafka or Spark Structured Streaming
- Experience with Infrastructure as Code tools such as Terraform or AWS CloudFormation
- Familiarity with LLM APIs, AI agents, or AI-powered workflow automation applied to software or data engineering
- Experience with BI and analytics platforms such as Power BI or Looker
- Demonstrated experience improving engineering efficiency, pipeline performance, or cloud infrastructure costs through automation and optimization
- Welcome to Autodesk!
- Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies.
Skills
- Job Requisition ID #
- Position Overview
- Our technology stack includes:
Compensation
- Salary transparency
Company info
- We take great pride in our culture here at Autodesk - it's at the core of everything we do.
This listing is sourced directly from Autodesk's careers page and normalized into a canonical job model.