Concentrix
Databricks Engineer
USA, TX, Work-at-Home · Senior · Full-time
Sponsorship not specified$92k-$120kDetected 10 days ago
PythonCode ReviewGitSQLDatabricksAWSAzureCI/CDPandasSparkData EngineeringComplianceUnityHIPAAHL7/FHIREHR/EMRResearch
Stay score
odds of building a lasting career here
43Risky
Cap-exempt (no lottery)0
Sponsors this role65
Entry-level history0
PERM / green-card track0
Lottery odds (Level II)66
Fits your clock70
Thin sponsorship signal and lottery-bound (~30% per draw). A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- The global technology and services leader that powers the world's best brands, today and into the future.
- We're solution-focused, tech-powered, intelligence-fueled.
- We shape new game-changing careers in over 70 countries, attracting the best talent.
Responsibilities
- Build and maintain batch and streaming data pipelines for extracting, transforming, and loading (ETL/ELT) data from multiple sources into the Databricks lakehouse on Azure.
- Implement data ingestion using Auto Loader, Lakeflow Connect, and Azure Data Factory.
- Develop pipelines with Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables), including data quality expectations.
- Perform data manipulation and transformation using PySpark and Spark SQL, ensuring data is prepared for analytics and reporting.
- Implement data models within the lakehouse following medallion architecture (bronze/silver/gold) and team modeling standards.
- Apply Unity Catalog permissions and governance standards to the data assets you build.
- Collaborate with cross-functional teams, including business stakeholders and IT, to ensure data solutions meet business and performance requirements aligned to project goals.
Requirements
- 6+ years of professional experience in data engineering, data & analytics or data warehousing.
- 3+ years of hands-on experience working with Databricks in a data engineering capacity.
- 3+ years of experience with Python, including manipulating large datasets using PySpark DataFrames, Spark SQL, and/or the pandas API on Spark.
- 2+ years of data engineering experience on Microsoft Azure (e.g., ADLS Gen2, Azure Data Factory, Key Vault).
- Bachelor's degree in computer science, Information Systems, Data Engineering, or a closely related field, or equivalent professional experience.
- The employee is regularly required to operate a computer, keyboard, telephone/headset, and/or other office equipment as essential functions of this position.
- As part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role.
Nice to have
- Experience implementing streaming data ingestion in Databricks (Structured Streaming, Auto Loader, Event Hubs).
- Exposure to Spark and Delta Lake performance tuning and compute cost optimization.
- Familiarity with dimensional modeling and SCD Type 1 and Type 2 patterns.
- Experience enabling BI consumption through Databricks SQL warehouses and tools such as Power BI.
- We accept applications for this position on an ongoing basis.
- It is currently for an existing, immediate vacancy
- We encourage all interested candidates to apply.
- Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law.
Skills
- Proficiency in Python programming for data engineering tasks.
- Strong knowledge of SQL for data modeling, transformation, and querying.
- Working knowledge of Delta Lake fundamentals (e.g., MERGE, schema evolution, time travel).
- Working knowledge of Unity Catalog concepts, including catalogs, schemas, and permissions.
- Experience with Git-based version control and familiarity with CI/CD practices for data pipelines.
- Understanding of testing and deployment strategies for data pipelines, including productionizing ETL pipelines and Databricks SQL queries.
Compensation
- The base salary for this position is $92,250 to $120,000 plus incentives that align with individual and company performance.
Benefits
- available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.
Company info
- Join us and be part of this journey towards greater opportunities and brighter futures.
- It is currently for an existing, immediate vacancy; however, we are also considering applications for future opportunities as they arise.
- Artificial Intelligence: As part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants.
- And we're proud to be recognized with awards such as "World's Best Workplaces," "Best Companies for Career Growth," and "Best Company Culture," year after year.
Equal opportunity
- Concentrix is an equal opportunity and affirmative action (EEO-AA) employer.
- We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law.
- For more information regarding your EEO rights as an applicant, please visit the following websites:
- Accommodation:
Visa & Work Authorization
- In accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position.
Apply directly at Concentrix →Create a free account for alerts like thisView Concentrix immigration profile
This listing is sourced directly from Concentrix's careers page and normalized into a canonical job model.