Costar
Databricks Platform & Database Engineer
US-VA Arlington · Full-time
Work authorization required$136k-$177kDetected 13 hours ago
PythonSQLNoSQLPostgreSQLMySQLMongoDBDynamoDBSnowflakeDatabricksAWSTerraformCI/CDDevOpsRESTKafkaMachine LearningTensorFlowPyTorchscikit-learnSparkData VisualizationLLMsCybersecurityPipeline Management
> stay_score
odds of building a lasting career here
33Unrated
Cap-exempt (no lottery)0
Sponsors this role0
Entry-level history0
PERM / green-card track0
Lottery odds (Level III)83
Fits your clock70
No strong sponsorship signal in the public record yet. In the full product we resolve the exact legal entity and show its filing history with a confidence score — treat as unverified until then.
Lottery odds assume a STEM candidate.
Personalize to your clock →> community_outcomes
No reports yet — be the first to help the next applicant.
About the role
- By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.
- Successful candidates will demonstrate a willingness to learn, adopt, and apply AI technologies responsibly to solve complex business and engineering challenges.
- This position is located in Arlington, VA and is in office Monday through Thursday with work from home on Friday.
Responsibilities
- Deploy, administer, and maintain Databricks workspaces on AWS, including workspace configuration, network settings, access management, Runtime versions, cluster configurations, libraries, and init scripts across dev, staging, and production
- Lead platform upgrades, workspace migrations, and full environment lifecycle management
- Monitor, optimize and right‑sizing clusters, SQL warehouses, and job compute for performance and cost
- Support data ingestion from relational and non-relational sources into Databricks via AWS, DMS or native Lakeflow ingestion services
- Lead the design and implementation of end-to-end data workflows, covering the reliable distribution of curated data to downstream systems including SQL Server, DynamoDB, S3, and other enterprise data consumers.
- Design, implement, and administer relational and non-relational databases such as SQL Server, Aurora, PostgreSQL, MySQL, and DynamoDB across AWS (RDS/Aurora) and on-premises data centers
- Manage provisioning, patching, backups, replication, failover, version upgrades, and cross-platform migrations between cloud and on-premises environments
- Develop IaC solutions using Terraform for Databricks workspaces, AWS RDS, Aurora, and supporting resources
- Build and maintain CI/CD workflows for platform configuration and pipeline code
- Implement proactive monitoring and alerting across Databricks jobs, pipelines, clusters, SQL warehouses, and all database instances
Requirements
- Bachelor's Degree required from an accredited, not for profit, in person, university or college.
- A track record of commitment to prior employers.
- Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures.
- 5+ years of experience in database engineering or data platform roles, across both relational/non-relational database administration and Databricks platform ownership
- Proven, hands-on experience administering enterprise Databricks environments
- Ability to retrieve, synthesize, and present critical data in structures that is immediately useful to answering specific ad-hoc questions
- Knowledge of data governance and compliance best practices.
- Deep expertise in Databricks platform administration: Unity Catalog, workspace security, cluster management, and Auto Loader on AWS
- Infrastructure-as-Code experience with Terraform
Nice to have
- Experience with FinOps / cloud cost optimization
- Experience implementing access controls, data privacy protections, and monitoring for AI workloads.
- Understanding of Lakehouse AI architecture and how ML pipelines integrate with Unity Catalog and Delta Lake
Skills
- Advanced SQL and proficiency in PySpark and Python
- Infrastructure-as-Code experience with Terraform; CI/CD pipeline management
- Experience with cost optimization initiatives.
- Experience supporting 24/7 operational environments
- Experience with data governance frameworks, compliance practices, and cloud cost optimization
- Working knowledge of Data Visualization tools like Looker and PowerBI
- Working knowledge of non-relational databases: DynamoDB, MongoDB, or equivalent NoSQL platforms
- Familiarity with AI governance frameworks, model lineage, auditability, and compliance
- requirements for ML systems
- Experience with kafka or other real-time streaming platforms, Postgres/RDBMS
- Experience with Snowflake Administration
- Experience working with and managing large consumer datasets to derive insights
Compensation
- $136,000 - $177,000 annually.
Company info
- We've continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors.
- We are looking for a Databricks Platform & Database Engineer with hands-on experience in enterprise Databricks environments on AWS and traditional database engineering spanning relational and non-relational systems.
Visa & Work Authorization
- However, please note that CoStar Group is not able to provide visa sponsorship for this position.
This listing is sourced directly from Costar's careers page and normalized into a canonical job model.