Insomniac Design
Senior Data Engineer
Washington, DC · Senior
Work authorization required$115k-$150kDetected 25 days ago
PythonDistributed SystemsCode ReviewSQLPostgreSQLMySQLBigQuerySnowflakeRedshiftDatabricksAWSGCPAzureCloud PlatformsCI/CDKafkaMachine LearningSparkAirflowdbtData AnalysisData EngineeringCybersecurityCompliance
> stay_score
odds of building a lasting career here
33Unrated
Cap-exempt (no lottery)0
Sponsors this role0
Entry-level history0
PERM / green-card track0
Lottery odds (Level III)83
Fits your clock70
No strong sponsorship signal in the public record yet. In the full product we resolve the exact legal entity and show its filing history with a confidence score — treat as unverified until then.
Lottery odds assume a STEM candidate.
Personalize to your clock →> community_outcomes
No reports yet — be the first to help the next applicant.
About the role
- We're an agile, determined and innovative team organized by functional areas of expertise - Creative, Technology, Strategy, and Management.
- We thrive on creative problem-solving, collaboration, and innovation.
- By thoughtfully integrating AI into our workflows, we're not only improving productivity but also ensuring our people have the tools to do their best work.
Responsibilities
- Architect and implement enterprise-grade data platforms, including data lakes, warehouses, and real-time pipelines.
- Lead performance optimization of databases, queries, and pipelines (e.g., partitioning, indexing, cost-efficient cloud solutions).
- Design and implement scalable data architecture that ensures high availability, security, and performance.
- Optimize database structures, schemas, indexing, and partitioning for efficient query performance.
- Implement CI/CD for data pipelines and automate infrastructure using Infrastructure-as-Code (IaC) tools.
- Architect and develop end-to-end ETL/ELT pipelines for structured and unstructured data ingestion, processing, and transformation.
- Automate and optimize data workflows using tools like Apache Spark, Kafka, Airflow, and dbt.
- Monitor, troubleshoot, and optimize data pipeline performance.
- Implement data governance policies, including metadata management, lineage tracking, and role-based access control (RBAC).
- Develop frameworks for data quality validation, anomaly detection, and integrity checks.
Nice to have
- Certifications in cloud/data technologies (e.g., AWS Certified Data Analytics, Google Cloud Data Engineer).
- Experience with ML pipelines (e.g., feature stores, model deployment).
- Contributions to open-source data projects.
Skills
- Expertise in SQL and relational database management systems (MySQL, PostgreSQL, Oracle).
- Proficiency in Python (or similar languages) for data processing and automation.
- Hands-on experience with big data tools:Apache Spark, Kafka, Airflow, dbt, Snowflake, Databricks
- Expertise in data modeling.
- Strong knowledge of data security, governance, and compliance frameworks.
- Proven track record of leading data projects, including migrations, warehousing, and real-time analytics.
- Strong problem-solving skills for debugging distributed systems and resolving data anomalies.
- Experience with Agile/Scrum methodologies, including tools like Jira, Git.
- Excellent communication and stakeholder management skills.
- Nice-to-Have (Bonus Skills):
Compensation
- $115,000 - $150,000.
Company info
- At Insomniac, we leverage AI to free our teams from routine tasks so they can focus on the aspects of our functions that are most valuable.
- We are not accepting applicants from recruiters or staffing agencies
Visa & Work Authorization
- Applicant Eligibility: Please note, candidates who are eligible to work in the US without visa sponsorship are eligible to apply.
Apply directly at Insomniac Design →Create a free account for alerts like thisView Insomniac Design immigration profile
This listing is sourced directly from Insomniac Design's careers page and normalized into a canonical job model.