Electronic Consulting Services, Inc (ECS Federal)
Senior Data Engineer
Arlington, Virginia, USA · Senior · full-time
Sponsorship not specifiedDetected 50 days ago
GitSQLPostgreSQLMySQLElasticsearchDockerKubernetesTerraformAnsibleCI/CDJenkinsData EngineeringData ScienceAgileTest AutomationManual Testing
About the role
- Define and enforce data quality, data validation, and data governance standards across legacy and modernized components.
Responsibilities
- Design and architect robust, scalable data models, schemas, indexes, and stored procedures in a relational database to support transactional workloads and complex business logic.
- Lead the migration of the system of record from Elasticsearch to a relational database, including data modeling, transformation, validation, and cutover strategies.
- Develop and maintain data pipelines and integration processes to keep the database and Elasticsearch aligned for search and analytics use cases.
- Implement and evolve scoring models, intelligence modifiers, and capability gap logic in the data layer to support mission-critical decision support.
- Optimize database performance, including indexing strategies, query tuning, and partitioning to support high-volume, low-latency operations.
- Collaborate with application engineers to integrate APIs and services with the underlying data models and stored procedures, ensuring seamless functionality and consistent data semantics.
- Integrate and operate CI/CD pipelines used for building, testing, and deploying data services and schema changes in cloud environments.
- Demonstrated experience designing and implementing data models and logic to support scoring models, rules engines, or similar decision-support systems.
Requirements
- Ability to pass a Public Trust investigation.
- Bachelor's degree in a related field.
- Minimum 15 years general work experience.
- 8+ years of experience as a Data Engineer or in a closely related role, with strong experience in legacy data system modernization.
- 5+ years of hands-on experience with relational databases including from-scratch schema design, index creation, stored procedures SQL development, performance tuning, and transaction management.
- 3+ years of experience working with Elasticsearch or OpenSearch, including index design, mappings, and data ingestion strategies.
- 5+ years of experience supporting applications in production, troubleshooting complex data issues in legacy environments, and proposing effective remediation strategies.
- Strong understanding of data modeling for OLTP/transactional systems, including normalization/denormalization tradeoffs and referential integrity.
- Desired Skills Experience re-architecting systems to move the system of record between data stores (e.g., Elasticsearch to database), including coexistence, synchronization, and phased cutovers.
- Familiarity with automated testing frameworks and tools for data validation, regression testing, and schema change verification.
Nice to have
- Tools necessary for excelling in this role include SQL (PostgreSQL or MySQL preferred), Elasticsearch/OpenSearch, data modeling and transformation frameworks, and DevSecOps practices in the Cloud.
- This role will focus heavily on modernizing legacy data architectures and re-architecting the application's data layer, shifting from Elasticsearch to PostgreSQL or MariaDB as the system of record for transactional data.
- You will play a critical role in evolving scoring models, intelligence modifiers, and capability gap logic while ensuring alignment and consistency between the new relational database and Elasticsearch.
- 5+ years of experience with relational databases and ORM technologies (e.g., JPA/Hibernate), experience with Elasticsearch or OpenSearch alignment patterns a plus.
Skills
- Docker, Kubernetes, Jenkins, Terraform, Ansible, OpenSearch, Elasticsearch, Gitlab.
- Familiarity working in Agile / SCRUM development environments.
Apply directly at Electronic Consulting Services, Inc (ECS Federal) →Create a free account for alerts like thisView Electronic Consulting Services, Inc (ECS Federal) immigration profile
This listing is sourced directly from Electronic Consulting Services, Inc (ECS Federal)'s careers page and normalized into a canonical job model.