Guidehouse
Data Engineer - Managing Consultant
McLean, Virginia
No sponsorshipDetected 26 days ago
PythonGitSQLDatabricksAWSTerraformCI/CDGitHub ActionsPlatform EngineeringKafkaData EngineeringUnityCommunication
About the role
- All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or guidehouse@myworkday.com.
- Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse.
- Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event.
Responsibilities
- Design, build, and optimize scalable, production-grade data ingestion, transformation, and analytics-ready pipelines using Databricks (Delta Lake, Delta Live Tables, Auto Loader) and AWS services, enabling trusted, timely data access across enterprise use cases.
- Execute full delivery lifecycle by supporting intake, discovery, source profiling, and technical design, while maintaining requirements traceability and aligning solutions to Architecture Review Board (ARB) and governance expectations.
- Implement and maintain governed data pipelines with embedded metadata, lineage, and data quality controls, ensuring pipelines meet defined technical, security, and documentation requirements before production deployment.
- Develop and operationalize data engineering frameworks that incorporate observability, monitoring, alerting, and resilient error handling to maintain platform stability and support ≥99.9% availability targets.
- Partner with platform engineering and cloud operations teams to integrate pipelines with AWS services (S3, Glue, Kafka/Kinesis, APIs), enabling secure, scalable data movement and cross-platform interoperability.
- Apply security and compliance controls aligned to IRS cybersecurity policies, including RBAC/ABAC, data masking, encryption, and audit logging to protect sensitive data and maintain regulatory compliance.
- Demonstrated experience building and optimizing data pipelines leveraging Delta Lake, medallion architecture, and modern data ingestion frameworks (batch and streaming).
Requirements
- Clearance Required
- Ability to Obtain Public Trust
- Bachelor's degree is required
- Minimum EIGHT (8) years of experience in data engineering within cloud-based environments,
- Advanced proficiency in Python, PySpark, and SQL for large-scale data processing and pipeline development in lakehouse architectures.
- Strong experience with AWS data platforms and services (e.g., S3, IAM, VPC, Glue, streaming frameworks) and integration with enterprise data ecosystems.
- Hands-on experience with Databricks Unity Catalog, Delta Sharing, Genie, and Clean Rooms for governed data access and collaboration.
- Experience with performance optimization techniques (Photon, Z-ordering, liquid clustering) to improve large-scale data workloads.
Nice to have
- What Would Be Nice To Have
Benefits
- Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.
- Benefits Include
- Medical, Rx, Dental & Vision Insurance
- Position may be eligible for a discretionary variable incentive bonus
- Parental Leave and Adoption Assistance
- 401(k) Retirement Plan
- Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
- Short-Term & Long-Term Disability
- Tuition Reimbursement, Personal Development & Learning Opportunities
- Mobility Stipend
Equal opportunity
- Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.
Apply directly at Guidehouse →Create a free account for alerts like thisView Guidehouse immigration profile
This listing is sourced directly from Guidehouse's careers page and normalized into a canonical job model.