Factspan Inc
Senior Data Engineer
Atlanta, Georgia, USA · Senior · Full-time
Sponsorship not specifiedDetected 68 days ago
PythonSQLBigQueryGCPCloud PlatformsCI/CDDevOpsAirflowData EngineeringAgileSASCommunicationProblem Solving
About the role
- Participate in daily Agile ceremonies, sprint reviews, and deployment planning.
Responsibilities
- Design and develop data ingestion, transformation, and orchestration pipelines using Google Cloud Platform (BigQuery, Dataflow, Cloud Composer) and Airflow.
- Implement and maintain data integrations between AEP and data lake, ensuring high performance and scalability.
- Build and optimize ETL/ELT workflows to support campaign orchestration, preference logic, and audience segmentation.
- Implement data quality checks, monitoring, and exception handling frameworks to ensure clean and reliable data.
- Work closely with Lead DE and SME to translate campaign archetypes into data pipelines and orchestration rules.
- Support performance tuning, data reconciliation, and defect resolution during testing and hypercare phases.
- Collaborate with QA team for end-to-end test validation and ensure production readiness.
Requirements
- Required Technical Skills Strong hands-on experience in Google Cloud Platform services: BigQuery, Dataflow, GCS, Cloud Composer (Airflow).
Nice to have
- Google Cloud Platform certifications (e.g., Professional Data Engineer) preferred but not mandatory.
Skills
- BigQuery, Dataflow, GCS, Cloud Composer (Airflow).
- Proficiency in SQL for data profiling, transformation, and performance optimization.
- Proficiency in Python for pipeline automation, scripting, and orchestration.
- Experience building batch and streaming data pipelines.
- Exposure to working with marketing or customer engagement platforms is a plus.
- Understanding of data quality, logging, monitoring, and alerting best practices.
- Preferred Skills Experience in Airflow DAG development for complex data pipelines.
- Familiarity with MarTech platforms such as Adobe Experience Platform or similar ESPs.
- Knowledge of data modeling for campaign orchestration and audience segmentation.
- Experience with CI/CD and DevOps principles for data deployments.
- Strong troubleshooting and performance tuning skills.
- Soft Skills & Attributes Strong problem-solving skills and attention to detail.
Benefits
- Education Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
Apply directly at Factspan Inc →Create a free account for alerts like thisView Factspan Inc immigration profile
This listing is sourced directly from Factspan Inc's careers page and normalized into a canonical job model.