ICS Global Soft, Inc.
Sr. AWS Data Engineer w/d SQL, Python Experience
Raleigh, North Carolina · Senior
Sponsorship not specifiedDetected 16 days ago
PythonJavaBashSpringSQLSnowflakeAWSCI/CDLinuxData EngineeringInventory Management
About the role
- The ideal candidate will have strong hands-on experience in Collibra and Atacama.
- The ideal candidate will have strong hands-on experience in data engineering, batch modernization, cloud-based data processing, SQL development, job scheduling, and enterprise data platform delivery.
- Experience Level: 9+ years of relevant data engineering experience, preferably in financial services, investment management, banking, or other highly regulated enterprise environments.
Responsibilities
- Develop, enhance, and maintain data pipelines and batch processing solutions using Java Spring Batch, Python, SQL, shell scripting, and AWS services.
- Support integration between on-premises legacy systems and AWS-based target platforms, ensuring reliable data movement, synchronization, monitoring, and operational continuity.
- Build and optimize data ingestion workflows to support the Rapid Data Ingestion platform, including file intake, validation, transformation, inventory tracking, and downstream consumption.
- Implement data quality checks to detect changes in vendor file formats, data integrity issues, missing or incomplete data, and other anomalies that may impact critical business processes.
- Enable and support data lineage capabilities by capturing source-to-target data movement, transformations, metadata, and audit-relevant processing details.
- Support disaster recovery implementation for the Rapid Data Ingestion platform in AWS to improve resiliency and continuity for critical and audit-sensitive processes.
- Develop and maintain job scheduling and orchestration processes using Control-M or equivalent scheduling tools.
- Implement secure engineering practices, including application-specific database access, elimination of shared credentials, and enforcement of least-privilege access principles.
- Perform performance tuning to ensure rewritten jobs meet or exceed current batch cycle expectations, including completion within strict operational SLAs.
- Participate in data validation, reconciliation, defect triage, testing, production deployment, and warranty support activities.
Requirements
- Bachelor's degree in Computer Science, Information Technology, Engineering, Data Engineering, or a related field, or equivalent practical experience.
Nice to have
- AWS certification, Snowflake certification, or relevant cloud/data engineering certification is preferred but not mandatory.
Skills
- Strong experience with Java Spring Batch for batch job development, migration, and modernization.
- Hands-on experience with AWS services, especially AWS Batch and Amazon S3.
- Strong SQL development experience, including Oracle SQL and PL/SQL concepts.
- Experience developing data engineering solutions using Python.
- Strong shell scripting experience using Bash, KornShell, or similar Unix/Linux scripting languages.
- Experience with Control-M or equivalent enterprise job scheduling and orchestration tools.
- Experience working with legacy batch processing environments and modernizing on-premises batch workloads to cloud-based platforms.
- Understanding of secure access patterns, credential management, least-privilege controls, and audit-focused data processing.
- Experience with CI/CD, code deployment, version control, and standard software engineering practices.
- Certifications: AWS certification, Snowflake certification, or relevant cloud/data engineering certification is preferred but not mandatory.
- Expected Deliverables:
Company info
- NMSDC Certified | Certified Minority Business Enterprise (MBE), SBE | An E-Verify company | Proud Member of Historically Underutilized Business (HUB)
- According to Bill S.1618 Title III passed by the 105th US Congress, this message is not considered "Spam" as we have included the contact information.
- If you wish to be removed from our mailing list, please respond with "remove" in the subject field.
- We apologize for any inconvenience caused.
Apply directly at ICS Global Soft, Inc. →Create a free account for alerts like thisView ICS Global Soft, Inc. immigration profile
This listing is sourced directly from ICS Global Soft, Inc.'s careers page and normalized into a canonical job model.