ICS Global Soft, Inc.

ICS Global Soft, Inc.

Sr. AWS Data Engineer w/d SQL, Python Experience

Raleigh, North Carolina · Senior

Sponsorship not specifiedDetected 16 days ago
PythonJavaBashSpringSQLSnowflakeAWSCI/CDLinuxData EngineeringInventory Management

About the role

  • The ideal candidate will have strong hands-on experience in Collibra and Atacama.
  • The ideal candidate will have strong hands-on experience in data engineering, batch modernization, cloud-based data processing, SQL development, job scheduling, and enterprise data platform delivery.
  • Experience Level: 9+ years of relevant data engineering experience, preferably in financial services, investment management, banking, or other highly regulated enterprise environments.

Responsibilities

  • Develop, enhance, and maintain data pipelines and batch processing solutions using Java Spring Batch, Python, SQL, shell scripting, and AWS services.
  • Support integration between on-premises legacy systems and AWS-based target platforms, ensuring reliable data movement, synchronization, monitoring, and operational continuity.
  • Build and optimize data ingestion workflows to support the Rapid Data Ingestion platform, including file intake, validation, transformation, inventory tracking, and downstream consumption.
  • Implement data quality checks to detect changes in vendor file formats, data integrity issues, missing or incomplete data, and other anomalies that may impact critical business processes.
  • Enable and support data lineage capabilities by capturing source-to-target data movement, transformations, metadata, and audit-relevant processing details.
  • Support disaster recovery implementation for the Rapid Data Ingestion platform in AWS to improve resiliency and continuity for critical and audit-sensitive processes.
  • Develop and maintain job scheduling and orchestration processes using Control-M or equivalent scheduling tools.
  • Implement secure engineering practices, including application-specific database access, elimination of shared credentials, and enforcement of least-privilege access principles.
  • Perform performance tuning to ensure rewritten jobs meet or exceed current batch cycle expectations, including completion within strict operational SLAs.
  • Participate in data validation, reconciliation, defect triage, testing, production deployment, and warranty support activities.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, Engineering, Data Engineering, or a related field, or equivalent practical experience.

Nice to have

  • AWS certification, Snowflake certification, or relevant cloud/data engineering certification is preferred but not mandatory.

Skills

  • Strong experience with Java Spring Batch for batch job development, migration, and modernization.
  • Hands-on experience with AWS services, especially AWS Batch and Amazon S3.
  • Strong SQL development experience, including Oracle SQL and PL/SQL concepts.
  • Experience developing data engineering solutions using Python.
  • Strong shell scripting experience using Bash, KornShell, or similar Unix/Linux scripting languages.
  • Experience with Control-M or equivalent enterprise job scheduling and orchestration tools.
  • Experience working with legacy batch processing environments and modernizing on-premises batch workloads to cloud-based platforms.
  • Understanding of secure access patterns, credential management, least-privilege controls, and audit-focused data processing.
  • Experience with CI/CD, code deployment, version control, and standard software engineering practices.
  • Certifications: AWS certification, Snowflake certification, or relevant cloud/data engineering certification is preferred but not mandatory.
  • Expected Deliverables:

Company info

  • NMSDC Certified | Certified Minority Business Enterprise (MBE), SBE | An E-Verify company | Proud Member of Historically Underutilized Business (HUB)
  • According to Bill S.1618 Title III passed by the 105th US Congress, this message is not considered "Spam" as we have included the contact information.
  • If you wish to be removed from our mailing list, please respond with "remove" in the subject field.
  • We apologize for any inconvenience caused.

This listing is sourced directly from ICS Global Soft, Inc.'s careers page and normalized into a canonical job model.