Cloudious LLC
Data Engineer (Ab Initio, OzoneCH, Flink)/ Ab Initio Consultant
Berkeley Heights, New Jersey, USA · full-time
Sponsorship not specified$110k-$110kDetected 63 days ago
PythonJavaScalaBashSQLDockerKubernetesCI/CDLinuxKafkaData EngineeringCommunicationProblem Solving
About the role
- Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee "exactly-once" processing.
- Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance.
- Monitor and troubleshoot performance issues in large-scale clusters.
Responsibilities
- Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.
- Implement event-driven data pipelines using Kafka, MQ, and file streams.
- Proactively monitor live production streams to ensure 24/7 reliability and troubleshooting data issues Develop ETL pipelines for batch and real-time data ingestion and transformation.
- Implement and ensure data validation, data security, integrity, and compliance across big data platforms.
- Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
Requirements
- Deep understanding of credit card process system Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta>Environment), Conduct>It, and Continuous Flows.
- Proficiency in Unix/Linux shell scripting, SQL, and database technologies (e.g., Oracle, Teradata).
- Familiarity with Linux/Unix environments and shell scripting.
- Experience with cloud-based big data platforms Exposure to containerization (Docker, Kubernetes) for big data workloads.
- Knowledge of CI/CD pipelines for data engineering projects.
- Bachelor's degree in computer science, Software Engineering, or a related field.
- Proficiency in business process modeling and documentation tools.
- Required Skills &
- Required Skills & Qualifications: Deep understanding of credit card process system Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta>Environment), Conduct>It, and Continuous Flows.
Nice to have
- Experience in Java, Scala, Python or Kafka is plus.
- Product implementation experience is preferred
Compensation
- $110k-$110k
Apply directly at Cloudious LLC →Create a free account for alerts like thisView Cloudious LLC immigration profile
This listing is sourced directly from Cloudious LLC's careers page and normalized into a canonical job model.