Next Gen Software Solutions LLC
Data Engineer - Spark, Hadoop, Flink |Contract W2
Berkeley Heights, New Jersey
Sponsorship not specified$0k-$0kDetected 14 days ago
PythonJavaScalaSQLDockerKubernetesCI/CDLinuxKafkaSparkData Engineering
About the role
- We specialize in delivering tailored IT consulting services, innovative software solutions, and connecting businesses with highly skilled IT professionals.
- Equal Employment Opportunity Statement: Next Gen Software Solutions is an Equal Opportunity Employer.
Responsibilities
- Design and implement distributed data processing solutions using Apache Spark, Hadoop, Flink
- Develop and maintain Spark applications for data transformation, aggregation, and ETL processes using Scala, Java, or Python
- Manage and optimize HDFS and Apache Ozone, Kafka for scalable and fault-tolerant storage.
- Develop ETL pipelines for batch and real-time data ingestion and transformation.
- Implement and ensure data validation, data security, integrity, and compliance across big data platforms.
- Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
Requirements
- Strong expertise in Apache Spark (Core, SQL, Streaming).
- Hands-on experience with Hadoop ecosystem (HDFS, YARN, MapReduce).
- Proficiency in Apache Ozone for object storage and integration with Hadoop.
- Knowledge of cluster management and resource optimization.
- Familiarity with Linux/Unix environments and shell scripting.
- Experience with cloud-based big data platforms
- Knowledge of CI/CD pipelines for data engineering projects.
- Bachelor's degree in computer science, Software Engineering, or a related field.
- Proficiency in business process modeling and documentation tools.
Nice to have
- Experience with Hive, HBase, and Kafka is a plus.
- Product implementation experience is preferred
Compensation
- $0k-$0k
Company info
- Next Gen Software Solutions is a trusted provider of IT Staffing and consulting services dedicated to empowering businesses with cutting-edge technology solutions and exceptional talent.
- Founded and led by a dedicated U.S. Army solider, Next Gen Software Solutions is deeply rooted in the core values of integrity, discipline, commitment, and experience-principles that guide every aspect of our operations.
- Next Gen Software Solutions is an Equal Opportunity Employer.
- We are committed to fostering an inclusive and diverse workplace where all employees and applicants are treated respect and dignity.
- We do not discriminate based on race, colour, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, genetic information, veteran status, or any other legally protected characteristic under applicable federal, state, or local laws.
- We are seeking a highly skilled Big Data Engineer with strong experience in Apache Spark, Hadoop ecosystem, and Apache Ozone.
Apply directly at Next Gen Software Solutions LLC →Create a free account for alerts like thisView Next Gen Software Solutions LLC immigration profile
This listing is sourced directly from Next Gen Software Solutions LLC's careers page and normalized into a canonical job model.