ICW Group
Data Engineer III
San Diego, CA · Mid
Sponsorship not specifiedDetected 30 days ago
PythonScalaData StructuresCode ReviewSQLNoSQLPostgreSQLDynamoDBSnowflakeRedshiftDatabricksAWSCloud PlatformsCI/CDKafkaMachine LearningSparkData EngineeringData ScienceEHR/EMRResearchCommunicationProblem SolvingTime Management
About the role
- Why settle for just a job when you can land a career?
- Learn more about why you want to be here!
- Data is central to ICW Group's business strategy and digital evolution, and the Data Engineer ensures optimal data delivery architecture is consistent throughout all projects.
Responsibilities
- Leads the design and build of scalable data pipelines and solutions (batch and/or streaming) that make the best use of traditional and cloud platforms (AWS or similar) by understanding the business, technology, and data landscape including real time data processing.
- Designs, supports and peer reviews the data models and schemas for new and existing data sources for the data warehouse.
- Conducts unit, integration, and system tests on our data sources to validate data against source systems, and continuously optimize performance to improve query speed and reduce cost.
- Leads data initiatives to ensure pipelines are reliable, efficient, testable, and maintainable.
- Drives the improvement of engineering team processes via data architecture, engineering, test, and operational excellence best practices.
- Collaborates in implementing components of data strategy - Master Data Management (MDM), data virtualization etc.
- Contributes to data governance and data quality best practices including design reviews, unit testing, code reviews, and continuous integration and deployment.
- Partners with Enterprise Architecture, Technology, and Project teams to ensure consistency of solutions approach while maintaining data governance requirements.
- Collaborates with the Enterprise Architecture team to drive tooling and standards to improve the productivity and quality of output for data engineers across the company.
Requirements
- Required to lift and carry relatively light materials.
- Ability to work additional hours, as required.
- Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'big data' technologies and tools.
- Maintains a strong understanding of the current landscape and proactively leads the analysis of the current environment to detect data deficiencies, gaps, and opportunities.
- Collaborates with data architects to ensure the output of the physical models meet required needs- e.g., collaborates on data definition, data structure, data content and data usage.
Nice to have
- Data architecture or data engineering related certification strongly desired.
- AWS Cloud Practitioner or more advanced AWS certification preferred.
- DAMA certifications preferred.
Skills
- Working knowledge of API or stream-based data extraction processes.
- Background in data modeling and performance tuning in relational and no-SQL databases.
- Experience with AWS technologies like Redshift, S3, EC2, Glue, EMR, Kinesis, Lambda, DynamoDB, etc.
- Experience with modern data architectures and modern data platforms like Snowflake, Databricks etc.
- Knowledge and experience with data movement tools - SSIS, Profisee, Alteryx, Informatica.
- Strong analytical and time management skills. Self-motivated and able to handle tasks with minimal supervision.
- Hadoop, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend etc.
- Strong verbal and written communication skills.
- This job operates in a professional office environment.
- While performing the duties of this job, the employee is regularly required to talk or hear.
- The employee frequently will sit, stand, walk, and bend during working hours.
- Requires manual and finger dexterity and eye-hand coordination.
Compensation
- If hired at ICW Group, your final base salary compensation will be determined by factors unique to each candidate, including experience, education and the location of the role and considers employees performing substantially similar work.
Benefits
- Requires normal or corrected vision and hearing corrected to a normal range.
- We offer a competitive benefits package, with generous medical, dental, and vision plans as well as 401K retirement plans and company match
- Bonus potential for all positions
Visa & Work Authorization
- We are currently not offering employment sponsorship for this opportunity.
Apply directly at ICW Group →Create a free account for alerts like thisView ICW Group immigration profile
This listing is sourced directly from ICW Group's careers page and normalized into a canonical job model.