Lorven Technologies Inc.
Data Engineer - New York, NY (Onsite) - Contract - Lorven Technologies Inc
New York, New York, USA · contract, third party
Sponsorship not specifiedDetected 42 days ago
PythonJavaScalaGitSQLNoSQLDynamoDBBigQuerySnowflakeRedshiftAWSGCPAzureCloud PlatformsDockerKubernetesCI/CDJenkinsDevOpsKafkaSparkdbtData EngineeringProject Management
About the role
- Job Title: Data Engineer Location: New York, NY (Onsite) Duration: Long Term Must Have Skills: Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL Cloud Platforms: AWS Data Warehousing & Analytics: Redshift or Snowflake or Big Query Data Integration & ETL: AWS Glue, Aws EMR, Spark, Data Bricks CI/CD: AWS Code Pipeline, Jenkins,
- CloudFormation, Docker, Kubernetes Job Description: Bachelor's degree in Computer science or equivalent, with minimum 12+ Years of relevant Experience. Extensive experience utilizing Google Cloud Platform (Google Cloud Platform) services, including BigQuery, Dataflow, Data prep, and Pub/Sub, for data engineering solutions. Proficient in building and
Requirements
- Bachelor's degree in Computer science or equivalent, with minimum 12+ Years of relevant Experience.
- Extensive experience utilizing Google Cloud Platform (Google Cloud Platform) services, including BigQuery, Dataflow, Data prep, and Pub/Sub, for data engineering solutions.
Skills
- Strong background in implementing security and compliance on Google Cloud Platform, ensuring data privacy and regulatory adherence.
- Track record of optimizing cost and resource usage within Google Cloud Platform environments.
- Skilled in AWS services such as Amazon EMR, Redshift, and Glue for efficient data processing.
- Expertise in architecting scalable, cost-effective solutions on AWS, with proficiency in configuring AWS Lambda for serverless computing.
- Adept at setting up AWS Kinesis streams to process real-time data, enhancing system responsiveness and data-driven decision-making.
- Experienced in integrating AWS services into CI/CD pipelines, streamlining automation for continuous integration, delivery, and deployment.
- Skilled in setting up and securing AWS Virtual Private Cloud (VPC) environments.
- Proficient in managing Azure virtual machines (VMs) for cloud infrastructure operations.
- Extensive experience managing on-premises data infrastructure, including data warehouses and databases.
- Familiar with AWS DevOps practices for continuous integration and deployment.
- Expertise in using Git for version control in DBT projects, ensuring proper tracking and documentation of data model changes.
- Skilled in performance optimization and tuning of on-premises data systems.
Apply directly at Lorven Technologies Inc. →Create a free account for alerts like thisView Lorven Technologies Inc. immigration profile
This listing is sourced directly from Lorven Technologies Inc.'s careers page and normalized into a canonical job model.