Citigroup

Citigroup

Big Data/PySpark Engineering Lead - Vice President

Tampa Florida United States, USA · Exec · Full-time

Sponsorship not specified$114k-$171kDetected 1 day ago
PythonData StructuresAlgorithmsCode ReviewGitSQLNoSQLMongoDBCI/CDLinuxDevOpsKafkaSparkData EngineeringProject ManagementTest AutomationLeadershipCommunicationMentoringHadoopBitbucket

About the role

  • Leadership & Strategy - Provide technical mentorship and conduct code reviews for junior and mid-level engineers.
  • Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays.
  • Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.

Responsibilities

  • Architecture & Design
  • Design and implement scalable, fault-tolerant batch and real-time data processing pipelines.
  • Develop robust data models and schema designs optimized for both performance and storage efficiency.
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Legacy Systems Decommissioning: Lead the strategic migration of data and logic from legacy platforms (e.g. on-premises SQL Servers) to a modern Data Lakehouse environment.
  • Validation & Parity Testing: Design and implement automated frameworks for Data Parity Testing to ensure 100% accuracy and consistency between legacy outputs and new big data results.
  • Optimize complex SQL queries and fine-tune distributed computing clusters to reduce latency and costs.
  • Build and maintain CI/CD pipelines for automated testing and deployment of data jobs.
  • Collaborate with Product Managers to ensure data availability for downstream analytics, business models and users

Requirements

  • 6+ years of relevant experience in the Financial Service industry
  • Experience as Applications Development Manager
  • Experience as senior level in an Applications Development role
  • Experience in Data Engineering, focused on Big Data ecosystems.
  • Knowledge in Hadoop, YARN, Hive, Impala, Spark, and Spark SQL with extensive high volume of data processing pipeline development.
  • Programming Expert level and hand on experience in Python.
  • Familiarity with data formats like Avro, Parquet, CSV, JSON.
  • Hands-on experience in writing SQL queries.
  • Experience with source code management tools such as Bitbucket, Git etc.
  • Big Data Tech Proficiency and hands-on in Hadoop, Spark, Hive, Kafka, and NoSQL databases (MongoDB, HBase).
  • Knowledge in Hadoop, YARN, Hive, Impala, Spark, and Spark SQL with extensive high volume of data processing pipeline development. Programming Expert level and hand on experience in Python.
  • Highly experienced with Unix based operating systems and shell scripting.
  • Strong computer science fundamentals in data structures, algorithms, databases, and operating systems.
  • Reverse Engineering, ability to read "spaghetti" SQL or old scripts and document the business logic before moving it.
  • Data Lineage, Experience using tools (like Collibra or Informatica) to track where data comes from and where it's going.

Nice to have

  • Bachelor's degree/University degree or equivalent experience
  • Master's degree preferred

Skills

  • Jul 27, 2026 ------------------------------------------------------
  • Automated Processing and AI
  • Our automated processing and AI do not involve relying on automatic or autonomous decision-making.
  • Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.
  • Illinois residents - AI Notice and Right

Compensation

  • $113,840.00 - $170,760.00
  • In addition to salary, Citi's offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards.

Benefits

  • Monitor system health and troubleshoot performance bottlenecks across the data lifecycle.

Equal opportunity

  • View Citi's EEO Policy Statement and the Know Your Rights poster.
Apply directly at Citigroup →Create a free account for alerts like thisView Citigroup immigration profile

This listing is sourced directly from Citigroup's careers page and normalized into a canonical job model.