S P Global Market Intelligence Inc.

S P Global Market Intelligence Inc.

Director, Data Integration & Workflows

New York, NY · Director

Sponsorship not specified$149k-$229kDetected 32 days ago
PythonScalaCode ReviewSQLAWSGCPAzureCloud PlatformsCI/CDDevOpsData EngineeringAI OrchestrationAgileResearchLeadershipCommunicationCollaborationProblem SolvingMentoring

About the role

  • Reporting to the Director of Data AI & Enablement, this role is critical to the Data Platform enablement strategy, accelerating delivery, reducing production risk, and ensuring that every pipeline and workflow is scalable, observable, and maintainable.
  • Establish reference architectures and engineering standards for ETL/ELT, orchestration, error handling, observability, and performance/cost optimization with clear "definition of done" criteria for production readiness
  • Foster a culture of technical excellence, craftsmanship, reusable component development, and continuous improvement in automation maturity

Responsibilities

  • Define and drive the data automation and transformation strategy for the Data Integration & Workflows group, setting standards and approaches for building production-ready pipelines and workflow automation across value streams
  • Collaborate with the PPD Group to build sustainable, transformational enhancements to the data platform and associated tools
  • Lead delivery through enablement by assessing SME technical capability and selecting the right engagement model
  • Partner with value stream SMEs to co-develop and review pipelines, adapting support based on SME technical capability and fostering their growth
  • Oversee the design and implementation of robust, reusable data integration and workflow patterns for both batch and streaming use cases
  • Partner with PPD on feasibility and planning, providing realistic estimates, identifying dependencies, and shaping technical scope to ensure delivery commitments are achievable and measurable
  • Partner with IT during QA to resolve issues quickly and ensure solutions meet enterprise standards for quality, security, and supportability

Requirements

  • 10+ years of experience in data engineering, data integration, or related technical roles
  • 5+ years of leadership experience managing technical teams and delivering complex data solutions
  • Strong knowledge of both batch and streaming data processing technologies
  • Experience with modern data platforms, cloud infrastructure (AWS, Azure, or GCP), and data engineering tools
  • Proficiency in programming languages commonly used in data engineering (Python, SQL, Scala, etc.)
  • Knowledge of DevOps practices, CI/CD pipelines, and infrastructure-as-code
  • Familiarity with data governance principles and compliance frameworks
  • Develop and implement training programs to enhance the technical proficiency of value stream SMEs in data engineering practices

Nice to have

  • Experience across the breadth of index concepts and asset classes
  • Familiarity with SPDJI products, methodologies, or index calculation processes
  • Expertise in Python or SQL Development
  • Experience with Agile/Scrum methodologies and product-oriented delivery models
  • Knowledge of data lineage, metadata management, and data cataloging
  • Right to Work Requirements:
  • This role is limited to persons with indefinite right to work in the United States.
  • This must be completed before we can proceed to an offer.

Skills

  • Responsible for defining and enforcing the "definition of done" for production-ready data solutions
  • What Success Looks Like
  • Measurable improvement in technical skills of value stream SMEs through evaluations, certifications, and feedback

Compensation

  • S&P Global states that the anticipated base salary range for this position is $149,031 to $228,996.
  • In addition to base compensation, this role is eligible for an annual incentive plan.

Benefits

  • This role is eligible to receive additional S&P Global benefits.
  • Strategic Leadership & Technical Vision

Company info

  • Advancing Essential Intelligence.
  • We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective.
  • The Director of Data Integration & Workflows leads the team that serves as the backbone of enablement at S&P Dow Jones Indices (SPDJI), responsible for building, templating, and standardizing the data pipelines and workflow patterns that power our index and analytical solutions.

This listing is sourced directly from S P Global Market Intelligence Inc.'s careers page and normalized into a canonical job model.