S P Global Market Intelligence Inc.
Director, Data Integration & Workflows
New York, NY · Director
Sponsorship not specified$149k-$229kDetected 32 days ago
PythonScalaCode ReviewSQLAWSGCPAzureCloud PlatformsCI/CDDevOpsData EngineeringAI OrchestrationAgileResearchLeadershipCommunicationCollaborationProblem SolvingMentoring
About the role
- Reporting to the Director of Data AI & Enablement, this role is critical to the Data Platform enablement strategy, accelerating delivery, reducing production risk, and ensuring that every pipeline and workflow is scalable, observable, and maintainable.
- Establish reference architectures and engineering standards for ETL/ELT, orchestration, error handling, observability, and performance/cost optimization with clear "definition of done" criteria for production readiness
- Foster a culture of technical excellence, craftsmanship, reusable component development, and continuous improvement in automation maturity
Responsibilities
- Define and drive the data automation and transformation strategy for the Data Integration & Workflows group, setting standards and approaches for building production-ready pipelines and workflow automation across value streams
- Collaborate with the PPD Group to build sustainable, transformational enhancements to the data platform and associated tools
- Lead delivery through enablement by assessing SME technical capability and selecting the right engagement model
- Partner with value stream SMEs to co-develop and review pipelines, adapting support based on SME technical capability and fostering their growth
- Oversee the design and implementation of robust, reusable data integration and workflow patterns for both batch and streaming use cases
- Partner with PPD on feasibility and planning, providing realistic estimates, identifying dependencies, and shaping technical scope to ensure delivery commitments are achievable and measurable
- Partner with IT during QA to resolve issues quickly and ensure solutions meet enterprise standards for quality, security, and supportability
Requirements
- 10+ years of experience in data engineering, data integration, or related technical roles
- 5+ years of leadership experience managing technical teams and delivering complex data solutions
- Strong knowledge of both batch and streaming data processing technologies
- Experience with modern data platforms, cloud infrastructure (AWS, Azure, or GCP), and data engineering tools
- Proficiency in programming languages commonly used in data engineering (Python, SQL, Scala, etc.)
- Knowledge of DevOps practices, CI/CD pipelines, and infrastructure-as-code
- Familiarity with data governance principles and compliance frameworks
- Develop and implement training programs to enhance the technical proficiency of value stream SMEs in data engineering practices
Nice to have
- Experience across the breadth of index concepts and asset classes
- Familiarity with SPDJI products, methodologies, or index calculation processes
- Expertise in Python or SQL Development
- Experience with Agile/Scrum methodologies and product-oriented delivery models
- Knowledge of data lineage, metadata management, and data cataloging
- Right to Work Requirements:
- This role is limited to persons with indefinite right to work in the United States.
- This must be completed before we can proceed to an offer.
Skills
- Responsible for defining and enforcing the "definition of done" for production-ready data solutions
- What Success Looks Like
- Measurable improvement in technical skills of value stream SMEs through evaluations, certifications, and feedback
Compensation
- S&P Global states that the anticipated base salary range for this position is $149,031 to $228,996.
- In addition to base compensation, this role is eligible for an annual incentive plan.
Benefits
- This role is eligible to receive additional S&P Global benefits.
- Strategic Leadership & Technical Vision
Company info
- Advancing Essential Intelligence.
- We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective.
- The Director of Data Integration & Workflows leads the team that serves as the backbone of enablement at S&P Dow Jones Indices (SPDJI), responsible for building, templating, and standardizing the data pipelines and workflow patterns that power our index and analytical solutions.
Apply directly at S P Global Market Intelligence Inc. →Create a free account for alerts like thisView S P Global Market Intelligence Inc. immigration profile
This listing is sourced directly from S P Global Market Intelligence Inc.'s careers page and normalized into a canonical job model.