Schonfeld
AI Data Engineer
New York, New York, United States
Sponsorship not specifiedDetected 16 days ago
PythonJavaGoRustScalaSQLNoSQLPostgreSQLMySQLMongoDBElasticsearchDynamoDBRedshiftVector DatabasesAWSGCPCloud PlatformsDockerKubernetesKafkaMachine LearningSparkAirflowData Engineering
About the role
- Schonfeld Strategic Advisors is seeking an experienced AI Data Engineer to join our Data Engineering team.
- Ensure data quality, consistency, and integrity across all pipelines.
- Integrate with existing firm systems including risk platforms, trading systems, portfolio management tools, and research databases.
Responsibilities
- Design and build scalable, reliable data pipelines to ingest, transform, and deliver structured and unstructured data to SchonAI using Prefect.
- Develop ETL/ELT processes for diverse data sources including market data, research documents, internal databases, and third-party APIs.
- Implement real-time and batch data processing workflows to meet varying latency requirements.
- Build and maintain data infrastructure optimized for AI/ML workloads, including vector databases and semantic search systems.
- Design data schemas and storage solutions that support efficient retrieval and processing for LLM applications.
- Implement data versioning, lineage tracking, and observability for AI training and inference pipelines.
- Optimize data delivery for low-latency AI interactions and high-throughput batch processing.
- Partner with AI engineers, software developers, and data scientists to understand data requirements.
- Collaborate with infrastructure teams on cloud architecture, security, and compliance requirements.
- Experience building data pipelines for LLM applications or RAG (Retrieval Augmented Generation) systems
Requirements
- Programming: Strong proficiency in Python
- experience with SQL and at least one other language (e.g. Java, Scala, Go, Rust)
- Data Engineering: 5+ years of experience building production data pipelines using tools like Apache Airflow, Prefect, Dagster, or similar
- Big Data Technologies: Hands-on experience with distributed computing frameworks (Spark, Flink) and modern data platforms
- AI/ML Data: Understanding of data requirements for ML/AI systems, including experience with vector databases (Pinecone, Weaviate, Qdrant) and embedding pipelines
- Strong proficiency in Python
Skills
- Hands-on experience with distributed computing frameworks (Spark, Flink) and modern data platforms
- Cloud Platforms: Proficiency with AWS services (S3, Kubernetes) or equivalent GCP services
- Databases: Experience with both SQL (PostgreSQL, MySQL) and NoSQL databases (MongoDB, DynamoDB, Elasticsearch)
- Preferred Experience
- Familiarity with financial data sources (market data, fundamental data, alternative data)
- Knowledge of data streaming technologies (Kafka, Kinesis, Pub/Sub)
- Experience of Analytics/Warehouse/OLAP DB (BigQ, SingleStore, RedShift, ClickHouse)
- Experience with containerization (Docker) and orchestration (Kubernetes)
- Understanding of MLOps practices and tools
- Experience with data quality frameworks (Great Expectations, Deequ)
- Professional Skills
- Bachelor's or Master's degree in Computer Science, Data Engineering, or related technical field
Compensation
- The base pay for this role is expected to be between $225k and $275k.
Company info
- Schonfeld is a global multi-manager hedge fund that strives to deliver industry-leading risk-adjusted returns for our investors.
- We leverage both internal and external portfolio manager teams around the world, seeking to capitalize on inefficiencies and opportunities within the markets.
- We draw from decades of experience and a significant investment in proprietary technology, infrastructure and risk analytics to invest across four main strategies: Quant, Tactical, Fundamental Equity and Discretionary Macro & Fixed Income.
- At Schonfeld, we'll invest in you.
- Attracting and retaining top talent is at the heart of what we do, because we believe that exceptional outcomes begin with exceptional people.
- We foster a culture where talent is empowered to continually learn, innovate and pursue ambitious goals.
- We are teamwork-oriented, collaborative and encourage ideas-at all levels-to be shared.
- As an organization committed to investing in our people, we provide learning and educational offerings and opportunities to make an impact.
- We encourage community through internal networks, external partnerships and service initiatives that promote inclusion and purpose beyond the firm's walls.
- The base pay for this role is expected to be between $225k and $275k.
- The expected base pay range is based on information at the time this post was generated.
- This role may also be eligible for other forms of compensation such as a performance bonus and a competitive benefits package.
- Actual compensation for the successful candidate will be determined based on a variety of factors such as skills, qualifications, and experience.
Apply directly at Schonfeld →Create a free account for alerts like thisView Schonfeld immigration profile
This listing is sourced directly from Schonfeld's careers page and normalized into a canonical job model.