Drweng
Senior Data Engineer, Unified Platform
Chicago, New York City · Senior
Sponsorship not specified$200k-$250kDetected 23 days ago
PythonJavaSQLNoSQLCassandraKubernetesgRPCKafkaSparkAirflowData EngineeringProject ManagementResearchCommunicationProblem Solving
About the role
- DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world.
- Headquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets.
Responsibilities
- Model, build, and manage data products built atop DRW's Unified Data Platform.
- Work closely with Data Strategists to determine appropriate data sources and implement processes that onboard and manage new datasets for trading, research, and back-office purposes.
- Design data governance processes that enable discovery, cost-sharing, usage tracking, access controls, and quality control of datasets to address the needs of DRW trading teams and strategies.
- Continually monitor data ingestion pipelines and data quality to ensure stability, reliability, and quality of the data. Design monitoring and quality control software and processes.
- Own the technical aspects of vendor ingestion pipelines, coordinating with vendor relationship managers on upcoming changes, performing routine data operations without breaking internal users, and contributing to the team's on-call rotation to respond to unanticipated changes.
- Proven ability to deliver rapid results within processes that span multiple stakeholders.
- Extensive familiarity with SQL and Java or Python, with a proven ability to develop and deliver maintainable data transformations for production data pipelines.
Requirements
- Extensive knowledge of data modeling techniques
- We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.
- 7+ years of experience working with modern data technologies and building data-first products.
- Experience with one or more data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.).
- Experience with multiple data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.) and knowledge of their associated trade-offs.
- Experience with multiple data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.).
Compensation
- The annual base salary range for this position is $200,000 to $250,000 depending on the candidate's experience, qualifications, and relevant skill set.
This listing is sourced directly from Drweng's careers page and normalized into a canonical job model.