Senior Data Engineer for Investment Firm

The client, a leading global investment firm with a strong focus on technology and systematic strategies, is seeking an experienced Data Engineer to join their expanding London office. The role is a Senior Data Engineer set to join a team responsible for building a research-facing data platform that supports systematic trading and electronic market-making. The platform is designed to make market and reference data consistent, traceable, and easy to use at scale while working directly with Quants and Traders.

Senior Data Engineer Responsibilities

• Build and evolve a cloud-native data platform supporting research and trading workflows
• Develop and maintain Python-first data pipelines and access layers for large-scale datasets
• Design and standardise datasets across asset classes, ensuring consistency and usability
• Implement and improve data lineage, freshness tracking, and metadata systems
• Work with columnar data processing tools (e.g. PyArrow, Polars) for efficient data handling
• Collaborate closely with Quants and Researchers to improve how data is consumed and used
• Continuously enhance a pragmatic, production data environment, balancing performance, reliability, and maintainability
• Take ownership of systems end-to-end, from ingestion through to consumption

Key Requirements

• 5+ years' experience building data platforms or data infrastructure
• Strong Python and SQL skills (Python-first engineering environment)
• Experience with data modelling, schema design, and dataset standardisation
• Hands-on experience with cloud environments (ideally AWS)
• Experience working with large-scale, real-world datasets in production
• Familiarity with workflow orchestration tools (e.g. Airflow)
• Exposure to columnar data processing (e.g. PyArrow, Polars, Spark)