Data Engineer

About this role

We're hiring a hands-on Data Engineer to join the Total Fund Management Portfolio Management Technology team. The role focuses on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats.
KEY RESPONSIBILITIES
Develop and optimize Spark workloads in cloud environments Work with
large datasets using Parquet and Iceberg
Translate requirements into robust engineering solutions
Ensure performance, reliability, and maintainability
Contribute to monitoring, documentation, and deployment
MUST HAVE
Strong Python and PySpark
Hands-on Apache Spark, cloud preferred
Databricks experience
Large-scale data systems expertise
Client-facing delivery background
Independent problem-solving in ambiguous settings
NICE TO HAVE
AWS Glue and Lake Formation
Airflow and orchestration tools
Distributed data architectures
Capital markets exposure
Originally posted on Himalayas