About the Role:

CRU is undergoing a data transformation that will revolutionise how market information about commodities will be delivered to clients. The Senior Data Engineer role is part of the team spearheading this transformation and will be key in the development of internal analytical data platforms and customer facing data products.

The role has a direct impact on how our customers consume our content and data. The role requires an individual who can focus on the detail while being aware of customer needs and the wider product development strategy.

Responsibilities:

  • Develops and maintains scalable data pipelines to power new initiative data products in the commodity industry.
  • Use the latest data analytics and quality tools to ensure our data meets our strict data standards.
  • Design and implement new data pipelines using best in class tools such as Airflow, DBT, Snowflake etc.
  • Build a scalable cloud infrastructure on Azure using modern technologies such as terraform.
  • Build quality data software leveraging best practices and coding standards.
  • Bring your own ideas to show us how we can do things better.

Essential Criteria:

Qualifications:

  • Degree-level education, preferably in a technology focused subject, such as computer science or information technology from a top university (or equivalent through professional qualifications and experience)

Required Skills:

  • 5 years of SQL experience
  • 2 years Snowflake experience
  • 2 years dbt experience
  • Experience in a start-up
  • Ability in managing and communicating data warehouse plans to internal clients
  • Experience designing, building, and maintaining data processing systems
  • Experience with Azure cloud services, DBT, Airflow, Kubernetes, GitHub
  • Contribution to opensource software
  • Active GitHub profile

Preferred Skills and Experience:

  • Experience with Airflow & Kubernetes
  • Ability in managing and communicating data warehouse plans to internal clients
  • Experience designing, building, and maintaining data processing systems
  • Experience in a self-starter environment (e.g. start-up/scale-up)
  • Contribution to opensource software
Join the Team

Markets are changing, and technology is advancing, making data expertise crucial for efficient, sustainable growth. At CRU, we help businesses meet these challenges as a leading data intelligence partner by staying adaptable, collaborative, and proactive.

Apply Now

Related Content