Senior Data Engineer - Aws

Company profile

A global energy company with a huge renwable and low-carbon project with opportunties aroung the world. A great place to grow your skill set and reach your potential in a sustainable and diverse work force.

Job Description

As a Senior Data Engineer, you will be responsible for:

• Designing, implementing and maintaining large scale data processing systems on AWS

• Experienced working in MPP platforms/Spark

• Responsible for end to end Ci/CD data pipelines

Skills

• Coding in SQL, Python

• Excellent Communicator

• Communiate the needs to the wider business

Requirements

• 10+ years in the Data Engineering space with experience in ECS, EKS, Lambda, DynamoDB, Kinesis, AWS Batch, ElasticSearch/OpenSearch, EMR, Athena, Docker/Kubernetes

• Proficient with MPP Databases (Snowflake, Redshift, Big Query, Azure DW) and/or Apache Spark

• Infrastructure as Code (Terraform, Cloud Formation, Ansible, Serverless)

If this is of interest, please apply!

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.