Data Engineer

As we undertake a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, we are growing our Data Engineering capability within the Data Team.

At E.ON Next we're looking for the most ambitious, talented, and creative people out there to join our brand new, fresh, start-up business. E.ON Next is one of the biggest energy providers in the UK and plays a crucial role in shaping the UK energy market. This isn't the old energy as you know it - we're all-in on 100% renewable energy and sustainability and focussing what we do around our customers. This is new, exciting, and waiting for stars like you to shape it. Do you love delivering for customers?

Are you full of energy, ideas, and passion?

A taste of what you'll be doing:

• You will build and maintain scalable and efficient data pipelines within Databricks in accordance with best practice. You will evolve and improve these pipelines as requirements change and as new technologies become available.

• You will build towards and maintain an enterprise data model within Databricks.

• You will integrate new sources into the data platform through the use of batch and streaming processes, all the while adhering to committed SLAs.

• You will create and maintain documentation of data pipelines and associated systems, and adhere to the security and monitoring processes around data.

• You will ensure data quality and reliability processes are effective and adhered to, ensuring trust in the data.

• You will help maintain existing non-Databricks data pipelines, including monitoring and troubleshooting.

Are you the person for the job?

• You will have a strong Python background, ideally with at least a year's experience of building solutions using Python. You will require working knowledge of intermediate Python concepts such as, but not limited to, decorators, context managers, and comprehensions.

• You will have a good understanding of SQL and database design.

• Databricks or Spark experience is a plus, but otherwise you should be willing to learn.

• You will be familiar with concepts of data governance, data cataloguing, and data quality principles.

• You will have experience of data extraction, joining, and aggregation tasks. Any experience using Spark is a bonus, but otherwise you will be expected to learn Spark/Databricks.

• You will be able to perform data cleansing operations to prepare data for analysis, including transforming data into useful formats.

• You will be able to explain data storage concepts and logical data structures ie. data warehousing.

• You will be able to write repeatable, production quality code as part of your data pipelines, taking advantage of templating and parameterisation where needed.

• You should be able to make recommendations for data pipeline design based on business requirements.

• You will need to be open to new ways of working, and open to working with new technologies.

• You will need to be able to set your own goals and take the initiative when working.

• You should have a drive to troubleshoot and deconstruct problems, and build appropriate solutions.

What else do I need to know?

• Closing date - Friday 1st March 2024

• We'll have regular team socials and lively team chats

• Competitive salary

• Location - London, Leicester or Nottingham with travel to our other sites when required.

• Working environment: Flexible hybrid working - a blend of in the office and home working.

• 26 days holiday plus bank holidays each year - this includes a guaranteed day of for your birthday off if you want it.

• A generous pension scheme.

• The chance to choose from our award-winning Flexible Benefits package which includes the option to buy up to 10 days holiday a year.

• We've exciting opportunities for everyone to develop their talent at E.ON. Our open access, inclusive talent networks provide networking, learning and development for all, building your skills, qualifications, and capabilities throughout your career.

• For all successful candidates. Due to the nature of this role your employment will be subject to a basic DBS (Disclosure Barring Service) check being carried out by ourselves via a 3rd party service provider

We're committed to equal opportunities and actively promote a diverse and inclusive working environment, and fairness for everyone.
We realise the best people bring their energy at different times, so we're happy to talk flexible working. We offer a range of flexible working options, including full time, part time, job share, remote working and variable start and finishing times.