Senior Data Engineer - Databricks & Pyspark

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around 2 times per month.

This organisation have invested a lot into their data function in recent years, and they are now fully operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team!

As this is a Senior role, you will support the Lead Data Engineer to mentor and lead the Data Engineering team. You will lead on the development of technical specifications and architecture around the Data Lake, and will still be very technically hands-on in writing code using SQL and Python scripting languages, and undertaking a wide variety of technical work.

This is a crucial hire, where you will become the point of expertise for all data-related projects, whilst having a real influence in the implementation of the organisation's data strategy and transformation roadmap.

This is a brilliant opportunity for an experienced Data Engineer who is keen to progress their career with a company who will encourage you to provide thought leadership, and to innovate and experiment with new technologies to deliver benefits to the business.

Requirements

• Excellent skills in Databricks and Pyspark
• Excellent understanding of SQL and/or CosmosDB databases
• Experience designing, developing and maintaining data warehouses and data lakes
• Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse
• Knowledge of Agile methodology
• Excellent communication and problem-solving skills

Benefits

• Salary up to £75,000 depending on experience
• 25 days annual leave plus additional 3 to be taken over Christmas - New Year
• Private healthcare
• Annual discretionary bonus

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, the London Power BI User Group, Newcastle Power BI User Group and Newcastle Data Platform and Cloud User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed)