Senior Data Engineer

Do you love new challenges? Are you excited about new technology experimentation? Are you looking for a new challenge that stretches your talents? Then this could be the role for you.

We are looking for a Senior Data Engineer that enjoys leading a team and likes solving complex problems across a full spectrum of technologies. You will help ensure our technological infrastructure operates seamlessly in support of our business objectives and that the team are.

You will work closely with the Data Manager and Principle Data Engineer and help us to create and develop data as we move forward into our new Snowflake environment to ensure we deliver accurate and timely information to the rest of the business.

DUTIES

• Supporting with the training and development of the Data Engineering team
• Ensuring documentation is created and of the required standard
• Over-seeing DevOps and the adoption by the Data Engineering team
• Ensuring that the Team are on the latest version of the relevant software
• Supporting the Data Manager
• Being the point of contact for the team when the data manager is not available
• Develop and implement data pipelines that extract, transform and load data using into our Snowflake environment for use with reporting tools such as Power BI and SSRS.
• Work on ingesting, storing, processing and analysing large data sets.
• Assist in the creation and maintenance of a scalable and high-performance data warehouse.
• Translate complex technical and functional requirements into detailed designs.
• Investigate and analyse alternative solutions to data storing, processing etc. to ensure the most streamlined approaches are implemented.

RESPONSIBILITIES

• Ensure the team are up to date on all administrative tasks
• Ensure the team are updating and utilising DevOps to its full ability and adhering to best practice
• Ensure that the team are versioning code, and that coding standards are in place and being adopted.
• Ensure that the team are versioning Talend jobs in accordance with the best practices
• Ensure that the Team are on the latest version of the relevant software.
• Develop and maintain data pipelines implementing ETL/ELT processes using the appropriate business tools.
• Take responsibility for data set development and implementation.
• Work closely with the wider data and BI Team’s in implementing data analytic pipelines.
• Help define data governance policies and support data versioning processes.
• Maintain security and data privacy.
• Define, build and maintain the data pipelines that will enable faster, better, data-informed decision-making within the business.
• An expert in SQL development, designing and developing scalable ETL packages from the business source systems.
• Analyse complex data elements and systems, data flow, dependencies, and relationships in order to contribute to conceptual physical and logical data models.
• Responsible for designing, architecting and developing the data environment.
• Supporting and influencing the implementation of the data strategy.
• Work collaboratively with the entire Data & Analytics teams, providing support to the entire department for its data centric needs.
• Keep up with industry trends and best practices, advising senior management on new and improved Data Engineering strategies that will drive departmental performance, promoting informed decision-making, and ultimately improving overall business performance.
• Performs similar duties as delegated by the Data Manager, Principle Data Engineer, Head of Data & Analytics and Chief Information Officer.
• Convey technical messages to collaborative non-technical departments and colleagues.
• Documentation of Data architecture, policies, and procedures.

GENERAL INFORMATION

• To attend for work reliably and punctually and to follow a work pattern as required fulfilling the role, which may include working overtime if the need arises.
• To know where to access policies, to keep yourself up to date with all procedures and policy changes and to be aware of and follow their contents.
• To develop your own and your teams, practice through the supervision and appraisal process, ensuring your continuous professional development needs are identified and addressed.
• Use an appropriate level of confidentiality where personal information is involved with regard to both individuals in our care and employees.
• To ensure that people with whom you have contact have equal opportunities, to acknowledge their individual differences and uphold their rights and responsibilities, including the right not to be discriminated against, as set out in law and by policies.
• To carry out, as and when required, any additional tasks and responsibilities as are reasonably compatible with this job description and its objectives.
• A duty exists (under Health & Safety legislation) to take reasonable care for the health and safety of yourself and that of others. This implies taking positive steps to understand the hazards in the workplace, to evaluate and take action to reduce the risks. It is expected that you comply with safety rules and procedures and to ensure that nothing you do, or fail to do, puts yourself or others at risk.
• It is everyone’s responsibility to ensure that everything possible is done to protect individuals in our care from abuse of a physical, sexual, neglectful, financial or institutional nature. This includes an absolute requirement to report any incident of this nature you witness, hear about or suspect.

This job description is an outline of the key tasks and responsibilities of the role and is not intended as an exhaustive list. The job may change over time to reflect the changing needs of the business, as well as the personal development needs of the post holder.

Due to limits on sponsorship allocations, we are not currently in a position to offer sponsorship to new candidates for these roles, this remains under review.

We reserve the right to close this vacancy early if we receive sufficient applications for the role. Therefore, if you are interested, please submit your application as early as possible.