Address
Form of work
SalaryDay Rate: £500 to £600
Duration: 6 Months
Location: Home-based. London or Horsham - one or two days a month
You must have experience in the insurance sector to be considered for this role.
The Role:
As a Senior Data Engineer, you will play a crucial role in the architecture, design, and implementation of their data infrastructure. You will be responsible for developing, maintaining, and optimizing our data pipelines, and data warehouse, ensuring the highest standards of data quality and reliability. Working closely with the MI and business teams, you will enable data-driven decisions that drive efficiency, innovation, and competitive advantage in the insurance market.
Key Responsibilities:
- Design and implement scalable, efficient, and secure data architectures to support the storage and retrieval of insurance-related data.
- Collaborate with relevant stakeholders to ensure alignment with overall business goals.
- Develop and maintain Extract, Load, Transform (ELT/ETL) processes to ingest, clean, and transform diverse data sets from various sources into a unified format.
- Optimise ELT/ETL workflows for performance, reliability, and scalability.
- Integrate data from internal and external sources to provide a comprehensive and unified view of insurance-related data.
- Work closely with relevant departments including finance, underwriting and pricing to understand data requirements for analytics and reporting.
- Implement data quality checks and validation processes to ensure the accuracy and completeness of insurance data.
- Identify and address data quality issues promptly. Documenting issues and remedial action.
- Monitor and optimise the performance of data pipelines, databases, and data storage systems.
- Implement best practices for data indexing, partitioning, and optimisation.
- Implement and enforce data security measures to protect sensitive insurance data.
- Ensure compliance with data privacy regulations and industry standards.
- Collaborate with analysts to understand their data requirements and assist in the development of data models for predictive analytics.
- Maintain comprehensive documentation of Data Engineering processes, data models, and ELT workflows.
- Provide documentation for end-users and other stakeholders as needed.
- Stay informed about emerging technologies and best practices in Data Engineering.
- Integrate new tools and technologies to enhance the efficiency and effectiveness of Data Engineering processes.
Technical Skills & Qualifications:
5+ years of experience in Data Engineering, with a proven track record in a similar role, in the insurance sector.
- Expertise in Microsoft Azure, including Azure Data Factory (ADF), Azure SQL Database, and other Azure data services.
- Strong experience with SQL, including complex query writing, performance tuning, and database design.
- Proficiency in ETL and ELT processes, with hands-on experience designing and implementing data pipelines.
- Familiarity with data modelling, data warehousing, and data governance principles.
- Excellent problem-solving skills, with the ability to work independently and as part of a team.
- Strong communication and interpersonal skills, capable of engaging effectively with both technical and non-technical stakeholders.
