Data Engineer Azure

KEY ACCOUNTABILITIES

• Work within the GTS Data Services team using a professional and recognised lifecycle approach covering analysis, planning, design, development, testing, deployment, and maintenance.
• Be involved in the design, engineering, improvement and productionzation of enterprise level data solutions using appropriate Azure data related resources including Azure Data Factory and Azure Databricks
• Use provided business requirements to engineer appropriate data driven solutions.
• Use the central and GTS Data Services' standards to ensure appropriate code quality and that agreed patterns and practices are being followed.
• Produce appropriate test scripts.
• Be involved in unit and integration testing.
• Assist other data professionals (data scientists, data analysts and other data consumers).
• Be involved with the creation and maintenance of a curated data model for use by data professionals.
• Perform data profiling and data quality measurements.
• Comply with data governance and SSE Security Standards.
• Ensure CI/CD best practice are followed for transition of solutions from development, through testing, into production following an appropriate change control mechanism.
• Support solutions in production.
• Proactively suggest improvements to solutions.
• Be involved with any prototyping / discovery work (and transition these to formal development and thus production supported solutions as appropriate).
• Help promote a better understanding of data and analytics across business stakeholders.
• Work with key business stakeholders, IT experts and subject-matter experts to plan and deliver optimal analytics and data science solutions, promote effective data management practices, and improve understanding of data and analytics.
• Help protect SSE from cyberattack and data loss by following standards and instructions and by reporting risks and incidents.
• critical systems in a medium/large organisation.
• extensive experience in developing and maintaining solutions.
• fully conversant with agile

KNOWLEDGE, SKILLS, AND EXPERIENCE

• Business Knowledge
• Display a solid understanding of the SSE business area relevant to where the design will be applied.
• Understanding the 'what' and the 'why' behind requirements and strategy to ensure that solutions being engineered fulfil their purposes and deliver value.
• Be aware and query non-functional, as well as functional needs.
• Experience working with a diverse set of stakeholders to achieve business deliveries.
• Understanding of data integrity, data protection and data security threats.

Essential Functional / Technical Skills

• Relevant Professional Qualification and/or Undergraduate Degree.
• Excellent technical computing, analysis, design, and development skills to a proven professional level.
• Experience from a similar support or development role in supporting business concepts as applied to data driven analytics projects.
• Experience with designing, building, and operating analytics solutions using Azure cloud technologies.
• Understanding of the full software development life cycle and ability to apply it to complex projects.
• Data management, engineering, and analysis experience
• Experience in automated data driven testing and analysis.
• Building and maintaining ETL processes
• Data visualisation/ exploration