Job Description
The CompanyNigel Wright are pleased to be working with a growing North East based solutions provider in their search for a
Data Engineer.
The RoleKey Responsibilities:
- Work closely with Data Architects and Insight Analysts on the development of client's cloud data warehouse and IoT analytics projects utilising cloud technologies such as AWS or Azure.
- Create data pipeline processes which are orchestrated in an optimal manner across data layers and data models.
- Ensure data provenance, quality and lineage can be supported and maintained from development work considering supportability.
- Create and maintain detailed solutions documentation.
- Create and maintenance of Infrastructure as Code Solutions.
The RequirementsThis is a fantastic opportunity to work with market leading technologies and develop client facing skills. You will also naturally have a passion for all things data, keeping up to date with the latest technologies and methodologies, whilst supporting others in the team to continually improve. Key requirements:
- 2+ years prior experience in Data Engineering or business intelligence role.
- Extensive ETL and data pipeline implementation experience, technology agnostic.
- Experience implementing solutions using at least one of the following technologies Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google Big Query, Alteryx, SSIS, Informatica.
- Demonstrable understanding of data warehouse and data lake principles.
- Demonstrable data modelling techniques such as Kimball, Inmon or Data Vault methodologies.