Azure Data Engineer | Outside IR35 | 3 - 6 Months | Mostly Remote |Healthcare.
SR2 is pleased to partner with a London-based consultancy at the forefront of developing a cutting-edge healthcare product. We are actively seeking a skilled Azure Data Engineer to join our dynamic team on a 3-6 month contract (Outside IR35). This role requires a passionate individual with a strong technical background in Python, Azure, Docker, and related technologies. The successful candidate will play a crucial role in building robust data pipelines, managing technical client relationships, and contributing to the success of our healthcare product.
Responsibilities:
Data Pipeline Development:
- Research, define, and implement data pipelines to process and analyze health data efficiently.
- Leverage Python, Pandas, and Luigi to design and optimize data processing workflows.
Client Relationship Management:
- Serve as the main point of contact for technical client interactions, ensuring effective communication and understanding of client requirements.
- Work collaboratively to align data solutions with client needs.
Continuous Integration (CI) Pipelines:
- Develop and maintain CI pipelines using Gitlab CI to automate the building and deployment of data pipelines and associated web applications.
- Ensure version control and code integration best practices are followed.
Infrastructure as Code (IaC):
- Implement Infrastructure as Code (IaC) using Bicep to manage Azure and on-premises server environments.
- Deploy and manage Azure services such as Azure Container Registry (ACR), web apps, managed Postgres, Azure Data Factory, blob storage, and networking components.
Monitoring and Troubleshooting:
- Establish robust monitoring practices for data pipelines and web applications to detect and resolve issues promptly.
- Demonstrate proficiency in troubleshooting and resolving complex technical challenges.
Sysadmin Tasks:
- Perform routine system administration tasks on on-premises servers, ensuring their stability and security.
Key Skills:
Python and Pandas:
- Extensive experience in Python programming for data manipulation and analysis using Pandas.
Docker:
- Proficiency in containerization using Docker for packaging, distributing, and running applications.
Azure Services:
- In-depth knowledge and hands-on experience with Azure services, including ACR, web apps, managed Postgres, Azure Data Factory, blob storage, and networking.
Gitlab CI:
- Strong understanding and practical experience with Gitlab CI for continuous integration and deployment.
Bicep:
- Experience with Infrastructure as Code using Bicep for Azure resource provisioning and management.
Linux (on-prem servers):
- Solid command of Linux systems, particularly in on-premises server environments.
C#:
- Familiarity with C# to review and debug applications within a small team setting.
Qualifications and Experience:
- Proven track record as a Data Engineer, with specific emphasis on Azure environments.
- Exposure to healthcare data processing is advantageous.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills within a team environment.
Azure Data Engineer | Outside IR35 | 3 - 6 Months | Mostly Remote |Healthcare.