Specialist Data Engineer

Job summary
We are seeking a Specialist Data Engineer to play a pivotal role in steering the Data Engineering team towards achieving strategic analytic objectives.This is an exciting opportunity to make a significant impact in Anglo American, leveraging cutting-edge technologies in Azure and Databricks.The ideal candidate will bring a mix of technical expertise, leadership skills, and a passion for data-driven decision-making in the mining industry.
Job seniority: mid-to-senior level
Responsibilities
• Responsible for leading the design and implementation of Data Engineering core capabilities in a data platform based on Azure and Databricks Technologies.• Ensure the optimization and reliability of data workflows, pipelines, and user interfaces.• Design and implement robust, scalable, and cost-effective data solutions using Azure and Databricks Technologies.• Oversee and lead a team of Data Engineers, ensuring effective team operations and project execution.• Develop and implement effective data strategies and architectures in alignment with organizational goals and industry best practices.• Oversee and manage internal data-related projects, ensuring timely delivery and adherence to high-quality standards.• Work closely with cross-functional teams to ensure alignment of Data Engineering efforts with business needs.• Regularly evaluate and improve data systems and processes for efficiency, scalability, and reliability.• Implement robust capabilities to guarantee that the Data Platform adheres to regulatory compliance standards.
Requirements
• An undergraduate qualification (Bachelors / Honours degree or equivalent) in computer science, business informatics, engineering/technology or equivalent• Deep understanding of Azure cloud services, including Azure Data Lake, Azure SQL Database, Azure Data Factory, and other relevant Azure services.• Advanced knowledge of Databricks, including the Unified Analytics Platform and Delta Lake for big data processing and analytics.• Strong background in data warehousing concepts, ETL processes, and tools.• Knowledge of data security, privacy laws, and compliance regulations relevant to the mining industry and global operations such as GDPR, HIPAA, CCPA.• Familiarity with big data technologies and trends, and how they can be leveraged in a mining context.• In-depth knowledge of data management best practices, data storage, federation, virtualization, service techniques and technologies.
Key Skills Needed
• Deep understanding of Azure cloud services• Advanced knowledge of Databricks• Strong background in data warehousing concepts• Knowledge of data security and compliance regulations• Familiarity with big data technologies• In-depth knowledge of data management best practices