Address
SalaryWhy this job matters
Your role as a Big Data Engineer in the Cyber Platform team is integral to the build and configuration of our threat hunting and intelligence solutions, used to maintain and protect BTs customers and core network. These platforms are actively used to detect and stop potential threats to our customers and BT as an organization. Join our high performing, efficient and adaptable software team to be at the forefront of Big Data as we look to build the next generation big data platform to identify cyber threats and provide our customers the data they require to protect BT.
The Big Data Developer is responsible for designing, developing, and maintaining large-scale data processing systems. This role involves working with big data technologies to manage and analyse vast amounts of data, ensuring efficient data storage, retrieval, and processing.
What you’ll be doing
You’ll work closely with cross-functional teams to ensure the availability, security, and performance of our data platform. The Big Data Developer will collaborate with data scientists, analysts, and other IT professionals to build robust data solutions that support business objectives.
Skills Needed Data Pipeline Development:
• Design, develop, and implement scalable and efficient data pipelines.
• Integrate data from various sources, including databases, APIs, and streaming platforms.
• Ensure accurate and efficient data processing and transformation.
Experience Expected Mandatory:
• In-depth understanding of open-source big data tools: o Apache Hadoop: Distributed storage and processing framework for large-scale data tasks.
• Apache Spark: In-memory compute for ETL, machine learning, and data science workloads. Apache Kafka: Scalable, fault-tolerant messaging system.
• Java Development: - Write and maintain Java applications for data pipelines. Troubleshoot Java-related issues within the ACP Platform.
• DevOps: - Write Puppet modules for deployment management. • Familiarity with GIT and CI/CD pipelines. • Operating Systems: o Proficiency in Linux and shell scripting.
The skills you’ll need
Our leadership standards
Looking in:
Leading inclusively and Safely
I inspire and build trust through self-awareness, honesty and integrity.
Owning outcomes
I take the right decisions that benefit the broader organisation.
Looking out:
Delivering for the customer
I execute brilliantly on clear priorities that add value to our customers and the wider business.
Commercially savvy
I demonstrate strong commercial focus, bringing an external perspective to decision-making.
Looking to the future:
Growth mindset
I experiment and identify opportunities for growth for both myself and the organisation.
Building for the future
I build diverse future-ready teams where all individuals can be at their best.
With over 175 years of heritage, BT is now the flagship business brand of BT Group. We’ve brought together our best people and capabilities into a B2B powerhouse serving 1.2 million business customers internationally.
We’re a global leader for secure connectivity and collaboration platforms for businesses of all shapes and sizes, from big household names and government departments, right through to sole traders and new start-ups. But it’s not just the technology that matters, it’s what it can do to help them build stronger, smarter, more secure businesses.
We value diversity and inclusion and believe in making a positive impact. We connect for good by championing digital inclusion and equipping people, businesses, and communities with digital skills to thrive.
As a member of our team, you will be part of an organisation that celebrates difference, fosters innovation and provides you with opportunities to be your best. With millions of businesses relying on us daily, joining BT means you can be part of a diverse and multi-skilled team that makes a significant impact to society.
A FEW POINTS TO NOTE:
Although these roles are listed as full-time, if you’re a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch.
DON'T MEET EVERY SINGLE REQUIREMENT?
Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.
